Configuration Parsing Warning: In config.json: "quantization_config.bits" must be an integer

original model Meta-Llama-3-70B-Instruct

EXL2 quants of Meta-Llama-3-70B-Instruct

Located in the main branch

2.55 bits per weight
measurement.json

원본 모델 Meta-Llama-3-70B-Instruct

Meta-Llama-3-70B-Instruct 모델 EXL2 양자화

메인 branch에 있는 파일

2.55 bits per weight
measurement.json

Downloads last month: 4

Inference Providers NEW

Text Generation

This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.