VPTQ Llama 3.3 70B Instruct without finetune
Collection
arxiv.org/abs/2409.17066, VPTQ Llama 3.3 70B without finetune
•
6 items
•
Updated
Disclaimer:
The model is reproduced based on the paper VPTQ: Extreme Low-bit Vector Post-Training Quantization for Large Language Models github and arXiv
The model itself is sourced from a community release.
It is intended only for experimental purposes.
Users are responsible for any consequences arising from the use of this model.
- Downloads last month
- 7
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support
Model tree for VPTQ-community/Meta-Llama-3.3-70B-Instruct-v16-k65536-16384-woft
Base model
meta-llama/Llama-3.1-70B
Finetuned
meta-llama/Llama-3.3-70B-Instruct