Hugging Face's logo

TitanML
/
tiny-mixtral-AWQ-4bit

Text Generation
Transformers
Safetensors
mixtral
text-generation-inference
4-bit precision
awq
Model card Files
xet
Community

No model card

Downloads last month
2,211
Safetensors
Model size
89.8M params
Tensor type
I32
·
F16
·
Inference Providers NEW
Text Generation
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Collections including TitanML/tiny-mixtral-AWQ-4bit