Hugging Face's logo

numen-tech
/
Dolphin3.0-Qwen2.5-3b-GPTQ-Int4

Text Generation
MLC-LLM
English
conversational
4-bit precision
Model card Files
xet
Community

fp16 version of Dolphin3.0-Qwen2.5-3b for inference with Private LLM.

Downloads last month
-
Inference Providers NEW
Text Generation
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for numen-tech/Dolphin3.0-Qwen2.5-3b-GPTQ-Int4

Base model

Qwen/Qwen2.5-3B
Finetuned
dphn/Dolphin3.0-Qwen2.5-3b
Quantized
(34)
this model