Unquantized (fp16, the parent model is bf16) version of Dolphin3.0-Llama3.2-1B for inference with Private LLM.

Downloads last month
0
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for numen-tech/Dolphin3.0-Llama3.2-1B-q0f16

Quantized
(24)
this model