Please use the superior (tested) quant thats now been moved to ConfidentialMind org.

Cheers, Jaro

Downloads last month
27
Safetensors
Model size
4.91B params
Tensor type
I32
BF16
FP16
Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API: The model has no library tag.