iMatrix GGUFs for https://huggingface.co/Undi95/MG-FinalMix-72B

imat generated with Kalomaxe's groups_merged.txt

Downloads last month
858
GGUF
Model size
72.7B params
Architecture
qwen2
Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.

Model tree for MarsupialAI/MG-FinalMix-72B_iMatrix_GGUF