hugging-quants/Llama-3.2-3B-Instruct-Q8_0-GGUF
Text Generation
•
3B
•
Updated
•
5.55k
•
52
Llama 3.2 3B & 1B GGUF Quants
Llama.cpp compatible quants for Llama 3.2 3B and 1B Instruct models.
-
-
hugging-quants/Llama-3.2-3B-Instruct-Q4_K_M-GGUF
Text Generation • 3B • Updated • 7.95k • 20 -
hugging-quants/Llama-3.2-1B-Instruct-Q8_0-GGUF
Text Generation • 1B • Updated • 21.6k • 34 -
hugging-quants/Llama-3.2-1B-Instruct-Q4_K_M-GGUF
Text Generation • 1B • Updated • 45.2k • 16