matrixportal
/

Llama-3.2-3B-Instruct-GGUF

Text Generation

Inference Endpoints

Model card Files Files and versions Community

Llama-3.2-3B-Instruct-GGUF

1 contributor

History: 22 commits

matrixportal's picture

Upload llama-3.2-3b-instruct-q3_k_l.gguf with huggingface_hub

fbd96ee verified 15 days ago

.gitattributes
2.28 kB

Upload llama-3.2-3b-instruct-q3_k_l.gguf with huggingface_hub 15 days ago
README.md

17.2 kB

Upload README.md with huggingface_hub 15 days ago
llama-3.2-3b-instruct-q2_k.gguf

1.36 GB
LFS

Upload llama-3.2-3b-instruct-q2_k.gguf with huggingface_hub 15 days ago
llama-3.2-3b-instruct-q3_k_l.gguf

1.82 GB
LFS

Upload llama-3.2-3b-instruct-q3_k_l.gguf with huggingface_hub 15 days ago
llama-3.2-3b-instruct-q3_k_m.gguf

1.69 GB
LFS

Upload llama-3.2-3b-instruct-q3_k_m.gguf with huggingface_hub 15 days ago
llama-3.2-3b-instruct-q3_k_s.gguf

1.54 GB
LFS

Upload llama-3.2-3b-instruct-q3_k_s.gguf with huggingface_hub 15 days ago
llama-3.2-3b-instruct-q4_k_m.gguf

2.02 GB
LFS

Upload llama-3.2-3b-instruct-q4_k_m.gguf with huggingface_hub 15 days ago
llama-3.2-3b-instruct-q4_k_s.gguf

1.93 GB
LFS

Upload llama-3.2-3b-instruct-q4_k_s.gguf with huggingface_hub 15 days ago
llama-3.2-3b-instruct-q5_0.gguf

2.27 GB
LFS

Upload llama-3.2-3b-instruct-q5_0.gguf with huggingface_hub 15 days ago
llama-3.2-3b-instruct-q5_k_m.gguf

2.32 GB
LFS

Upload llama-3.2-3b-instruct-q5_k_m.gguf with huggingface_hub 15 days ago
llama-3.2-3b-instruct-q5_k_s.gguf

2.27 GB
LFS

Upload llama-3.2-3b-instruct-q5_k_s.gguf with huggingface_hub 15 days ago
llama-3.2-3b-instruct-q6_k.gguf

2.64 GB
LFS

Upload llama-3.2-3b-instruct-q6_k.gguf with huggingface_hub 15 days ago
llama-3.2-3b-instruct-q8_0.gguf

3.42 GB
LFS

Upload llama-3.2-3b-instruct-q8_0.gguf with huggingface_hub 15 days ago