Edit Models filters

Model Tree

meta-llama/Llama-3.2-3B-Instruct

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

138

Full-text search

Active filters: meta-llama/Llama-3.2-3B-Instruct

prithivMLmods/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated 2 days ago • 178 • 7

bartowski/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated Oct 8 • 118k • 75

prithivMLmods/Llama-Doctor-3.2-3B-Instruct-GGUF

Text Generation • Updated 1 day ago • 91 • 6

hugging-quants/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Sep 25 • 5.27k • 17

mlx-community/Llama-3.2-3B-Instruct-4bit

Text Generation • Updated Sep 25 • 19.8k • 16

MaziyarPanahi/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated Sep 25 • 1.75M • 8

unsloth/Llama-3.2-3B-Instruct-bnb-4bit

Text Generation • Updated Sep 30 • 264k • 14

onnx-community/Llama-3.2-3B-Instruct

Text Generation • Updated Oct 8 • 281 • 10

hugging-quants/Llama-3.2-3B-Instruct-Q8_0-GGUF

Text Generation • Updated Sep 25 • 39.6k • 40

lmstudio-community/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated Sep 25 • 8.2k • 28

samurai-zero/Llama-3.2-3B-Instruct-Q8_0-GGUF

Text Generation • Updated Sep 25 • 12 • 1

mlc-ai/Llama-3.2-3B-Instruct-q4f16_1-MLC

Updated Sep 25 • 893 • 2

bartowski/Llama-3.2-3B-Instruct-exl2

Text Generation • Updated Oct 8 • 106 • 4

mlc-ai/Llama-3.2-3B-Instruct-q4f32_1-MLC

Updated Sep 25 • 803 • 1

neuralmagic/Llama-3.2-3B-Instruct-FP8-dynamic

Text Generation • Updated Oct 9 • 1.92k • 2

legraphista/Llama-3.2-3B-Instruct-IMat-GGUF

Text Generation • Updated Sep 25 • 1.03k • 1

second-state/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated Sep 26 • 1.33k • 1

gaianet/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated Sep 25 • 286 • 1

neuralmagic/Llama-3.2-3B-Instruct-FP8

Text Generation • Updated Oct 16 • 10.9k • 2

Solshine/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Sep 26 • 12 • 1

beethogedeon/Llama-3.2-3B-Instruct-Q4_K_S-GGUF

Text Generation • Updated Sep 26 • 6 • 1

Solshine/Llama-3.2-3B-Instruct-Q8_0-GGUF

Text Generation • Updated Sep 26 • 28 • 1

joshmiller656/Llama3.2-3B-Instruct-AWQ-INT4

Updated Sep 26 • 113 • 1

kingabzpro/llama-3.2-3b-it-Ecommerce-ChatBot

Text Generation • Updated Oct 1 • 289 • 3

QuantFactory/Llama-3.2-Taiwan-Legal-3B-Instruct-GGUF

Text Generation • Updated 15 days ago • 2.25k • 7

QuantFactory/VersatiLlama-Llama-3.2-3B-Instruct-Abliterated-GGUF

Text Generation • Updated Oct 8 • 757 • 3

QuantFactory/Llama3.2-3B-Enigma-GGUF

Text Generation • Updated Oct 8 • 748 • 2

QuantFactory/Llama3.2-3B-ShiningValiant2-GGUF

Text Generation • Updated Oct 8 • 743 • 3

QuantFactory/Llama3.2-3B-Esper2-GGUF

Text Generation • Updated Oct 8 • 659 • 3

QuantFactory/Llama-3.2-3B-Instruct-abliterated-GGUF

Updated Oct 8 • 2.43k • 6