Edit Models filters

Model Tree

meta-llama/Llama-3.2-3B-Instruct

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

139

Full-text search

Active filters: meta-llama/Llama-3.2-3B-Instruct

Esperanto/llama-3.2-3B-Instruct-kvc-fp16-onnx

Text Generation • Updated Oct 9 • 11 • 1

sheldonrobinson/Llama-3.2-3B-Instruct-Q8_0-GGUF

Text Generation • Updated Oct 10 • 12 • 1

kinetical/llama3.2-3b-simulMT-et-en

Updated 9 days ago • 89 • 2

mav23/Llama3.2-3B-Enigma-GGUF

Text Generation • Updated Oct 10 • 363 • 1

mav23/Llama-3.2-3B-Instruct-abliterated-GGUF

Updated Oct 11 • 470 • 1

QuantFactory/Reasoning-Llama-3b-v0.1-GGUF

Updated Oct 13 • 681 • 3

saishshinde15/TethysAI_Research

Updated Oct 14 • 150 • 2

xmadai/Llama-3.2-3B-Instruct-xMADai-INT4

Text Generation • Updated 24 days ago • 123 • 6

apto-as/Llama-3.2-3B-Instruct-Q5_K_M-GGUF

Text Generation • Updated Oct 17 • 5 • 1

AIFunOver/Llama-3.2-3B-Instruct-openvino-8bit

Text Generation • Updated 10 days ago • 32 • 1

paultimothymooney/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Sep 25 • 8

mlc-ai/Llama-3.2-3B-Instruct-q0f16-MLC

Updated Sep 25 • 7

mlc-ai/Llama-3.2-3B-Instruct-q0f32-MLC

Updated Sep 25 • 9

jxtngx/Meta-Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Sep 25 • 62

neuralmagic/Llama-3.2-3B-Instruct-quantized.w8a8

Text Generation • Updated Oct 16 • 1.61k • 1

mukel/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated Sep 26 • 195

baslak/Llama-3.2-3B-Instruct-ONNX-Q4

Updated Sep 25 • 13

baslak/Llama-3.2-3B-Instruct-ONNX-Q4-F16

DevQuasar/Llama-3.2-3B-Instruct-GGUF

Updated Sep 26 • 32

MCZK/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated Sep 26 • 382 • 1

mlc-ai/Llama-3.2-3B-Instruct-q4f16_0-MLC

Updated Sep 26 • 2.1k

SandLogicTechnologies/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated Sep 26 • 30

SanctumAI/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated Sep 26 • 34k • 1

jimjimjimmyjim/Llama-3.2-3B-Instruct-Q8_0-GGUF

Text Generation • Updated Sep 26 • 8

numen-tech/Llama-3.2-3B-Instruct-w4a16g128asym

Text Generation • Updated Sep 26

paultimothymooney/Llama-3.2-3B-Instruct-Q8_0-GGUF

Text Generation • Updated Sep 26 • 8

brunopio/Llama-3.2-3B-Instruct-nbits4-GS64-Axis1-HQQ

Updated Sep 26 • 3

brunopio/Llama-3.2-3B-Instruct-nbits4-GSNone-Axis0-HQQ

Updated Sep 26 • 2

pingzhou/Llama-3.2-3B-Instruct-Q8_0-GGUF

Text Generation • Updated Sep 26 • 4

rohanprichard/Llama-3.2-3B-Instruct-MLC

Updated Sep 27 • 3