Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

Misc with no match

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

69

Full-text search

Active filters: 3b

Triangle104/Llama3.2-3B-ShiningValiant2-Q6_K-GGUF

Text Generation • Updated Nov 19, 2024 • 9

Triangle104/Llama3.2-3B-ShiningValiant2-Q8_0-GGUF

Text Generation • Updated Nov 19, 2024 • 5

Khetterman/Llama-3.2-Kapusta-3B-v8

Text Generation • Updated Nov 20, 2024 • 21 • 1

mradermacher/Llama3.2-3B-Enigma-GGUF

Updated Nov 20, 2024 • 345

mradermacher/Llama3.2-3B-Enigma-i1-GGUF

Updated Nov 20, 2024 • 213

Khetterman/Llama-3.2-Kapusta-JapanChibi-3B-v1

Text Generation • Updated Nov 20, 2024 • 5

tensorblock/open-llama-3b-v2-elmv3-GGUF

Updated Nov 24, 2024 • 68

itlwas/Llama-3.2-Kapusta-3B-v8-Q4_K_M-GGUF

Updated Dec 18, 2024 • 15 • 1

itlwas/Llama-3.2-Kapusta-JapanChibi-3B-v1-Q4_K_M-GGUF

Updated Dec 18, 2024 • 18 • 1

itlwas/Llama-Deepsync-1B-Q4_K_M-GGUF

Text Generation • Updated Dec 29, 2024 • 8

mradermacher/Llama-Deepsync-1B-GGUF

Updated Dec 30, 2024 • 79

mradermacher/Llama-Deepsync-1B-i1-GGUF

Updated Dec 30, 2024 • 120

mradermacher/Llama-Deepsync-3B-GGUF

Updated Dec 31, 2024 • 48

mradermacher/Llama-Deepsync-3B-i1-GGUF

Updated Dec 31, 2024 • 90

QuantFactory/Llama-Deepsync-3B-GGUF

Text Generation • Updated Jan 3 • 199 • 2

QuantFactory/Llama-Deepsync-1B-GGUF

Text Generation • Updated Jan 4 • 110 • 3

matrixportal/Llama-3.2-Kapusta-3B-v8-GGUF

Updated Jan 14 • 3

roleplaiapp/SmallThinker-3B-Preview-Q2_K-GGUF

Text Generation • Updated Jan 16 • 7

roleplaiapp/SmallThinker-3B-Preview-Q3_K_S-GGUF

Text Generation • Updated Jan 16 • 3

roleplaiapp/SmallThinker-3B-Preview-Q3_K_M-GGUF

Text Generation • Updated Jan 16 • 4

roleplaiapp/SmallThinker-3B-Preview-Q3_K_L-GGUF

Text Generation • Updated Jan 16 • 7

roleplaiapp/SmallThinker-3B-Preview-Q4_0-GGUF

Text Generation • Updated Jan 16 • 9

roleplaiapp/SmallThinker-3B-Preview-Q4_K_S-GGUF

Text Generation • Updated Jan 16 • 3

roleplaiapp/SmallThinker-3B-Preview-Q4_K_M-GGUF

Text Generation • Updated Jan 16 • 6

roleplaiapp/SmallThinker-3B-Preview-Q5_0-GGUF

Text Generation • Updated Jan 16 • 5

roleplaiapp/SmallThinker-3B-Preview-Q5_K_S-GGUF

Text Generation • Updated Jan 16 • 4

roleplaiapp/SmallThinker-3B-Preview-Q5_K_M-GGUF

Text Generation • Updated Jan 16 • 4

roleplaiapp/SmallThinker-3B-Preview-Q6_K-GGUF

Text Generation • Updated Jan 16 • 8

roleplaiapp/SmallThinker-3B-Preview-Q8_0-GGUF

Text Generation • Updated Jan 16 • 3

roleplaiapp/SmallThinker-3B-Preview-IQ3_M-GGUF

Text Generation • Updated Jan 16 • 4