Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Carbon Emissions

Mixture of Experts

Misc with no match

text-embeddings-inference

Models

2,327

Full-text search

Active filters: chat

NousResearch/Hermes-3-Llama-3.1-8B-GGUF

Updated Aug 23 • 106k • 102

Qwen/Qwen2.5-32B-Instruct

Text Generation • Updated Sep 25 • 130k • 120

Qwen/Qwen2.5-Coder-32B-Instruct-GPTQ-Int4

Text Generation • Updated 6 days ago • 1.88k • 5

Qwen/Qwen2.5-Coder-3B-Instruct-GGUF

Text Generation • Updated 6 days ago • 11.1k • 5

mlx-community/Qwen2.5-Coder-32B-Instruct-4bit

Text Generation • Updated 6 days ago • 562 • 5

Qwen/Qwen2.5-Math-7B-Instruct

Text Generation • Updated Sep 23 • 91.6k • 37

shuttleai/shuttle-3

Text Generation • Updated 23 days ago • 518 • 28

huihui-ai/Qwen2.5-Coder-32B-Instruct-abliterated

Text Generation • Updated 4 days ago • 338 • 4

mradermacher/miscii-14b-1028-GGUF

Updated 4 days ago • 353 • 4

ModelCloud/Qwen2.5-Coder-32B-Instruct-gptqmodel-4bit-vortex-v1

Text Generation • Updated 3 days ago • 47 • 4

bartowski/Qwen2.5-72B-0.6x-Instruct-GGUF

Text Generation • Updated about 20 hours ago • 370 • 4

Qwen/Qwen2-7B-Instruct

Text Generation • Updated Aug 21 • 641k • 586

NousResearch/Hermes-3-Llama-3.1-70B-GGUF

Updated Aug 23 • 1.33k • 35

Qwen/Qwen2.5-72B-Instruct-AWQ

Text Generation • Updated Oct 9 • 25.3k • 39

Qwen/Qwen2.5-Coder-1.5B-Instruct

Text Generation • Updated 6 days ago • 18.8k • 43

anthracite-org/magnum-v4-12b-gguf

Text Generation • Updated 25 days ago • 10.7k • 15

Goekdeniz-Guelmez/Josiefied-Qwen2.5-14B-Instruct-abliterated-v4

Text Generation • Updated 19 days ago • 224 • 9

MarsupialAI/Monstral-123B

Text Generation • Updated about 4 hours ago • 225 • 7

lmstudio-community/Qwen2.5-Coder-32B-Instruct-GGUF

Text Generation • Updated 6 days ago • 2.5k • 3

bartowski/Qwen2.5-Coder-3B-Instruct-GGUF

Text Generation • Updated 8 days ago • 2.63k • 3

lmstudio-community/Qwen2.5-Coder-3B-Instruct-GGUF

Text Generation • Updated 6 days ago • 277 • 3

MaziyarPanahi/calme-3.3-qwenloi-3b

Text Generation • Updated 9 days ago • 41 • 3

lucyknada/Qwen_Qwen2.5-Coder-32B-Instruct-exl2

Text Generation • Updated 6 days ago • 109 • 3

mradermacher/miscii-14b-1028-i1-GGUF

Updated 4 days ago • 1.98k • 3

bartowski/Qwen2.5-Coder-14B-Instruct-abliterated-GGUF

Text Generation • Updated 4 days ago • 1.2k • 3

mlx-community/miscii-14b-1028-4bit

Text Generation • Updated 3 days ago • 11 • 3

Qwen/CodeQwen1.5-7B-Chat-GGUF

Text Generation • Updated Apr 23 • 5.86k • 106

NousResearch/Hermes-3-Llama-3.1-70B-FP8

Updated Sep 8 • 1.9k • 11

Qwen/Qwen2.5-Math-72B-Instruct

Text Generation • Updated Sep 23 • 50.7k • 19

Qwen/Qwen2.5-7B-Instruct-GPTQ-Int8

Text Generation • Updated about 1 month ago • 7.65k • 8