Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

192

Base only

Active filters: Instruct

prithivMLmods/Llama-Magpie-3.2-3B-Instruct-GGUF

Text Generation • 3B • Updated Nov 30, 2024 • 289 • 2

mradermacher/LUNA-SOLARkrautLM-Instruct-GGUF

11B • Updated Dec 1, 2024 • 293 • 1

mradermacher/LUNA-SOLARkrautLM-Instruct-i1-GGUF

11B • Updated Dec 1, 2024 • 816 • 1

prithivMLmods/Math-IIO-7B-Instruct

Text Generation • Updated Dec 2, 2024 • 25 • 1

prithivMLmods/Math-IIO-7B-Instruct-GGUF

Text Generation • 8B • Updated Dec 2, 2024 • 107 • 4

QuantFactory/Math-IIO-7B-Instruct-GGUF

Text Generation • 8B • Updated Dec 1, 2024 • 1.38k • 3

mradermacher/Math-IIO-7B-Instruct-GGUF

8B • Updated Dec 2, 2024 • 660

mradermacher/Math-IIO-7B-Instruct-i1-GGUF

8B • Updated Dec 2, 2024 • 1.8k

prithivMLmods/Neumind-Math-7B-Instruct

Text Generation • Updated Dec 5, 2024 • 31 • 2

prithivMLmods/Neumind-Math-7B-Instruct-GGUF

Text Generation • 8B • Updated Dec 5, 2024 • 145 • 5

prithivMLmods/Novaeus-Promptist-7B-Instruct

Text Generation • 8B • Updated Dec 23, 2024 • 24 • 4

mradermacher/Neumind-Math-7B-Instruct-GGUF

8B • Updated Dec 6, 2024 • 566 • 1

mradermacher/Neumind-Math-7B-Instruct-i1-GGUF

8B • Updated Dec 6, 2024 • 1.25k • 1

mradermacher/Novaeus-Promptist-7B-Instruct-GGUF

8B • Updated Dec 6, 2024 • 660 • 1

mradermacher/Novaeus-Promptist-7B-Instruct-i1-GGUF

8B • Updated Dec 6, 2024 • 1.7k • 2

mradermacher/SauerkrautLM-Mixtral-8x7B-Instruct-GGUF

47B • Updated Dec 9, 2024 • 210

prithivMLmods/Qwen-UMLS-7B-Instruct

Text Generation • 8B • Updated Dec 14, 2024 • 125 • • 6

mradermacher/SauerkrautLM-Mixtral-8x7B-Instruct-i1-GGUF

47B • Updated Dec 9, 2024 • 775

prithivMLmods/QwQ-LCoT-3B-Instruct

Text Generation • 3B • Updated Dec 14, 2024 • 36 • 5

prithivMLmods/QwQ-LCoT-3B-Instruct-GGUF

Text Generation • 3B • Updated Dec 13, 2024 • 217 • 7

mradermacher/QwQ-LCoT-3B-Instruct-GGUF

3B • Updated Dec 12, 2024 • 463

mradermacher/QwQ-LCoT-3B-Instruct-i1-GGUF

3B • Updated Dec 12, 2024 • 543

QuantFactory/Neumind-Math-7B-Instruct-GGUF

Text Generation • 8B • Updated Dec 13, 2024 • 792 • 1

prithivMLmods/Llama-Song-Stream-3B-Instruct

Text Generation • 3B • Updated Dec 20, 2024 • 53 • 6

bartowski/Llama-Song-Stream-3B-Instruct-GGUF

Text Generation • 3B • Updated Dec 23, 2024 • 2.79k • 2

mradermacher/Llama-Song-Stream-3B-Instruct-GGUF

3B • Updated Dec 18, 2024 • 364 • 1

itlwas/QwQ-LCoT-3B-Instruct-Q4_K_M-GGUF

Text Generation • 3B • Updated Feb 2, 2025 • 49

mradermacher/Llama-Doctor-3.2-3B-Instruct-GGUF

3B • Updated Jul 11, 2025 • 627 • 2

mradermacher/Llama-Doctor-3.2-3B-Instruct-i1-GGUF

3B • Updated Jul 11, 2025 • 1.23k • 1

mradermacher/Qwen-UMLS-7B-Instruct-GGUF

8B • Updated Jan 17, 2025 • 512 • 1