Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

Mixture of Experts

8-bit precision

Carbon Emissions

text-embeddings-inference

Models

19,521

Full-text search

Active filters: llama-cpp

Tesslate/UIGEN-T2-7B-Q8_0-GGUF

Text Generation • Updated 7 days ago • 3.05k • 125

openfree/Gemma-3-R1984-27B-Q8_0-GGUF

Image-Text-to-Text • Updated Mar 30 • 363 • 26

openfree/Gemma-3-R1984-27B-Q4_K_M-GGUF

Image-Text-to-Text • Updated Mar 30 • 609 • 25

openfree/Gemma-3-R1984-12B-Q8_0-GGUF

Image-Text-to-Text • Updated Mar 30 • 544 • 27

openfree/Gemma-3-R1984-12B-Q6_K-GGUF

Image-Text-to-Text • Updated Mar 30 • 393 • 25

openfree/QwQ-R1984-32B-Q8_0-GGUF

Updated Mar 31 • 507 • 24

openfree/QwQ-R1984-32B-Q4_K_M-GGUF

Updated Mar 31 • 472 • 26

openfree/Gemma-3-R1984-27B-Q6_K-GGUF

Image-Text-to-Text • Updated Mar 30 • 242 • 21

openfree/Qwen2.5-VL-32B-Instruct-Q4_K_M-GGUF

Image-Text-to-Text • Updated Mar 30 • 1.35k • 18

openfree/Mistral-Small-3.1-24B-Instruct-2503-Q8_0-GGUF

Image-Text-to-Text • Updated Mar 30 • 753 • 16

openfree/Mistral-Small-3.1-24B-Instruct-2503-Q6_K-GGUF

Image-Text-to-Text • Updated Mar 30 • 337 • 14

openfree/Llama-3_3-Nemotron-Super-49B-v1-Q6_K-GGUF

Text Generation • Updated Mar 30 • 458 • 18

openfree/Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M-GGUF

Image-Text-to-Text • Updated Mar 30 • 764 • 16

openfree/Llama-3_3-Nemotron-Super-49B-v1-Q4_K_M-GGUF

Text Generation • Updated Mar 30 • 356 • 14

openfree/Qwen2.5-VL-32B-Instruct-Q8_0-GGUF

Image-Text-to-Text • Updated Mar 30 • 618 • 17

openfree/QwQ-32B-Q8_0-GGUF

Text Generation • Updated Mar 30 • 351 • 16

smirki/UIGEN-T1.1-Qwen-7B-Q4_K_M-GGUF

Updated Feb 18 • 20 • 2

paultimothymooney/gemma-3-27b-it-Q4_K_M-GGUF

Image-Text-to-Text • Updated Mar 12 • 118 • 2

openfree/QwQ-32B-Q4_K_M-GGUF

Text Generation • Updated Mar 30 • 1k • 10

prithivMLmods/Deepthink-1.5B-Open-PRM-Q8_0-GGUF

Text Generation • Updated 20 days ago • 66 • 2

ufoym/Qwen3-8B-Q4_K_M-GGUF

Text Generation • Updated 14 days ago • 319 • 2

DreadPoor/Paxinium-Q4_K_M-GGUF

Updated 8 days ago • 695 • 2

NikolayKozloff/Absolute_Zero_Reasoner-Coder-7b-Q8_0-GGUF

Updated 3 days ago • 68 • 2

ybelkada/TinyLlama-1.1B-Chat-v1.0-Q4_0-GGUF

Updated Apr 12, 2024 • 203 • 2

DavidAU/Chat-Stheno-L2-13B-Q6_K-GGUF

Updated Apr 15, 2024 • 27 • 2

DavidAU/TinyLlama-1.1B-Chat-v1.0-reasoning-v2-Q8_0-GGUF

Updated Apr 20, 2024 • 13 • 1

DavidAU/TinyLlama-1.1B-Chat-v1.0-intel-dpo-Q8_0-GGUF

Updated Apr 20, 2024 • 2 • 1

DavidAU/TinyPoliticaLlama-1.1B-Q8_0-GGUF

Updated Apr 20, 2024 • 2 • 1

DavidAU/mpt-7b-instruct-Q8_0-GGUF

Updated Apr 20, 2024 • 5 • 1

sbawa/TinyLlama-1.1B-Chat-v1.0-intel-dpo-Q4_K_M-GGUF

Updated Apr 26, 2024 • 4 • 1