Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,025

Base only

Active filters: ggml

unsloth/FLUX.2-klein-9B-GGUF

Image-to-Image • 9B • Updated Jan 16 • 253k • 352

unsloth/LTX-2.3-GGUF

Image-to-Video • 21B • Updated Apr 20 • 311k • 574

unsloth/Z-Image-Turbo-GGUF

Text-to-Image • 6B • Updated Jan 8 • 356k • 264

unsloth/FLUX.2-klein-4B-GGUF

Image-to-Image • 4B • Updated Jan 16 • 273k • 219

HoppouAI/Breeze-TTS-2.cpp

Text-to-Speech • 3B • Updated 24 days ago • 8.91k • 18

unsloth/Z-Image-GGUF

Text-to-Image • 6B • Updated Jan 28 • 66k • 197

Serveurperso/Qwen3-TTS-GGUF

Text-to-Speech • 0.9B • Updated 11 days ago • 309k • 47

Serveurperso/YuE2-GGUF

0.7B • Updated 7 days ago • 2.78k • 4

unsloth/Qwen-Image-GGUF

Text-to-Image • 20B • Updated Dec 22, 2025 • 34.9k • 33

Serveurperso/ACE-Step-1.5-GGUF

0.7B • Updated 8 days ago • 100k • 95

Serveurperso/OmniVoice-GGUF

Text-to-Speech • 0.6B • Updated 11 days ago • 37.8k • 64

mudler/moss-transcribe.cpp-gguf

Automatic Speech Recognition • 0.9B • Updated Jul 9 • 1.84k • 13

microsoft/VibeVoice-ASR-BitNet

Automatic Speech Recognition • 0.3B • Updated Jul 24 • 39.7k • 198

RemySkye/Qwen3.8-Flash-Next-REAM-60Pct-GGUF

Text Generation • 129B • Updated 13 days ago • 16.2k • 5

unsloth/FLUX.2-dev-GGUF

Image-to-Image • 32B • Updated Dec 10, 2025 • 109k • 92

unsloth/ERNIE-Image-GGUF

Text-to-Image • 8B • Updated Apr 14 • 2.79k • 71

cstr/chatterbox-GGUF

Text-to-Speech • 0.3B • Updated Aug 13 • 5.26k • 3

cstr/sensevoice-small-GGUF

Automatic Speech Recognition • 0.2B • Updated Aug 2 • 1.92k • 2

cstr/siglip-so400m-patch14-384-GGUF

Image Feature Extraction • 0.4B • Updated Aug 2 • 138 • 1

gariwat/swiss-german-whisper-ggml

Automatic Speech Recognition • Updated Jul 8 • 1

Zyphra/ZONOS1-GGUF

Text-to-Speech • 63.5M • Updated Jul 15 • 178 • 3

LocalAI-io/TRELLIS.2-4B-GGUF

Image-to-3D • 0.5B • Updated Jul 16 • 12k • 12

simonfxr/kokoro.cpp-GGUF

Text-to-Speech • 81.7M • Updated Jul 21 • 1.36k • 1

remixerdec/Inflect-Nano-v2-GGUF

Text-to-Speech • 3.96M • Updated Jul 28 • 38 • 6

ckadirt/LeVo2-GGUF

0.7B • Updated Aug 13 • 506 • 1

Auguments/Qwen-Gemma-LFM-etc-fixed-jinja-templates

Updated Aug 13 • 1

mousebar01/Pixal3D.cpp-GGUF

Image-to-3D • 5B • Updated 8 days ago • 454 • 1

JoaoZaokk/kotoba-whisper-v2.0-ggml

Automatic Speech Recognition • Updated 8 days ago • 1

davidxifeng/zipvoice-gguf

Text-to-Speech • Updated 2 days ago • 841 • 1

malteos/bloom-6b4-clp-german

Text Generation • 6B • Updated Apr 6, 2024 • 131 • 38