Edit Models filters

Apps

Apps with no match

Inference Providers

Inference Providers with no match

HF Inference API

Misc

Inference Endpoints

4-bit precision

8-bit precision

text-generation-inference

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Models

6,303

Full-text search

Active filters: GGUF

Mozilla/TinyLlama-1.1B-Chat-v1.0-llamafile

Updated Jan 6 • 1.47k • 16

MaziyarPanahi/sqlcoder-7b-2-GGUF

Text Generation • Updated Feb 13, 2024 • 251 • 11

MaziyarPanahi/Llama-3-8B-Instruct-32k-v0.1-GGUF

Text Generation • Updated Jun 28, 2024 • 211k • 58

MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • Updated May 22, 2024 • 276k • 100

MaziyarPanahi/Mistral-Nemo-Instruct-2407-GGUF

Text Generation • Updated Jul 22, 2024 • 213k • 45

MaziyarPanahi/Phi-3.5-mini-instruct-GGUF

Text Generation • Updated Aug 20, 2024 • 256k • 14

tensorblock/anime-anything-promptgen-v2-GGUF

Updated Apr 20 • 209 • 2

tensorblock/Llama-3.2-8B-Instruct-GGUF

Updated Apr 20 • 401 • 1

jackboyla/Phi-3-mini-4k-instruct-graph-GGUF

Text Generation • Updated Dec 7, 2024 • 26 • 2

NexaAIDev/OmniAudio-2.6B

Audio-Text-to-Text • Updated Dec 13, 2024 • 304 • 267

MaziyarPanahi/gemma-3-1b-it-GGUF

Text Generation • Updated Mar 12 • 255k • 4

tensorblock/Phi-4-mini-instruct-abliterated-GGUF

Text Generation • Updated Apr 21 • 361 • 1

tensorblock/SherlockAssistant_Mistral-7B-Instruct-Ukrainian-GGUF

Updated May 1 • 267 • 1

tensorblock/Voicelab_trurl-2-13b-GGUF

Text Generation • Updated May 8 • 132 • 1

MaziyarPanahi/DeepSeek-R1-0528-Qwen3-8B-GGUF

Text Generation • Updated 18 days ago • 109k • 4

kroonen/OpenOrca-Platypus2-13B-GGUF

Updated Aug 30, 2023 • 7 • 2

Mozilla/llava-v1.5-7b-llamafile

Updated Apr 1 • 7.54k • 183

Trelis/openchat_3.5-function-calling-v3

Text Generation • Updated Mar 6, 2024 • 20

TIGER-Lab/TIGERScore-7B-GGUF

Text2Text Generation • Updated Dec 5, 2023 • 18 • 2

TIGER-Lab/TIGERScore-13B-GGUF

Text2Text Generation • Updated Dec 5, 2023 • 11 • 1

cosimoiaia/Loquace-7B-Mistral-GGUF

Updated Dec 16, 2023 • 10 • 3

tsunemoto/Magicoder-S-CL-7B-GGUF

Updated Dec 13, 2023 • 48 • 4

tsunemoto/SOLAR-10.7B-Instruct-v1.0-GGUF

Updated Dec 13, 2023 • 40

tsunemoto/bagel-dpo-7b-v0.1-GGUF

Updated Dec 13, 2023 • 25

tsunemoto/openchat-3.5-1210-GGUF

Updated Dec 14, 2023 • 53 • 1

tsunemoto/ToxicHermes-2.5-Mistral-7B-GGUF

Updated Dec 17, 2023 • 53 • 1

tsunemoto/dopeyshearedplats-1.3b-v1-GGUF

Updated Dec 17, 2023 • 17

tsunemoto/dolphin-2.5-mixtral-8x7b-GGUF

Updated Dec 17, 2023 • 75 • 1

tsunemoto/Mistral-7B-Instruct-v0.2-GGUF

Updated Feb 18, 2024 • 86

tsunemoto/MiniChat-1.5-3B-GGUF

Updated Dec 18, 2023 • 21 • 2