Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

4-bit precision

8-bit precision

text-generation-inference

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Models

5,951

Full-text search

Active filters: GGUF

tensorblock/Qwen_Qwen3-0.6B-GGUF

Text Generation • Updated 14 days ago • 735 • 2

MaziyarPanahi/Qwen3-32B-GGUF

Text Generation • Updated 14 days ago • 111k • 2

MaziyarPanahi/Qwen3-30B-A3B-GGUF

Text Generation • Updated 13 days ago • 109k • 3

Mozilla/llava-v1.5-7b-llamafile

Updated Apr 1 • 12.9k • 183

andrijdavid/TinyLlama-1.1B-Chat-v1.0-GGUF

Text Generation • Updated Jan 19, 2024 • 162 • 2

MaziyarPanahi/BASH-Coder-Mistral-7B-Mistral-7B-Instruct-v0.2-slerp-GGUF

Text Generation • Updated Jan 26, 2024 • 99 • 3

MaziyarPanahi/Yi-9B-GGUF

Text Generation • Updated Mar 14, 2024 • 433 • 15

MaziyarPanahi/Saul-Instruct-v1-GGUF

Text Generation • Updated Mar 10, 2024 • 257 • 8

raincoder/deepseek-coder-1.3b-llamafile

Updated Apr 4, 2024 • 50 • 1

MaziyarPanahi/zephyr-orpo-141b-A35b-v0.1-GGUF

Text Generation • Updated Apr 12, 2024 • 9.19k • 29

MaziyarPanahi/WizardLM-2-7B-GGUF

Text Generation • Updated Apr 15, 2024 • 308k • 80

MaziyarPanahi/WizardLM-2-8x22B-GGUF

Text Generation • Updated Apr 16, 2024 • 9.57k • 127

MaziyarPanahi/Meta-Llama-3-70B-Instruct-GGUF

Text Generation • Updated May 14, 2024 • 19.2k • 169

MaziyarPanahi/Meta-Llama-3-8B-Instruct-GGUF

Text Generation • Updated Apr 23, 2024 • 330k • 89

LiteLLMs/Meta-Llama-3-70B-Instruct-GGUF

Text Generation • Updated Apr 19, 2024 • 124 • 8

LiteLLMs/Llama3-OpenBioLLM-70B-GGUF

Updated May 28, 2024 • 1.65k • 6

rabil/Llama-3-8B-Lexi-Uncensored-llamafile

Updated May 1, 2024 • 32 • 3

MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • Updated May 22, 2024 • 338k • 96

legraphista/DeepSeek-V2-Lite-Chat-IMat-GGUF

Text Generation • Updated May 26, 2024 • 1.94k • 11

LiteLLMs/Turkish-Llama-8b-v0.1-GGUF

Text Generation • Updated May 29, 2024 • 115 • 2

legraphista/dolphin-2.9.2-Phi-3-Medium-abliterated-IMat-GGUF

Text Generation • Updated Jun 3, 2024 • 1.23k • 1

legraphista/Higgs-Llama-3-70B-IMat-GGUF

Text Generation • Updated Jun 6, 2024 • 5.83k • 8

MaziyarPanahi/Mistral-Nemo-Instruct-2407-GGUF

Text Generation • Updated Jul 22, 2024 • 313k • 44

MaziyarPanahi/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • Updated Jul 23, 2024 • 300k • 19

MaziyarPanahi/Mistral-Large-Instruct-2407-GGUF

Text Generation • Updated Jul 26, 2024 • 18.4k • 21

MaziyarPanahi/Phi-3.5-mini-instruct-GGUF

Text Generation • Updated Aug 20, 2024 • 327k • 12

MaziyarPanahi/Yi-Coder-1.5B-Chat-GGUF

Text Generation • Updated Sep 4, 2024 • 302k • 9

MaziyarPanahi/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated Sep 25, 2024 • 242k • 12

MaziyarPanahi/Llama-3.2-1B-Instruct-GGUF

Text Generation • Updated Sep 25, 2024 • 307k • 11

Ankit1057/BADMISTRAL-1.5B-i1-llamafile

Updated Oct 16, 2024 • 32 • 2