Edit Models filters

Inference status

Misc

Inference Endpoints

4-bit precision

8-bit precision

text-generation-inference

AutoTrain Compatible

Mixture of Experts

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

2,586

Full-text search

Active filters: GGUF

MaziyarPanahi/Mistral-Nemo-Instruct-2407-GGUF

Text Generation • Updated Jul 22 • 1.7M • 31

MaziyarPanahi/Meta-Llama-3.1-70B-Instruct-GGUF

Text Generation • Updated Jul 29 • 1.7M • 36

legraphista/Meta-Llama-3.1-70B-Instruct-IMat-GGUF

Text Generation • Updated Jul 27 • 1.06k • 11

legraphista/Llama-Guard-3-8B-IMat-GGUF

Text Generation • Updated Jul 23 • 609 • 3

MaziyarPanahi/Meta-Llama-3.1-405B-Instruct-GGUF

Text Generation • Updated Jul 29 • 161k • 12

legraphista/Mistral-Large-Instruct-2407-IMat-GGUF

Text Generation • Updated Jul 25 • 1.75k • 28

tinybiggames/tinypascal

Updated Jul 31 • 13 • 2

legraphista/Palmyra-Fin-70B-32K-IMat-GGUF

Text Generation • Updated Aug 2 • 1k • 7

MaziyarPanahi/SmolLM-1.7B-Instruct-v0.2-GGUF

Text Generation • Updated Aug 18 • 1.06M • 7

MaziyarPanahi/Phi-3.5-mini-instruct-GGUF

Text Generation • Updated Aug 20 • 1.69M • 5

MaziyarPanahi/Yi-Coder-9B-Chat-GGUF

Text Generation • Updated Sep 4 • 1.69M • 2

MaziyarPanahi/solar-pro-preview-instruct-GGUF

Text Generation • Updated Sep 13 • 1.72M • 18

MaziyarPanahi/Llama-3.2-1B-Instruct-GGUF

Text Generation • Updated Sep 25 • 1.74M • 4

legraphista/Llama-3.2-3B-Instruct-IMat-GGUF

Text Generation • Updated Sep 25 • 1.03k • 1

Devarui379/VersatiLlama-Llama-3.2-3B-Instruct-Abliterated-Imatrix-GGUF

Text Generation • Updated Oct 2 • 776 • 4

Ankit1057/BADMISTRAL-1.5B-i1-llamafile

Updated Oct 16 • 23 • 1

MaziyarPanahi/Llama-3.1-Nemotron-70B-Instruct-HF-GGUF

Text Generation • Updated about 1 month ago • 1.54k • 3

Quant-Cartel/Llama-3.05-Nemotron-Tenyxchat-Storybreaker-70B-iMat-GGUF

Text Generation • Updated 29 days ago • 1.17k • 1

MaziyarPanahi/Meraj-Mini-GGUF

Text Generation • Updated about 1 month ago • 124k • 2

MaziyarPanahi/llama-3.2-Korean-Bllossom-3B-GGUF

Text Generation • Updated 28 days ago • 668 • 1

MaziyarPanahi/Llama-3.2-3B-Instruct-uncensored-GGUF

Text Generation • Updated 28 days ago • 6.89k • 3

MaziyarPanahi/Llama-3.2-3B-Overthinker-GGUF

Text Generation • Updated 28 days ago • 777 • 1

MaziyarPanahi/Llama-3.2-3B-Instruct-abliterated-GGUF

Text Generation • Updated 28 days ago • 934 • 1

MaziyarPanahi/Llama-3.1-8B-Lexi-Uncensored-V2-GGUF

Text Generation • Updated 28 days ago • 891 • 1

MaziyarPanahi/Llama3.1-8B-Chinese-Chat-GGUF

Text Generation • Updated 28 days ago • 715 • 1

MaziyarPanahi/Nemotron-Mini-4B-Instruct-GGUF

Text Generation • Updated 28 days ago • 852 • 1

MaziyarPanahi/granite-3.0-8b-instruct-GGUF

Text Generation • Updated 25 days ago • 688 • 1

MaziyarPanahi/L3-Nymeria-8B-GGUF

Text Generation • Updated 20 days ago • 267 • 3

MaziyarPanahi/DarkIdol-Llama-3.1-8B-Instruct-1.1-Uncensored-GGUF

Text Generation • Updated 20 days ago • 234 • 1

MaziyarPanahi/L3-8B-Sunfall-v0.5-Stheno-v3.2-GGUF

Text Generation • Updated 19 days ago • 224 • 1