Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

8-bit precision

Inference Endpoints

text-generation-inference

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Models

2,219

Full-text search

Active filters: quantized

vital-ai/watt-tool-70B-awq

Updated Jan 24 • 6.66k • 4

MaziyarPanahi/Mistral-Small-24B-Instruct-2501-GGUF

Text Generation • Updated Jan 30 • 277k • 3

MaziyarPanahi/Qwen2.5-Coder-3B-Instruct-abliterated-GGUF

Text Generation • Updated Feb 2 • 64 • 2

MaziyarPanahi/Captain-Eris_Violet_Toxic-Magnum-12B-GGUF

Text Generation • Updated Feb 10 • 92 • 1

ordis-co-ltd/Qwen2.5-VL-72B-Instruct_exl2_6.0bpw

Image-Text-to-Text • Updated Feb 10 • 10 • 2

MaziyarPanahi/To-the-end-of-this-earth-MN-12B-GGUF

Text Generation • Updated Feb 14 • 16 • 1

MaziyarPanahi/Ayla-Light-12B-v2-GGUF

Text Generation • Updated Feb 16 • 84 • 2

MaziyarPanahi/Ayla-Light-12B-Stock-GGUF

Text Generation • Updated Feb 18 • 71 • 1

sgedela/opt-125m-quantized

Text Generation • Updated Feb 22 • 1

MaziyarPanahi/DeepSeek-R1-Distill-Llama-3B-GGUF

Text Generation • Updated Feb 24 • 321 • 1

qualcomm/YOLOv11-Detection-Quantized

Object Detection • Updated Apr 9 • 1

piotrmaciejbednarski/PLLuM-8x7B-chat-GGUF

Text Generation • Updated Mar 3 • 206 • 1

mradermacher/TopicalStorm-Llama3.2-3b-GGUF

Updated Mar 1 • 26 • 1

mradermacher/TopicalStorm-Llama3.2-3b-i1-GGUF

Updated Mar 1 • 53 • 1

RedHatAI/phi-4-quantized.w8a8

Text Generation • Updated 26 days ago • 219 • 1

RedHatAI/phi-4-quantized.w4a16

Text Generation • Updated 20 days ago • 1.13k • 1

GainEnergy/ogai-8x7b-4bit

Text Generation • Updated Mar 5 • 1

MaziyarPanahi/QwQ-32B-GGUF

Text Generation • Updated Mar 7 • 267k • 3

MaziyarPanahi/Glowing-Forest-12B-GGUF

Text Generation • Updated Mar 8 • 30 • 1

MaziyarPanahi/gemma-3-4b-it-GGUF

Text Generation • Updated Mar 12 • 289k • 6

MaziyarPanahi/gemma-3-12b-it-GGUF

Text Generation • Updated Mar 12 • 276k • 6

MaziyarPanahi/gemma-3-27b-it-GGUF

Text Generation • Updated Mar 16 • 271k • 4

MaziyarPanahi/MN-Hekate-Enodia-12B-GGUF

Text Generation • Updated Mar 23 • 83 • 1

MaziyarPanahi/Dirty-Shirley-Writer-v01-Uncensored-GGUF

Text Generation • Updated Mar 24 • 248 • 1

MaziyarPanahi/Dirty-Shirley-Writer-v0-abliterated-GGUF

Text Generation • Updated Mar 24 • 221 • 1

MaziyarPanahi/Qwen2.5-7B-sft-ultrachat-SPIN-gpt4o-GGUF

Text Generation • Updated Mar 24 • 246 • 1

MaziyarPanahi/MT-Merge9-gemma-2-9B-GGUF

Text Generation • Updated Mar 24 • 127 • 1

mradermacher/TopicalStorm-Llama3.1-8b-GGUF

Updated Mar 26 • 65 • 2

mradermacher/TopicalStorm-Llama3.1-8b-i1-GGUF

Updated Mar 30 • 668 • 1

boltuix/bert-lite

Text Classification • Updated Apr 7 • 29 • 3