Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

8-bit precision

Inference Endpoints

text-generation-inference

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Models

2,219

Full-text search

Active filters: quantized

RedHatAI/Qwen3-32B-FP8-dynamic

Text Generation • Updated 10 days ago • 606 • 7

ABDALLALSWAITI/FLUX.1-dev-ControlNet-Union-Pro-2.0-fp8

Text-to-Image • Updated 23 days ago • 4.1k • 21

RedHatAI/Llama-4-Scout-17B-16E-Instruct-FP8-dynamic

Image-Text-to-Text • Updated about 10 hours ago • 8.92k • 12

jedisct1/MiMo-7B-RL-GGUF

Updated 13 days ago • 20.7k • 16

RedHatAI/Qwen3-32B-quantized.w4a16

Text Generation • Updated 7 days ago • 81 • 3

MaziyarPanahi/Qwen3-32B-GGUF

Text Generation • Updated 14 days ago • 111k • 2

MaziyarPanahi/Qwen3-30B-A3B-GGUF

Text Generation • Updated 13 days ago • 109k • 3

NextGenC/erynn-1-774m

Text Generation • Updated 13 days ago • 8 • 2

afrideva/TinyLlama-1.1B-alpaca-chat-v1.5-GGUF

Text Generation • Updated Nov 6, 2023 • 53 • 2

afrideva/TinyMistral-248M-GGUF

Text Generation • Updated Dec 11, 2023 • 10.6k • 5

afrideva/TinyLlama-1.1B-Chat-v0.4-GGUF

Text Generation • Updated Nov 16, 2023 • 93 • 4

afrideva/TinyLlama-1.1B-Chat-v0.6-GGUF

Text Generation • Updated Nov 20, 2023 • 162 • 10

afrideva/Tiny-Vicuna-1B-GGUF

Text Generation • Updated Nov 23, 2023 • 355k • 7

afrideva/phi-2-uncensored-GGUF

Text Generation • Updated Dec 21, 2023 • 1.15k • 11

afrideva/Astrea-RP-v1-3B-GGUF

Text Generation • Updated Dec 26, 2023 • 101 • 3

MaziyarPanahi/BASH-Coder-Mistral-7B-Mistral-7B-Instruct-v0.2-slerp-GGUF

Text Generation • Updated Jan 26, 2024 • 99 • 3

MaziyarPanahi/miqu-1-70b-sf-GPTQ

Text Generation • Updated Feb 4, 2024 • 13 • 10

qualcomm/Stable-Diffusion

Unconditional Image Generation • Updated Apr 30, 2024 • 24

Lewdiculous/Kunoichi-DPO-v2-7B-GGUF-Imatrix

Text Generation • Updated May 4, 2024 • 3.65k • 39

argmaxinc/whisperkit-coreml

Automatic Speech Recognition • Updated 20 days ago • 359k • 130

AetherArchitectural/GGUF-Quantization-Script

Text Generation • Updated Dec 18, 2024 • 65

MaziyarPanahi/Yi-9B-GGUF

Text Generation • Updated Mar 14, 2024 • 433 • 15

MaziyarPanahi/Saul-Instruct-v1-GGUF

Text Generation • Updated Mar 10, 2024 • 257 • 8

MaziyarPanahi/zephyr-orpo-141b-A35b-v0.1-GGUF

Text Generation • Updated Apr 12, 2024 • 9.19k • 29

MaziyarPanahi/WizardLM-2-7B-GGUF

Text Generation • Updated Apr 15, 2024 • 308k • 80

MaziyarPanahi/WizardLM-2-8x22B-GGUF

Text Generation • Updated Apr 16, 2024 • 9.57k • 127

Lewdiculous/Aura_v2_7B-GGUF-IQ-Imatrix

Updated Apr 16, 2024 • 229 • 13

MaziyarPanahi/Meta-Llama-3-70B-Instruct-GGUF

Text Generation • Updated May 14, 2024 • 19.2k • 169

MaziyarPanahi/Meta-Llama-3-8B-Instruct-GGUF

Text Generation • Updated Apr 23, 2024 • 330k • 89

afrideva/TeenyTinyLlama-160m-GGUF

Text Generation • Updated May 12, 2024 • 64 • 2