Edit Models filters

Apps

Docker Model Runner

Inference Providers

HF Inference API

Misc

compressed-tensors

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

2,364

Full-text search

Active filters: compressed-tensors

nm-testing/Qwen3-Coder-30B-A3B-Instruct-FP8_DYNAMIC

31B • Updated 4 days ago • 5

cortecs/Qwen3-8B-clean-sparse-nvfp4a16

5B • Updated 4 days ago • 3

Sinensis/Broken-Tutu-24B-Unslop-v2.0-FP8-Dynamic

Text Generation • 24B • Updated 4 days ago • 2

nm-testing/llama-fp8-nvfp4-test

6B • Updated 4 days ago • 3

nm-testing/llama4_quantized-FP8-Dynamic-NVFP4

64B • Updated 3 days ago • 163

warshanks/Josiefied-Qwen3-4B-Instruct-2507-gabliterated-v1-AWQ

Text Generation • 1B • Updated 3 days ago • 21

SicariusSicariiStuff/Impish_Nemo_12B_FP8

Text Generation • 12B • Updated 2 days ago • 3

sayed0am/granite-3.3-8b-instruct-FP8-Dynamic

Text Generation • 8B • Updated 2 days ago • 3

sayed0am/gemma-3-12b-it-text-only-FP8-Dynamic

12B • Updated 2 days ago • 277

obamaTeo/qwen14b-10k-ver1

15B • Updated 2 days ago • 6

warshanks/Josiefied-Qwen3-4B-Instruct-2507-gabliterated-v2-AWQ

Text Generation • 1B • Updated 2 days ago • 21

rocca/GLM-4.5-compressed-tensors-w4a16-g128-v1

Updated 1 day ago • 35

cpatonn/II-Search-4B-AWQ-4bit

Text Generation • 1B • Updated 1 day ago • 6

tachytelicdetonation/medgemma-27b-it-fp8-dynamic

Text Generation • 27B • Updated 1 day ago • 21

tachytelicdetonation/medgemma-27b-it-fp8-static

Text Generation • 28B • Updated 1 day ago • 398

FogTeams/gemma-3-4b-it-W4A16-G128

2B • Updated 1 day ago • 14

Ba2han/qwen3-32b-gem-w4a16

Text Generation • 6B • Updated about 23 hours ago • 24

webbigdata/VoiceCore_smoothquant

4B • Updated about 19 hours ago • 4

sayan0506/qwen2.5_1.5b_v1_int8_w8a8_quantized_checkpoint_v1_6_1

2B • Updated about 20 hours ago • 6

mdavidson83/Qwen3-4B-Instruct-2507-INT8

Text Generation • 4B • Updated about 10 hours ago • 3

mdavidson83/Qwen3-4B-Instruct-2507-INT4

Text Generation • 1B • Updated about 9 hours ago • 3

mdavidson83/Qwen3-Coder-30B-A3B-Instruct-INT8

Text Generation • 31B • Updated about 6 hours ago

soo1206/title-model-16bit-FP8_DYNAMIC

Text Generation • 8B • Updated about 4 hours ago

NM-dev/Qwen2.5-VL-3B-Instruct-W4A16-G128

2B • Updated about 3 hours ago