Models

inclusionAI/Ming-lite-omni-1.5-FP8

18B • Updated 12 days ago • 120 • 17

zai-org/GLM-4.5V-FP8

Image-Text-to-Text • 108B • Updated about 7 hours ago • 319 • 8

zai-org/GLM-4.5-FP8

Text Generation • 358B • Updated about 7 hours ago • 9.13k • 62

zai-org/GLM-4.5-Air-FP8

Text Generation • 111B • Updated about 7 hours ago • 15.6k • • 45

allenai/olmOCR-7B-0725-FP8

Image-to-Text • 8B • Updated 19 days ago • 36.9k • 11

t-tech/T-pro-it-2.0-AWQ

6B • Updated 25 days ago • 2.12k • 7

ByteDance-Seed/Seed-X-PPO-7B-AWQ-Int4

Translation • 1B • Updated 15 days ago • 666 • 7

tencent/Hunyuan-7B-Instruct-FP8

Text Generation • 8B • Updated 6 days ago • 90 • 3

NeoChen1024/Ministral-8B-Instruct-2410-W8A8

8B • Updated Jan 17 • 11 • 2

RedHatAI/Llama-3.3-70B-Instruct-quantized.w8a8

Text Generation • 71B • Updated May 30 • 49k • 11

RedHatAI/DeepSeek-R1-Distill-Llama-8B-FP8-dynamic

Text Generation • 8B • Updated Feb 27 • 1.42k • 3

RedHatAI/DeepSeek-R1-Distill-Qwen-32B-quantized.w4a16

Text Generation • 6B • Updated Feb 27 • 3.13k • 5

reinforce20001/SakuraLLM.Sakura-14B-Qwen2.5-v1.0-GPTQ-Int8-V2

5B • Updated Feb 22 • 5 • 1

ISTA-DASLab/gemma-3-27b-it-GPTQ-4b-128g

Image-Text-to-Text • 5B • Updated Mar 20 • 10.2k • 38

RedHatAI/whisper-large-v3-turbo-FP8-Dynamic

Automatic Speech Recognition • 0.9B • Updated Apr 22 • 95 • 2

meta-llama/Llama-4-Maverick-17B-128E-Instruct-FP8

Image-Text-to-Text • 402B • Updated May 22 • 119k • • 126

gaunernst/gemma-3-4b-it-qat-compressed-tensors

Image-Text-to-Text • 2B • Updated Apr 8 • 2.42k • 2

ConfidentialMind/InternVL3-38B-FP8-Dynamic

Image-Text-to-Text • 38B • Updated Jul 7 • 29 • 2

RedHatAI/gemma-3-27b-it-quantized.w4a16

Image-Text-to-Text • 7B • Updated Jun 9 • 4.53k • 4

boboliu/Qwen3-Reranker-0.6B-W4A16-G128

Text Classification • 0.2B • Updated Jun 7 • 279 • 2

RedHatAI/Llama-4-Maverick-17B-128E-Instruct-quantized.w4a16

Image-Text-to-Text • 59B • Updated Jun 12 • 3.16k • 1

jeffcookio/Mistral-Small-3.2-24B-Instruct-2506-awq-sym

5B • Updated Jul 4 • 9.63k • 6

cpatonn/Llama-3_3-Nemotron-Super-49B-v1_5-AWQ-4bit

Text Generation • 8B • Updated 12 days ago • 764 • 2

deepcogito/cogito-v2-preview-deepseek-671B-MoE-FP8

Text Generation • 671B • Updated 12 days ago • 218 • 4

ByteDance-Seed/Seed-X-PPO-7B-GPTQ-Int8

Translation • 8B • Updated 15 days ago • 1.33k • 6

cpatonn/GLM-4.5-Air-AWQ-4bit

Text Generation • 18B • Updated 3 days ago • 12.8k • 9

ramblingpolymath/Qwen3-30B-A3B-Instruct-2507-W8A8

Text Generation • 31B • Updated 9 days ago • 206 • 1

cpatonn/Qwen3-30B-A3B-Instruct-2507-AWQ-4bit

Text Generation • 5B • Updated 13 days ago • 4.54k • 6

tencent/Hunyuan-4B-Instruct-FP8

Text Generation • 4B • Updated 6 days ago • 42 • 1

unsloth/cogito-v2-preview-deepseek-671B-MoE-FP8

Text Generation • 671B • Updated 12 days ago • 14 • 1