Models

tngtech/DeepSeek-R1T-Chimera

Text Generation • 685B • Updated Jul 6 • 1.25k • 263

Qwen/Qwen3-0.6B-FP8

Text Generation • 0.8B • Updated 17 days ago • 5.63k • 47

Qwen/Qwen3-1.7B-FP8

Text Generation • 2B • Updated 17 days ago • 7.16k • 28

Qwen/Qwen3-4B-FP8

Text Generation • 4B • Updated 17 days ago • 4.98k • 27

Qwen/Qwen3-8B-FP8

Text Generation • 8B • Updated 17 days ago • 51.3k • 39

unsloth/DeepSeek-R1-0528-GGUF

Text Generation • 671B • Updated Jun 15 • 51.6k • 185

ConfidentialMind/InternVL3-38B-FP8-Dynamic

Image-Text-to-Text • 38B • Updated Jul 7 • 29 • 2

unsloth/Kimi-K2-Instruct

Text Generation • Updated 25 days ago • 2.79k • 19

unsloth/Qwen3-235B-A22B-Instruct-2507-FP8

Text Generation • 235B • Updated 22 days ago • 625 • 3

unsloth/Qwen3-Coder-480B-A35B-Instruct-FP8

Text Generation • 480B • Updated 21 days ago • 1.67k • 3

internlm/Intern-S1-FP8

Image-Text-to-Text • 241B • Updated 8 days ago • 785 • 38

unsloth/Qwen3-235B-A22B-Thinking-2507-FP8

Text Generation • 235B • Updated 18 days ago • 102 • 2

unsloth/Qwen3-30B-A3B-Instruct-2507-FP8

Text Generation • 31B • Updated 14 days ago • 528 • 5

unsloth/Qwen3-30B-A3B-Thinking-2507-FP8

31B • Updated 14 days ago • 143 • 1

yonghenglh6/vlm_test_model_for_sglang_toy

8B • Updated 13 days ago • 157 • 1

smartguy0505/Affine-000001

685B • Updated 5 days ago • 168 • 1

FriendliAI/Meta-Llama-3-8B-Instruct-fp8

Text Generation • 8B • Updated Nov 3, 2024 • 37 • 2

nm-testing/mistral-fp8-dynamic

Text Generation • 7B • Updated Apr 26, 2024 • 2

nm-testing/mistral-fp8-static

Text Generation • 7B • Updated Apr 26, 2024 • 4

nm-testing/opt-125m-fp8-static

Text Generation • 0.1B • Updated Apr 26, 2024 • 6

RedHatAI/Meta-Llama-3-8B-Instruct-FP8

Text Generation • 8B • Updated Jul 18, 2024 • 4.85k • • 23

RedHatAI/Mixtral-8x7B-Instruct-v0.1-AutoFP8

Text Generation • 47B • Updated Jul 18, 2024 • 61 • 3

nm-testing/opt-125m-fp8-dynamic

Text Generation • 0.1B • Updated Apr 27, 2024 • 5

anyisalin/Meta-Llama-3-8B-Instruct-FP8

Text Generation • 8B • Updated May 6, 2024 • 2

anyisalin/Meta-Llama-3-8B-Instruct-FP8-D

Text Generation • 8B • Updated Apr 28, 2024 • 2

anyisalin/lzlv_70b_fp16_hf-FP8-D

Text Generation • 69B • Updated Apr 28, 2024 • 4

anyisalin/Meta-Llama-3-70B-Instruct-FP8-D

Text Generation • 71B • Updated Apr 28, 2024 • 2

anyisalin/Mixtral-8x7B-Instruct-v0.1-FP8-D

Text Generation • 47B • Updated Apr 28, 2024 • 4

nm-testing/llama-3-instruct-fp8-static-shared-scales

Text Generation • 8B • Updated Apr 28, 2024 • 10

nm-testing/llama-3-instruct-fp8-dynamic-shared-scales

Text Generation • 8B • Updated Apr 28, 2024 • 3