Models

adamo1139/Qwen2.5-7B-Sydney-FP8-Dynamic_FP16-Vision

8B • Updated Oct 19, 2024

noneUsername/Mistral-Small-Instruct-2409-abliterated-W8A8-Dynamic-Per-Token

22B • Updated Oct 19, 2024 • 3

adamo1139/Hermes-3-Llama-3.1-8B-Static-FP8-KV

8B • Updated Oct 19, 2024 • 1

adamo1139/Hermes-3-Llama-3.1-8B-Dynamic-FP8-KV

8B • Updated Oct 19, 2024 • 1

noneUsername/SuperNova-Medius-W8A8-Dynamic-Per-Token

15B • Updated Oct 19, 2024 • 3 • 1

flowaicom/Flow-Judge-v0.1-FP8

4B • Updated Oct 14, 2024 • 1 • 1

flowaicom/Flow-Judge-v0.1-W8A16

1B • Updated Oct 14, 2024 • 2 • 1

flowaicom/Flow-Judge-v0.1-W4A16

0.7B • Updated Oct 14, 2024 • 3 • 1

adamo1139/Hermes-3-Llama-3.1-8B_W8A8

8B • Updated Oct 15, 2024 • 4

leafspark/Llama-3.1-Nemotron-70B-Instruct-HF-FP8-Dynamic

71B • Updated Oct 16, 2024 • 3

daisd-ai/UniNER-W4A16

1B • Updated Oct 28, 2024 • 301

daisd-ai/anydef-v2-linear-W4A16

1B • Updated Oct 21, 2024 • 271

woroko/NVLM-D-72B-w4a16

18B • Updated Oct 16, 2024 • 7

RedHatAI/Llama-3.1-Nemotron-70B-Instruct-HF-FP8-dynamic

Text Generation • 71B • Updated 17 days ago • 568 • 14

nm-testing/MiniCPM-V-2_6-FP8-dynamic

8B • Updated Oct 17, 2024

nm-testing/Phi-3.5-vision-instruct-W8A8-Dynamic-Per-Token

4B • Updated Oct 17, 2024 • 3

RedHatAI/Qwen2.5-3B-Instruct-quantized.w8a16

1B • Updated Oct 17, 2024 • 5

RedHatAI/Qwen2.5-1.5B-Instruct-quantized.w8a16

0.8B • Updated Oct 17, 2024 • 5

RedHatAI/Qwen2.5-72B-Instruct-quantized.w8a16

20B • Updated Oct 17, 2024 • 5

RedHatAI/Qwen2.5-72B-Instruct-quantized.w4a16

12B • Updated Oct 17, 2024 • 6

RedHatAI/Qwen2.5-72B-quantized.w4a16

12B • Updated Oct 17, 2024 • 4

RedHatAI/Qwen2.5-32B-quantized.w4a16

6B • Updated Oct 18, 2024 • 16

RedHatAI/Qwen2.5-32B-Instruct-quantized.w4a16

6B • Updated Oct 18, 2024 • 50

RedHatAI/Qwen2.5-7B-quantized.w4a16

Text Generation • 2B • Updated Apr 16 • 33

noneUsername/Ministral-8B-Instruct-2410-HF-W8A8-Dynamic-Per-Token

8B • Updated Oct 19, 2024 • 3

noneUsername/TouchNight-Ministral-8B-Instruct-2410-HF-W8A8-Dynamic-Per-Token

8B • Updated Oct 19, 2024 • 3

CalamitousFelicitousness/Magnum-V4-72B-FP8-Dynamic

Text Generation • 73B • Updated Oct 20, 2024

gmonair/Qwen2.5-Math-1.5B-Instruct-W8A8-Dynamic-Per-Token

2B • Updated Oct 20, 2024 • 3

gmonair/Qwen2.5-Math-1.5B-Instruct-W8A16

0.8B • Updated Oct 20, 2024

leon-se/Aria-sequential_mlp-FP8-dynamic

Image-Text-to-Text • 25B • Updated Dec 29, 2024 • 1 • 6