Models

RedHatAI/Qwen2.5-3B-Instruct-quantized.w8a8

3B • Updated Oct 9, 2024 • 80

RedHatAI/Qwen2.5-7B-Instruct-quantized.w8a8

Text Generation • 8B • Updated 11 days ago • 1.11k • 2

RedHatAI/Qwen2.5-7B-quantized.w8a8

Text Generation • 8B • Updated Dec 3, 2024 • 21 • 1

RedHatAI/Qwen2.5-32B-quantized.w8a8

33B • Updated Oct 9, 2024 • 9

RedHatAI/Qwen2.5-32B-Instruct-quantized.w8a8

33B • Updated Oct 9, 2024 • 10

RedHatAI/Qwen2.5-72B-Instruct-quantized.w8a8

73B • Updated Oct 9, 2024 • 10

RedHatAI/Qwen2.5-72B-quantized.w8a8

Text Generation • 73B • Updated Dec 3, 2024 • 11

RedHatAI/Qwen2.5-0.5B-quantized.w8a16

Text Generation • 0.4B • Updated Nov 26, 2024 • 14

RedHatAI/Qwen2.5-0.5B-Instruct-quantized.w8a16

0.4B • Updated Oct 9, 2024 • 8

RedHatAI/Qwen2.5-1.5B-quantized.w8a16

Text Generation • 0.8B • Updated Nov 26, 2024 • 8

RedHatAI/Qwen2.5-3B-quantized.w8a16

Text Generation • 1B • Updated Nov 26, 2024 • 7

RedHatAI/Qwen2.5-7B-quantized.w8a16

Text Generation • 3B • Updated Nov 26, 2024 • 18 • 1

RedHatAI/Qwen2.5-7B-Instruct-quantized.w8a16

3B • Updated Oct 9, 2024 • 111

RedHatAI/Qwen2.5-32B-Instruct-quantized.w8a16

9B • Updated Oct 9, 2024 • 6

RedHatAI/Qwen2.5-32B-quantized.w8a16

Text Generation • 9B • Updated Nov 26, 2024 • 7

RedHatAI/Qwen2.5-72B-quantized.w8a16

Text Generation • 20B • Updated Nov 26, 2024 • 12

robertgshaw2/llama-3-act-order

11B • Updated Oct 9, 2024 • 3

RedHatAI/pixtral-12b-FP8-dynamic

Text Generation • 13B • Updated Feb 7 • 848 • 10

SicariusSicariiStuff/LLAMA-3_8B_Unaligned_BETA_FP8

Text Generation • 8B • Updated Jul 26 • 4 • 1

nm-testing/Phi-3.5-vision-instruct-FP8-dynamic

4B • Updated Oct 17, 2024 • 16

adamo1139/Hermes-3-Llama-3.1-8B-FP8-Static

8B • Updated Oct 19, 2024 • 5

adamo1139/OpenHermes-2.5-Mistral-7B-FP8-Static

7B • Updated Oct 19, 2024 • 1

adamo1139/Hermes-3-Llama-3.1-8B-FP8-Dynamic

8B • Updated Oct 19, 2024 • 7

adamo1139/OpenHermes-2.5-Mistral-7B-FP8-Dynamic

7B • Updated Oct 19, 2024 • 1

adamo1139/Qwen2.5-7B-Instruct-FP8-Dynamic_FP16-Vision

8B • Updated Oct 19, 2024 • 6

adamo1139/Qwen2.5-7B-Sydney-FP8-Dynamic_FP16-Vision

8B • Updated Oct 19, 2024 • 1

noneUsername/Mistral-Small-Instruct-2409-abliterated-W8A8-Dynamic-Per-Token

22B • Updated Oct 19, 2024 • 5

adamo1139/Hermes-3-Llama-3.1-8B-Static-FP8-KV

8B • Updated Oct 19, 2024 • 2

adamo1139/Hermes-3-Llama-3.1-8B-Dynamic-FP8-KV

8B • Updated Oct 19, 2024 • 2

noneUsername/SuperNova-Medius-W8A8-Dynamic-Per-Token

15B • Updated Oct 19, 2024 • 6 • 1