AngelSlim/Deepseek_r1_distill_qwen-1_5b_fp8_static
Updated
•
11
Deepseek_r1_distill-quant
The collection of quantization models of Deepseek_r1_distill
-
-
AngelSlim/Deepseek_r1_distill_qwen-1_5b_int4_awq
0.6B • Updated • 8 -
AngelSlim/Deepseek_r1_distill_qwen-1_5b_int4_gptq
0.6B • Updated • 4 -
AngelSlim/Deepseek_r1_distill_qwen-14b_int4_awq
3B • Updated • 117 -
AngelSlim/Deepseek_r1_distill_qwen-14b_fp8_static
15B • Updated • 10 -
AngelSlim/Deepseek_r1_distill_qwen-14b_int4_gptq
3B • Updated • 5 -
AngelSlim/Deepseek_r1_distill_qwen-7b_int4_gptq
2B • Updated • 4 -
AngelSlim/Deepseek_r1_distill_qwen-7b_int4_awq
2B • Updated • 3 -
AngelSlim/Deepseek_r1_distill_qwen-7b_fp8_static
8B • Updated • 11 -
AngelSlim/Deepseek_r1_distill_qwen-32b_fp8_static
33B • Updated • 16 -
AngelSlim/Deepseek_r1_distill_qwen-32b_int4_awq
6B • Updated • 4 -
AngelSlim/Deepseek_r1_distill_qwen-32b_int4_gptq
6B • Updated • 3