Quantized models' evaluation results:

Models AIME24 AIME25
Light-R1-14B-DS 74.0 60.2
Light-R1-14B-DS-Q4_0.gguf (int4) 70.1 54.9
Light-R1-14B-DS-Q8_0.gguf (int8) 71.9 59.4
Light-R1-14B-DS-Q4-KM.gguf (q4-k-m) 70 61.3
Downloads last month
2,857
GGUF
Model size
14.8B params
Architecture
qwen2

4-bit

8-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for qihoo360/Light-R1-14B-DS-GGUF

Quantized
(8)
this model

Collection including qihoo360/Light-R1-14B-DS-GGUF