README.md

metadata

datasets:
  - When-Does-Reasoning-Matter/general-reasoning-ift-pairs
  - When-Does-Reasoning-Matter/math-reasoning-ift-pairs
language:
  - en
library_name: transformers
pipeline_tag: text-generation
tags:
  - generated_from_trainer
license: cc-by-nc-4.0

When Does Reasoning Matter?

This model was trained as part of the paper When Does Reasoning Matter? It belongs to a collection of General and Math-specific student models distilled from Instruction-Fine-Tuned (IFT) or Reasoning answers generated by Qwen/Qwen3-235B-A22B.

---

Project Page

Project Page: https://huggingface.co/when-does-reasoning-matter

---

Datasets

These models were trained on the largest set of IFT and Reasoning answer pairs:

• General dataset: general-reasoning-ift-pairs
• Math dataset: math-reasoning-ift-pairs

---

Available Models

General		Math
IFT Models	Reasoning Models	IFT Models	Reasoning Models
Qwen2.5-0.5B-ift	Qwen2.5-0.5B-reasoning	Qwen2.5-0.5B-math-ift	Qwen2.5-0.5B-math-reasoning
Qwen2.5-1.5B-ift	Qwen2.5-1.5B-reasoning	Qwen2.5-1.5B-math-ift	Qwen2.5-1.5B-math-reasoning
Qwen2.5-3B-ift	Qwen2.5-3B-reasoning	Qwen2.5-3B-math-ift	Qwen2.5-3B-math-reasoning
Qwen2.5-7B-ift	Qwen2.5-7B-reasoning	Qwen2.5-7B-math-ift	Qwen2.5-7B-math-reasoning
Qwen2.5-14B-ift	Qwen2.5-14B-reasoning	Qwen2.5-14B-math-ift	Qwen2.5-14B-math-reasoning

---

If you use this dataset in your work, please cite: When Does Reasoning Matter?

@misc{boizard2025doesreasoningmattercontrolled,
      title={When Does Reasoning Matter? A Controlled Study of Reasoning's Contribution to Model Performance}, 
      author={Nicolas Boizard and Hippolyte Gisserot-Boukhlef and Kevin El-Haddad and Céline Hudelot and Pierre Colombo},
      year={2025},
      eprint={2509.22193},
      archivePrefix={arXiv},
      primaryClass={cs.CL},
      url={https://arxiv.org/abs/2509.22193}, 
}