Hugging Face's logo

HuggingFaceTB
/
SmolLM2-1.7B-Instruct

Text Generation
Transformers
TensorBoard
ONNX
Safetensors
Transformers.js
English
llama
conversational
text-generation-inference
Model card Files
xet
Metrics Community
30

What were the training datasets for this model?

#14
by Weyaxi - opened
Discussion
Weyaxi

Hi,

Thanks for this great model!

The datasets for other SmolLM (v1) models have been shared, but I couldn’t find the datasets used for training this model. Will the names of these datasets be released?

loubnabnl
 Hugging Face Smol Models Research org

Hi, we will share the training details in an upcoming tech report. We use a mix of FineWeb-Edu, DCLM and The Stack with new math and code datasets that we will release with the tech report.

loubnabnl
 Hugging Face Smol Models Research org

We released the SFT dataset here: https://huggingface.co/datasets/HuggingFaceTB/smoltalk

Weyaxi

Thanks for the contributions and the release!

Weyaxi changed discussion status to closed

Sign up or log in to comment