SmolLM3 evaluation datasets - a HuggingFaceTB Collection

HuggingFaceTB 's Collections

SmolLM3 pretraining datasets

SmolLM3 evaluation datasets

Dolma LongAttn Graded

Reasoning datasets

SmolLM2

SmolVLM2 📺 Smallest video LM ever 🤏🏻

📚 LLM pretraining datasets

SmolVLM

🧩 SmolLM2 Intermediate Checkpoints

The Ultimate Collection of Code Classifiers

SmolVLM 256M & 500M

💻 Local SmolLMs

Instruct datasets

🌌 Cosmopedia

Find textbooks in FineWeb with a classifier

FineWeb clustering & synthetic generations

Other: Stanford, OpenStax, khanAcademy, wikihow...

FW generation prompts

Wikipedia Science topics

Wikipedia textbooks

SFT Experiments

Decay mixture experiments

SmolLM3 evaluation datasets

updated Jul 8

Datasets to decontaminate the post-training mixtures against. Use the subset and column values described per entry

Idavidrein/gpqa

Viewer • Updated Mar 28, 2024 • 1.25k • 51.5k • 202

Note Subset: gpqa_diamond Column: Question
HuggingFaceH4/aime_2024

Viewer • Updated Jan 26 • 30 • 31k • 42

Note Column: problem
MathArena/aime_2025

Viewer • Updated May 14 • 30 • 4.01k • 4

Note Column: problem
MathArena/hmmt_feb_2025

Viewer • Updated May 14 • 30 • 1.01k • 2

Note Column: problem
MathArena/usamo_2025

Viewer • Updated Apr 16 • 6 • 118 • 2

Note Column: problem
MathArena/brumo_2025

Viewer • Updated May 14 • 30 • 140

Note Column: problem
HuggingFaceH4/MATH-500

Viewer • Updated Nov 15, 2024 • 500 • 65.1k • 169

Note Column: problem
livecodebench/code_generation_lite

Updated Jun 5 • 58.6k • 56

Note Subsets: v4 & v4_v5 Column: question_content
lighteval/SimpleQA

Viewer • Updated Jan 28 • 4.33k • 179 • 2

Note Split: test Column: problem
edinburgh-dawg/mmlu-redux-2.0

Viewer • Updated Feb 25 • 5.7k • 3.4k • 27

Note Subsets: decontaminate against all 57. May be best to create a copy of the dataset and have a single `all` subset Column: question
facebook/Multi-IF

Viewer • Updated Oct 30, 2024 • 4.5k • 330 • 34

Note Column: turn_1_prompt (needs preprocessing)
openai/MMMLU

Viewer • Updated Oct 16, 2024 • 393k • 6.19k • 496

Note Subset: default Column: Question
TIGER-Lab/MMLU-Pro

Viewer • Updated Apr 6 • 12.1k • 55.8k • 367

Note Split: test