allenai/MADLAD-400
Updated
•
180k
•
142
text-pretrain-data
some pretrain dataset for LLM
-
-
CASIA-LM/ChineseWebText
Viewer • Updated • 1k • 5.8k • 41 -
allenai/dolma
Updated • 1.76k • 908 -
allenai/peS2o
Updated • 2.48k • 177 -
Skywork/SkyPile-150B
Viewer • Updated • 1.76M • 6.87k • 370 -
wenge-research/yayi2_pretrain_data
Viewer • Updated • 1.68M • 799 • 51 -
togethercomputer/RedPajama-Data-V2
Updated • 6.34k • 364 -
tiiuae/falcon-refinedweb
Viewer • Updated • 968M • 14.4k • 856 -
togethercomputer/RedPajama-Data-1T
Viewer • Updated • 1.73M • 2.82k • 1.09k -
cerebras/SlimPajama-627B
Preview • Updated • 82.5k • 473 -
Tele-AI/TeleChat-PTD
Updated • 572 • 168 -
open-web-math/open-web-math
Viewer • Updated • 6.32M • 6.14k • 312 -
GAIR/MathPile
Preview • Updated • 109 • 185 -
EleutherAI/proof-pile-2
Updated • 5.91k • 200 -
vietgpt/open-web-math
Viewer • Updated • 6.32M • 161 -
meta-math/MetaMathQA
Viewer • Updated • 395k • 6.84k • 383 -
bigcode/the-stack-dedup
Viewer • Updated • 237M • 4.39k • 357 -
bigcode/the-stack
Viewer • Updated • 546M • 17.9k • 820 -
nampdn-ai/tiny-strange-textbooks
Viewer • Updated • 1M • 89 • 91 -
uonlp/CulturaX
Viewer • Updated • 7.18B • 13.3k • 516 -
Locutusque/UltraTextbooks
Viewer • Updated • 5.52M • 969 • 196 -
HuggingFaceTB/cosmopedia
Viewer • Updated • 31.1M • 7.1k • 616