oscar-corpus/OSCAR-2301
Updated • 1.57k • 186
LM datas
-
-
EleutherAI/pile
Updated • 10.2k • 503 -
nampdn-ai/tiny-strange-textbooks
Viewer • Updated • 1M • 57 • 94 -
wikimedia/wikipedia
Viewer • Updated • 61.6M • 257k • 1.44k -
Open-Orca/OpenOrca
Viewer • Updated • 2.94M • 24.8k • 1.6k -
liwu/MNBVC
Updated • 42.1k • 653 -
nampdn-ai/tiny-textbooks
Viewer • Updated • 420k • 663 • 184 -
togethercomputer/RedPajama-Data-V2
Updated • 7.21k • 406 -
nampdn-ai/tiny-math-textbooks
Viewer • Updated • 635k • 48 • 34 -
euirim/goodwiki
Viewer • Updated • 44.8k • 223 • 55 -
allenai/c4
Viewer • Updated • 10.4B • 1.27M • 653 -
bookcorpus/bookcorpus
Updated • 3.05k • 362 -
csebuetnlp/xlsum
Updated • 4.52k • 159 -
demelin/moral_stories
Viewer • Updated • 720k • 2.95k • 33 -
uonlp/CulturaX
Viewer • Updated • 7.18B • 22.3k • 685 -
JeanKaddour/minipile
Viewer • Updated • 1.01M • 3.85k • 150 -
nampdn-ai/tiny-lessons
Viewer • Updated • 20k • 49 • 25 -
nampdn-ai/tiny-bridgedict
Viewer • Updated • 17.6k • 8 • 18 -
nampdn-ai/tiny-orca-textbooks
Viewer • Updated • 147k • 33 • 43 -
GAIR/MathPile
Preview • Updated • 1.36k • 196 -
math-ai/AutoMathText
Viewer • Updated • 7.89M • 12.2k • 185 -
nampdn-ai/tiny-codes
Viewer • Updated • 1.63M • 2.31k • 301 -
allenai/peS2o
Updated • 20.7k • 204 -
nampdn-ai/mini-peS2o
Viewer • Updated • 1.91M • 34 • 11 -
HuggingFaceTB/cosmopedia
Viewer • Updated • 31.1M • 26.3k • 746 -
CausalLM/Refined-Anime-Text
Viewer • Updated • 1.02M • 24 • 274 -
espnet/yodas
Updated • 69.3k • 154 -
Skylion007/openwebtext
Viewer • Updated • 8.01M • 53.9k • 531 -
Locutusque/UltraTextbooks-2.0
Viewer • Updated • 3.22M • 284 • 53 -
storytracer/US-PD-Books
Viewer • Updated • 654k • 4.59k • 191 -
allenai/dolma
Updated • 3.44k • 1.08k -
m-a-p/MusicPile
Viewer • Updated • 5.86M • 977 • 59 -
nampdn-ai/mini-proofpile
Viewer • Updated • 221k • 10 • 8 -
nampdn-ai/mini-zh
Viewer • Updated • 2.2M • 62 • 3 -
YeungNLP/firefly-pretrain-dataset
Viewer • Updated • 2.46M • 688 • 42 -
open-phi/textbooks
Viewer • Updated • 1.8k • 3.43k • 95 -
open-phi/wile-e
Viewer • Updated • 933 • 15 • 3 -
tiiuae/falcon-refinedweb
Viewer • Updated • 968M • 62.4k • 957 -
aisingapore/SEA-PILE-v1
Viewer • Updated • 636M • 581 • 18 -
m-a-p/MAP-CC
Viewer • Updated • 1.77B • 5.6k • 83 -
EleutherAI/proof-pile-2
Updated • 21.6k • 231 -
open-web-math/open-web-math
Viewer • Updated • 6.32M • 30.7k • 360 -
nampdn-ai/mini-fineweb
Viewer • Updated • 291M • 13 • 27 -
HuggingFaceFW/fineweb
Viewer • Updated • 52.5B • 370k • 3.32k -
HuggingFaceTB/smollm-corpus
Viewer • Updated • 237M • 55.5k • 484 -
tabularisai/oak
Viewer • Updated • 1.06M • 217 • 38 -
roneneldan/TinyStories
Viewer • Updated • 2.14M • 85.1k • 1.15k -
m-a-p/Matrix
Viewer • Updated • 6.43B • 21.2k • 175 -
internlm/Lean-Github
Viewer • Updated • 219k • 410 • 41 -
opencsg/chinese-cosmopedia
Preview • Updated • 1.22k • 81 -
BAAI/CCI3-Data
Updated • 505 • 38 -
BAAI/CCI3-HQ
Viewer • Updated • 54.8M • 1.98k • 64 -
BAAI/IndustryCorpus2
Viewer • Updated • 634M • 1.91k • 76 -
Hieuman/wikitext-103-filtered
Viewer • Updated • 717k • 10 • 2 -
Salesforce/wikitext
Viewer • Updated • 3.71M • 1.62M • 780 -
iohadrubin/wikitext-103-raw-v1
Viewer • Updated • 29.7k • 2.47k • 10 -
Elriggs/openwebtext-100k
Viewer • Updated • 100k • 1.33k • 8 -
ashaba1in/small_openwebtext
Viewer • Updated • 1M • 79 • 1 -
shaowenchen/wiki_zh
Viewer • Updated • 1.04M • 17 • 6 -
TigerResearch/pretrain_zh
Viewer • Updated • 16.9M • 12.6k • 123 -
erhwenkuo/pretrain-chinese-zhtw
Viewer • Updated • 11.5M • 522 • 4 -
karpathy/tiny_shakespeare
Updated • 3.81k • 91 -
PleIAs/common_corpus
Viewer • Updated • 69.9k • 140k • 420 -
allenai/olmo-mix-1124
Viewer • Updated • 3.04B • 58.9k • 90 -
allenai/dolmino-mix-1124
Viewer • Updated • 170M • 21.2k • 101 -
institutional/institutional-books-hl
Preview • Updated • 18.7k • 292 -
EssentialAI/essential-web-v1.0
Preview • Updated • 14.6k • 246 -
PrimeIntellect/SYNTHETIC-2-Base
Viewer • Updated • 465k • 88 • 9 -
shajiu/TibetanGeneral_corpus
Viewer • Updated • 259k • 74 • 6 -
HuggingFaceFW/finepdfs
Viewer • Updated • 476M • 47.4k • 933 -
xTimeCrystal/TinyCorpus-v2
Viewer • Updated • 12.9M • 308 • 5 -
karpathy/fineweb-edu-100b-shuffle
Viewer • Updated • 97.2M • 10.6k • 171 -
open-index/hacker-news
Preview • Updated • 41.5k • 342