FineData

community

AI & ML interests

We release large pre-training datasets to accelerate open LLM development. Part of the Hugging Face Science team (hf.co/science)

Recent Activity

guipenedo updated a dataset about 1 month ago

HuggingFaceFW/fineweb-edu-score-2

guipenedo updated a dataset about 1 month ago

HuggingFaceFW/fineweb-edu

guipenedo updated a dataset about 1 month ago

HuggingFaceFW/fineweb

View all activity

HuggingFaceFW 's models 30

HuggingFaceFW/fineweb-edu-classifier

Text Classification • 0.1B • Updated Nov 17, 2024 • 47.2k • • 190

HuggingFaceFW/Datasets-Metrics-Viewer-Data

Updated Sep 2, 2024

HuggingFaceFW/ablation-model-fineweb-edu

Text Generation • 2B • Updated Jun 11, 2024 • 1.51k • 16

HuggingFaceFW/ablation-exp-filter-custom-all_filters-28BT

Text Generation • 2B • Updated Jun 4, 2024 • 4 • 1

HuggingFaceFW/ablation-exp-filter-custom-line_char_duplicated_0.01-28BT

Text Generation • 2B • Updated Jun 4, 2024 • 3 • 2

HuggingFaceFW/ablation-exp-filter-custom-line_ratio_0.67-28BT

Text Generation • 2B • Updated Jun 4, 2024 • 3

HuggingFaceFW/ablation-exp-filter-custom-lines_punct_0.12-28BT

Text Generation • 2B • Updated Jun 4, 2024 • 5 • 3

HuggingFaceFW/ablation-exp-filter-baseline_c4-28BT

Text Generation • 2B • Updated Jun 4, 2024 • 5 • 2

HuggingFaceFW/ablation-exp-filter-baseline_cc-28BT

Text Generation • 2B • Updated Jun 4, 2024 • 3 • 4

HuggingFaceFW/ablation-exp-filter-c4-word_lengths-28BT

Text Generation • 2B • Updated Jun 4, 2024 • 4 • 2

HuggingFaceFW/ablation-exp-filter-c4-tpunct-28BT

Text Generation • 2B • Updated Jun 4, 2024 • 3 • 1

HuggingFaceFW/ablation-exp-filter-c4-curly_bracket-28BT

Text Generation • 2B • Updated Jun 4, 2024 • 3

HuggingFaceFW/ablation-exp-filter-c4-all-28BT

Text Generation • 2B • Updated Jun 4, 2024 • 4

HuggingFaceFW/ablation-exp-filter-c4-all_except_tpunct-28BT

Text Generation • 2B • Updated Jun 4, 2024 • 4

HuggingFaceFW/ablation-exp-textext-wet-28BT

Text Generation • 2B • Updated Jun 4, 2024 • 3

HuggingFaceFW/ablation-exp-textext-warc_trafilatura-28BT

Text Generation • 2B • Updated Jun 4, 2024 • 3

HuggingFaceFW/ablation-exp-dedup-ind_mh-global_line-350BT

Text Generation • 2B • Updated Jun 4, 2024 • 4

HuggingFaceFW/ablation-exp-dedup-ind_mh-global_3line-350BT

Text Generation • 2B • Updated Jun 4, 2024 • 4

HuggingFaceFW/ablation-exp-fw-base_filt-ind_mh-c4_filters-350BT

Text Generation • 2B • Updated Jun 4, 2024 • 3

HuggingFaceFW/ablation-exp-dedup-ind_mh-global_line_minwords-350BT

Text Generation • 2B • Updated Jun 4, 2024 • 3

HuggingFaceFW/ablation-exp-dedup-independent_minhash-350BT

Text Generation • 2B • Updated Jun 4, 2024 • 3

HuggingFaceFW/ablation-exp-fw-base_filtering-350BT

Text Generation • 2B • Updated Jun 4, 2024 • 3

HuggingFaceFW/ablation-exp-dedup-global_minhash-350BT

Text Generation • 2B • Updated Jun 4, 2024 • 3

HuggingFaceFW/ablation-model-redpajama2

Text Generation • 2B • Updated May 5, 2024 • 9

HuggingFaceFW/ablation-model-the-pile

Text Generation • 2B • Updated Apr 25, 2024 • 6 • 1

HuggingFaceFW/ablation-model-slimpajama

Text Generation • 2B • Updated Apr 25, 2024 • 7 • 2

HuggingFaceFW/ablation-model-dolma-v1_6

Text Generation • 2B • Updated Apr 25, 2024 • 8 • 2

HuggingFaceFW/ablation-model-c4

Text Generation • 2B • Updated Apr 25, 2024 • 10 • 4

HuggingFaceFW/ablation-model-refinedweb

Text Generation • 2B • Updated Apr 25, 2024 • 9 • 3

HuggingFaceFW/ablation-model-fineweb-v1

Text Generation • 2B • Updated Apr 25, 2024 • 278 • 14