FineData

community

AI & ML interests

We release large pre-training datasets to accelerate open LLM development. Part of the Hugging Face Science team (hf.co/science)

Recent Activity

guipenedo updated a dataset 5 days ago

HuggingFaceFW/fineweb

guipenedo updated a dataset 5 days ago

HuggingFaceFW/fineweb-edu-score-2

thomwolf authored a paper 9 days ago

FineWeb2: One Pipeline to Scale Them All -- Adapting Pre-Training Data Processing to Every Language

View all activity

HuggingFaceFW 's Spaces 4

FineWeb: decanting the web for the finest text data at scale

Generate high-quality web text data for LLM training

Scaling FineWeb to 1000+ languages: Step 1: finding signal in 100s of evaluation tasks

Evaluate multilingual models using FineTasks

Tasks Explorer

Datasets Metrics Explorer