BigScience Workshop

AI & ML interests

A one-year long research workshop on large language models: the Summer of Language Models 21 🌸

Recent Activity

lvwerra  authored a paper 8 days ago

FineWeb2: One Pipeline to Scale Them All -- Adapting Pre-Training Data Processing to Every Language

craffel  authored a paper 8 days ago

FineWeb2: One Pipeline to Scale Them All -- Adapting Pre-Training Data Processing to Every Language

Skylion007  authored a paper 18 days ago

The Diffusion Duality

View all activity

Team members 328