Article
From DeepSpeed to FSDP and Back Again with Hugging Face Accelerate
By
and 3 others
•
•
55Stas Bekman
stas
AI & ML interests
Toolmaker. Software creator, optimizer and harmonizer.
Makes things work and fly at Contextual.AI
Training LLM/RAG/Generative AI/Machine Learning/Scalability
Organizations
published
an
article
about 1 year ago
published
an
article
almost 2 years ago
Article
Introducing IDEFICS: An Open Reproduction of State-of-the-art Visual Language Model
By
and 10 others
•
•
35
published
an
article
almost 3 years ago
Article
Incredibly Fast BLOOM Inference with DeepSpeed and Accelerate
By
and 1 other
•
•
1
published
an
article
about 3 years ago
Article
The Technology Behind BLOOM Training
By
•
•
36
published
an
article
over 4 years ago
Article
Fit More and Train Faster With ZeRO via DeepSpeed and FairScale
By
•
•
4
published
an
article
over 4 years ago
Article
Porting fairseq wmt19 translation system to transformers
By
•
•
1