DeepSpeed Ulysses: System Optimizations for Enabling Training of Extreme Long Sequence Transformer Models
Paper
•
2309.14509
•
Published
•
20
Yining Zheng
WillQvQ
AI & ML interests
None yet
Organizations
upvoted
a
paper
3 months ago