NormFormer: Improved Transformer Pretraining with Extra Normalization
Paper
•
2110.09456
•
Published
•
1
Sam Shleifer
sshleifer
AI & ML interests
Seq2Seq, summarization of long documents, finetuning methods
Organizations
authored
a
paper
about 2 years ago