Lifelong Language Pretraining with Distribution-Specialized Experts
Paper
•
2305.12281
•
Published
•
1
Wuyang Chen
wuyangchen
AI & ML interests
None yet
Recent Activity
liked
a Space
7 days ago
delta-lab-ai/Lean-Finder
liked
a dataset
about 1 month ago
qihoo360/WISA-80K
upvoted
a
paper
about 1 month ago
Hybrid Neural-MPM for Interactive Fluid Simulations in Real-Time
Organizations
authored
5
papers
5 months ago
Mixture-of-Experts Meets Instruction Tuning:A Winning Combination for Large Language Models
Paper
•
2305.14705
•
Published
Auto-scaling Vision Transformers without Training
Paper
•
2202.11921
•
Published
Principled Architecture-aware Scaling of Hyperparameters
Paper
•
2402.17440
•
Published
A Simple Single-Scale Vision Transformer for Object Localization and Instance Segmentation
Paper
•
2112.09747
•
Published