CompeteSMoE -- Statistically Guaranteed Mixture of Experts Training via Competition
Paper
•
2505.13380
•
Published
•
5
Various topics in AI and ML: large foundation model, computer vision, reinforcement learning, transformers, optimization, recommender system, etc.