Parameters vs FLOPs: Scaling Laws for Optimal Sparsity for Mixture-of-Experts Language Models
Paper
•
2501.12370
•
Published
•
8
Vimal Thilak
vimalthilak
AI & ML interests
None yet
Recent Activity
authored
a paper
3 days ago
Parameters vs FLOPs: Scaling Laws for Optimal Sparsity for
Mixture-of-Experts Language Models
upvoted
a
paper
3 months ago
Controlling Language and Diffusion Models by Transporting Activations
Organizations
None yet
vimalthilak's activity
authored
a
paper
3 days ago