Recycling Pretrained Checkpoints: Orthogonal Growth of Mixture-of-Experts for Efficient Large Language Model Pre-Training
Paper
•
2510.08008
•
Published
•
5
Yaoqi Chen
yoki123
·
AI & ML interests
None yet
Recent Activity
upvoted
a
paper
6 months ago
RetroInfer: A Vector-Storage Approach for Scalable Long-Context LLM
Inference
updated
a model
6 months ago
yoki123/Qwen-Qwen2.5-3B-full-ft-wiki-bsz16-lr1e-06
Organizations
upvoted
a
paper
13 days ago
upvoted
a
paper
6 months ago
updated
a
model
6 months ago
published
a
model
6 months ago
updated
a
model
6 months ago
published
a
model
6 months ago
updated
a
model
6 months ago
published
a
model
6 months ago
updated
a
model
6 months ago
published
a
model
6 months ago
updated
a
model
6 months ago
published
a
model
6 months ago
updated
a
model
6 months ago
published
a
model
6 months ago
updated
a
model
6 months ago
updated
a
dataset
6 months ago
published
a
model
6 months ago
updated
a
model
6 months ago
updated
a
dataset
6 months ago
updated
a
model
6 months ago