Data Mixing Agent: Learning to Re-weight Domains for Continual Pre-training Paper • 2507.15640 • Published about 1 month ago • 4
Sigma: Differential Rescaling of Query, Key and Value for Efficient Language Models Paper • 2501.13629 • Published Jan 23 • 49