GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection
Paper
•
2403.03507
•
Published
•
182
Umberto Cappellazzo
hisoka94
AI & ML interests
Continual learning for audio and speech processing. Parameter-efficient transfer learning of pre-trained models. Multimodal Large Language Models.
Organizations
None yet