GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection
Paper
•
2403.03507
•
Published
•
189
Szymon Ruciński
szymonrucinski
AI & ML interests
NLP & Computer Vision
Recent Activity
liked
a dataset
about 2 months ago
wykonos/movies
liked
a dataset
about 2 months ago
Pablinho/movies-dataset
liked
a model
2 months ago
apple/mobilevit-small
Organizations
upvoted
4
papers
over 1 year ago
Efficient Language Adaptive Pre-training: Extending State-of-the-Art Large Language Models for Polish
Paper
•
2402.09759
•
Published
•
1
MoE-Mamba: Efficient Selective State Space Models with Mixture of Experts
Paper
•
2401.04081
•
Published
•
72
Exponentially Faster Language Modelling
Paper
•
2311.10770
•
Published
•
119