Article
GaLore: Advancing Large Model Training on Consumer-grade Hardware
By
and 8 others
•
•
29Sourab Mangrulkar
smangrul
AI & ML interests
Machine Learning, Deep Learning, Natural Language Processing, Natural Language Generation, Computer Vision, Reinforcement Learning
Recent Activity
liked
a model
about 18 hours ago
google/gemma-3n-E2B
liked
a model
about 1 month ago
sarvamai/sarvam-m
liked
a model
about 1 month ago
mistralai/Devstral-Small-2505
Organizations
published
an
article
over 1 year ago
published
an
article
over 1 year ago
Article
🤗 PEFT welcomes new merging methods
By
and 1 other
•
•
20
published
an
article
over 1 year ago
Article
Mixture of Experts Explained
By
and 5 others
•
•
714
published
an
article
over 1 year ago
Article
Personal Copilot: Train Your Own Coding Assistant
By
and 1 other
•
•
64
published
an
article
almost 2 years ago
Article
Fine-tuning Llama 2 70B using PyTorch FSDP
By
and 3 others
•
•
25
published
an
article
about 2 years ago
Article
The Falcon has landed in the Hugging Face ecosystem
By
and 7 others
•
•
14
published
an
article
about 2 years ago
Article
Making LLMs even more accessible with bitsandbytes, 4-bit quantization and QLoRA
By
and 4 others
•
•
156
published
an
article
over 2 years ago
Article
Fine-tuning 20B LLMs with RLHF on a 24GB consumer GPU
By
and 5 others
•
•
57
published
an
article
over 2 years ago
Article
🤗 PEFT: Parameter-Efficient Fine-Tuning of Billion-Scale Models on Low-Resource Hardware
By
and 1 other
•
•
86
published
an
article
about 3 years ago
Article
Accelerate Large Model Training using DeepSpeed
By
and 1 other
•
•
6
published
an
article
about 3 years ago
Article
Accelerate Large Model Training using PyTorch Fully Sharded Data Parallel
By
and 1 other
•
•
4