Article
DeepSeek-R1 Dissection: Understanding PPO & GRPO Without Any Prior Reinforcement Learning Knowledge
By
•
•
67Ankit Sharma
nezubn
AI & ML interests
engineering • systems • ml
Recent Activity
liked
a model
2 months ago
deepseek-ai/DeepSeek-V3
liked
a model
4 months ago
bartowski/Llama-3.1_OpenScholar-8B-GGUF
Organizations
nezubn's activity
upvoted
an
article
2 days ago
upvoted
a
paper
4 months ago
upvoted
a
paper
5 months ago
upvoted
2
articles
7 months ago
Article
Optimizing your LLM in production
•
15
Article
Getting Started With Embeddings
•
60
upvoted
an
article
8 months ago
Article
quanto: a pytorch quantization toolkit
•
35
upvoted
2
papers
10 months ago
upvoted
a
paper
11 months ago
upvoted
an
article
11 months ago
Article
Making LLMs even more accessible with bitsandbytes, 4-bit quantization and QLoRA
•
125
upvoted
3
papers
11 months ago
Understanding LLMs: A Comprehensive Overview from Training to Inference
Paper
•
2401.02038
•
Published
•
64
Mixture-of-Depths: Dynamically allocating compute in transformer-based language models
Paper
•
2404.02258
•
Published
•
104
Advancing LLM Reasoning Generalists with Preference Trees
Paper
•
2404.02078
•
Published
•
45
upvoted
7
papers
12 months ago
Transformer-Lite: High-efficiency Deployment of Large Language Models on Mobile Phone GPUs
Paper
•
2403.20041
•
Published
•
35
Jamba: A Hybrid Transformer-Mamba Language Model
Paper
•
2403.19887
•
Published
•
108
Gamba: Marry Gaussian Splatting with Mamba for single view 3D reconstruction
Paper
•
2403.18795
•
Published
•
20
Long-form factuality in large language models
Paper
•
2403.18802
•
Published
•
25
The case for 4-bit precision: k-bit Inference Scaling Laws
Paper
•
2212.09720
•
Published
•
3
Simple and Scalable Strategies to Continually Pre-train Large Language Models
Paper
•
2403.08763
•
Published
•
50
MM1: Methods, Analysis & Insights from Multimodal LLM Pre-training
Paper
•
2403.09611
•
Published
•
126