SFT Memorizes, RL Generalizes: A Comparative Study of Foundation Model Post-training
Paper
•
2501.17161
•
Published
•
47
Mohammed Hamdy
mmhamdy
AI & ML interests
TechBio | AI4Sci | NLP | Reinforcement Learning
Recent Activity
Organizations
mmhamdy's activity
upvoted
a
paper
1 day ago
reacted to
AdinaY's
post with 🧠🔥
9 days ago
Post
2786
BIG release by DeepSeek AI🔥🔥🔥
DeepSeek-R1 & DeepSeek-R1-Zero: two 660B reasoning models are here, alongside 6 distilled dense models (based on Llama & Qwen) for the community!
https://huggingface.co/deepseek-ai
deepseek-ai/DeepSeek-R1
✨ MIT License : enabling distillation for custom models
✨ 32B & 70B models match OpenAI o1-mini in multiple capabilities
✨ API live now! Access Chain of Thought reasoning with model='deepseek-reasoner'
DeepSeek-R1 & DeepSeek-R1-Zero: two 660B reasoning models are here, alongside 6 distilled dense models (based on Llama & Qwen) for the community!
https://huggingface.co/deepseek-ai
deepseek-ai/DeepSeek-R1
✨ MIT License : enabling distillation for custom models
✨ 32B & 70B models match OpenAI o1-mini in multiple capabilities
✨ API live now! Access Chain of Thought reasoning with model='deepseek-reasoner'
upvoted
a
paper
17 days ago
liked
a
model
19 days ago
upvoted
a
paper
23 days ago
liked
a
dataset
25 days ago
upvoted
a
paper
25 days ago
upvoted
a
paper
26 days ago
upvoted
a
paper
29 days ago
authored
a
paper
about 1 month ago
upvoted
a
paper
about 1 month ago
commented
a
paper
about 1 month ago
reacted to
hba123's
post with 🚀
about 1 month ago
Post
1812
Blindly applying algorithms without understanding the math behind them is not a good idea frmpv. So, I am on a quest to fix this!
I wrote my first hugging face article on how you would derive closed-form solutions for KL-regularised reinforcement learning problems - what is used for DPO.
Check it out: https://huggingface.co/blog/hba123/derivingdpo
I wrote my first hugging face article on how you would derive closed-form solutions for KL-regularised reinforcement learning problems - what is used for DPO.
Check it out: https://huggingface.co/blog/hba123/derivingdpo
upvoted
a
paper
about 1 month ago
updated
a
collection
about 1 month ago
reacted to
fdaudens's
post with 👍
about 1 month ago
Post
1385
🔍 From instruction-following to creative storytelling, dive into 2024's most impactful AI datasets! These gems are shaping everything from scientific research to video understanding.
Check it out: huggingface/open-source-ai-year-in-review-2024
Check it out: huggingface/open-source-ai-year-in-review-2024
liked
a
model
about 1 month ago
upvoted
a
collection
about 1 month ago
liked
a
Space
about 2 months ago