Article
Welcome Gemma 3: Google's all new multimodal, multilingual, long context open LLM
•
387
chenk-ai
chenk-ai
·
AI & ML interests
None yet
Recent Activity
new activity
28 days ago
open-r1/README:[Experiment] Applying GRPO to DeepSeek-R1-Distill-Qwen-1.5B with LIMO
replied to
burtenshaw's
post
28 days ago
Here’s a notebook to make Gemma reason with GRPO & TRL. I made this whilst prepping the next unit of the reasoning course:
In this notebooks I combine together google’s model with some community tooling
- First, I load the model from the Hugging Face hub with transformers’s latest release for Gemma 3
- I use PEFT and bitsandbytes to get it running on Colab
- Then, I took Will Browns processing and reward functions to make reasoning chains from GSM8k
- Finally, I used TRL’s GRPOTrainer to train the model
Next step is to bring Unsloth AI in, then ship it in the reasoning course. Links to notebook below.
https://colab.research.google.com/drive/1Vkl69ytCS3bvOtV9_stRETMthlQXR4wX?usp=sharing
Organizations
None yet
chenk-ai's activity
upvoted
an
article
about 1 month ago
upvoted
an
article
2 months ago
Article
Open-R1: a fully open reproduction of DeepSeek-R1
•
841