burtenshaw/GemmaCoder3-12B
Image-Text-to-Text
•
Updated
•
364
•
39
a
fredbarre
AI & ML interests
None yet
Recent Activity
upvoted
a
collection
12 days ago
Best Leaderboard
liked
a model
12 days ago
burtenshaw/GemmaCoder3-12B
reacted
to
csabakecskemeti's
post
with 👀
3 months ago
I've run the open llm leaderboard evaluations + hellaswag on https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Llama-8B and compared to https://huggingface.co/meta-llama/Llama-3.1-8B-Instruct and at first glance R1 do not beat Llama overall.
If anyone wants to double check the results are posted here:
https://github.com/csabakecskemeti/lm_eval_results
Am I made some mistake, or (at least this distilled version) not as good/better than the competition?
I'll run the same on the Qwen 7B distilled version too.
Organizations
None yet
fredbarre's activity
liked
a
model
12 days ago
liked
a
model
4 months ago
liked
a
model
5 months ago
liked
4
models
6 months ago
liked
a
model
8 months ago
liked
a
Space
8 months ago
liked
a
model
8 months ago
liked
2
Spaces
10 months ago
liked
a
model
10 months ago
