nvidia/Llama-3.1-8B-UltraLong-4M-Instruct
Text Generation
•
Updated
•
176
•
24
hanzlajavaid
hanzla
AI & ML interests
Direct Preference Optimization, Supervised Finetuning, Stable Diffusion
Recent Activity
liked
a model
about 6 hours ago
nvidia/Llama-3.1-8B-UltraLong-4M-Instruct
published
a Space
12 days ago
hanzla/VR_Experience_Report
updated
a Space
12 days ago
hanzla/VR_Experience_Report
Organizations
hanzla's activity
liked
a
model
about 6 hours ago
published
a
Space
12 days ago
updated
a
Space
12 days ago
Ollama support
1
#1 opened 19 days ago
by
ayan4m1
liked
a
model
21 days ago
posted
an
update
23 days ago
Post
1985
Hi community,
Few days back, I posted about my ongoing research on making reasoning mamba models and I found great insights from the community.
Today, I am announcing an update to the model weights. With newer checkpoints, the Falcon3 Mamba R1 model now outperforms very large transformer based LLMs (including Gemini) for Formal Logic questions of MMLU. It scores 60% on formal logic which is considered a tough subset of questions in MMLU.
I would highly appreciate your insights and suggestions on this new checkpoint.
Model Repo: hanzla/Falcon3-Mamba-R1-v0
Chat space: hanzla/Falcon3MambaReasoner
Few days back, I posted about my ongoing research on making reasoning mamba models and I found great insights from the community.
Today, I am announcing an update to the model weights. With newer checkpoints, the Falcon3 Mamba R1 model now outperforms very large transformer based LLMs (including Gemini) for Formal Logic questions of MMLU. It scores 60% on formal logic which is considered a tough subset of questions in MMLU.
I would highly appreciate your insights and suggestions on this new checkpoint.
Model Repo: hanzla/Falcon3-Mamba-R1-v0
Chat space: hanzla/Falcon3MambaReasoner
liked
a
model
23 days ago
updated
a
Space
23 days ago
updated
a
model
24 days ago
published
a
model
24 days ago
This is brilliant
reacted to
Jaward's
post with 🔥
24 days ago
Post
3651
Implemented a custom multimodal GRPO trainer that scales for Small VLMs, supports cpu and gpu with vllm + flash attention. Using SmolVLM-256M-Instruct reference & reward model, wasn’t trained for long btw, still got some sparks of “thinking”:)
Code: https://github.com/Jaykef/ai-algorithms/blob/main/grpo_multimodal_reasoner.ipynb
Code: https://github.com/Jaykef/ai-algorithms/blob/main/grpo_multimodal_reasoner.ipynb
-
- 1 reply
updated
a
model
24 days ago