R's picture
🤝 Open to Collab

R PRO

juiceb0xc0de

AI & ML interests

Mechanistic interpretation SAE weight training Novel architecture exploration Brain atlas builds

Recent Activity

reacted to Bc-AI's post with 😎 about 2 hours ago
Smilyai News Hello everyone! August has been a crazy month for us at Smilyai-Labs. We've been doing lots behind the scenes, so here's the latest 👇 1. MiniCoder We are very close to releasing MiniCoder-1, our first-generation coding model designed for reasoning and coding. Our planned context window is 128K, but the earlier versions probably will not support that long! It's currently in the final stages of DPO so expect a release in early september. Release: VERY SOON™🤣 2. Smilyai G1 So, the current plan is 20B parameter model total, with a MoE architecture, activating around 2B parameters per token. Its desgigned for maximum performance but keeping it runnable on consumer hardware. It's only a plan and i have no idea when me and the team can finish it. Expect a launch around the end of september to early october-ish. I have no guarantees so don't quote me on the launch date. 3. T1 Smilyai-T1 is another major model we are working on. The goal for T1 is to take what we learnt from the countless architectural experiments and creating a powerful model designed for thinking. Think MiniCoder but reasons more and G1 but more capable. Its main goals are coding, math, reasoning and general capability. 4. Omni We are also planning Omni, our first from scratch multimodal model. It will not launch this year as it will take a while. We are actively researching the best architecture for it and we will update progress as we go! Thanks to our beta testers: @guardamarcos @ProCreations @juiceb0xc0de @Timmy6767 @Sbui503 @atom77777 @Fishtiks @smartdigitalnetworks @EmetTheGolum @smilyai-large-team @MUK-IS-GOAT @Bc-AI Thanks to my friends who work with me at lunchtimes (Smilyai-Labs team): @MUK-IS-GOAT @smilyai-large-team August was wild. Let’s see what September brings. 🚀 — Bc-AI, on behalf of SmilyAI Labs
liked a Space about 2 hours ago
ml-intern-explorers/MiniCoder-1-Inference
updated a dataset about 19 hours ago
juiceb0xc0de/qwen3.8-27b-atlas
View all activity

Organizations

Blog-explorers's profile picture ML intern explorers's profile picture Humanity's Last Hackathon's profile picture Build Small Hackathon's profile picture Smilyai-labs-beta-testers's profile picture 26B-Suite's profile picture