randomicity's picture

4 3

randomicity

randomicity

·

AI & ML interests

None yet

Recent Activity

reacted to onekq's post with 👍 3 days ago

Instead of architectural upgade, each major model drop nowadays perfects a regional innovation. What Kimi brought to spot light this time is quantization aware training (QAT). I wrote an article to explain it and why it matters to reasoning models. https://huggingface.co/blog/onekq/qat-bonsai If you are interested in this kind of posts, I will introduce the Muon optimizers, another technology behind Kimi success.

upvoted an article 7 days ago

Evaluate Your Own RAG: Why Best Practices Failed Us

upvoted a collection 10 days ago

Nordic datasets with Fineweb-edu predictions

View all activity

Organizations

None yet

randomicity 's datasets

None public yet