Mitko Vasilev's picture

7 6 25

Mitko Vasilev

mitkox

·

AI & ML interests

Make sure you own your AI. AI in the cloud is not aligned with you; it's aligned with the company that owns it.

Recent Activity

posted an update 1 day ago

Training a model to reason in the continuous latent space based on Meta's Coconut. If it all works will apply it on the MiniCPM-o SVD-LR. Endgame is a multimodal, adaptive, and efficient foundational on device AI model.

replied to their post 10 days ago

Can it run DeepSeek V3 671B is the new 'can it run Doom'. How minimalistic can I go with on device AI with behemoth models - here I'm running DeepSeek V3 MoE on a single A6000 GPU. Not great, not terrible, for this minimalistic setup. I love the Mixture of Experts architectures. Typically I'm running my core LLM distributed over the 4 GPUs. Make sure you own your AI. AI in the cloud is not aligned with you; it's aligned with the company that owns it.

replied to their post 10 days ago

Can it run DeepSeek V3 671B is the new 'can it run Doom'. How minimalistic can I go with on device AI with behemoth models - here I'm running DeepSeek V3 MoE on a single A6000 GPU. Not great, not terrible, for this minimalistic setup. I love the Mixture of Experts architectures. Typically I'm running my core LLM distributed over the 4 GPUs. Make sure you own your AI. AI in the cloud is not aligned with you; it's aligned with the company that owns it.

View all activity

Organizations

mitkox's activity

upvoted 2 collections 4 months ago

LLM Reasoning Papers

Papers to improve reasoning capabilities of LLMs • 20 items • Updated 3 days ago • 101

DataGemma Release

A series of pioneering open models that help ground LLMs in real-world data through Data Commons. • 2 items • Updated Dec 13, 2024 • 82

upvoted a collection 5 months ago

Hermes 3

The Hermes 3 Series of Models • 10 items • Updated Dec 11, 2024 • 100

upvoted an article 6 months ago

Article

The Rise of Agentic Data Generation

By

•

Jul 15, 2024

• 81

upvoted a paper 10 months ago

MM1: Methods, Analysis & Insights from Multimodal LLM Pre-training

Paper • 2403.09611 • Published Mar 14, 2024 • 126

upvoted a paper about 1 year ago

LLM in a flash: Efficient Large Language Model Inference with Limited Memory

Paper • 2312.11514 • Published Dec 12, 2023 • 257