Hugging Face's logo
Qiang's picture
4 33

Qiang

mikv39
VitoVikram's profile picture
Ā·

AI & ML interests

None yet

Recent Activity

liked a model 4 days ago
MrDragonFox/mOrpheus_3B-1Base_early_preview
liked a model 5 days ago
dreamgen/lucid-v1-nemo
reacted to m-ric's post with šŸš€ 8 days ago
New king of open VLMs: InternVL3 takes Qwen 2.5's crown! šŸ‘‘ InternVL have been a wildly successful series of model : and the latest iteration has just taken back their crown thanks to their superior, natively multimodal vision training pipeline. āž”ļø Most of the vision language models (VLMs) these days are built like Frankenstein : take a good text-only Large Language Model (LLM) backbone, stitch a specific vision transformer (ViT) on top of it. Then the training is sequential šŸ”¢ : 1. Freeze the LLM weights while you train the ViT only to work with the LLM part, then 2. Unfreeze all weights to train all weights in order to work together. šŸ’« The Shanghai Lab decided to challenge this paradigm and chose this approach that they call "native". For each of their model sizes, they still start from a good LLM (mostly Qwen-2.5 series, did I tell you I'm a huge fan of Qwen? ā¤ļø), and stitch the ViT, but they don't freeze anything : they train all weights together with interleaved text and image understanding data in a single pre-training phase šŸŽØ. They claim it results in more seamless interactions between modalities. And the results prove them right: they took the crown of top VLMs, at nearly all sizes, from their Qwen-2.5 parents. šŸ‘‘
View all activity

Organizations

None yet

mikv39's activity

liked a model 4 days ago
liked a model 5 days ago
liked a model 9 days ago
liked a model 13 days ago
liked a model 16 days ago
liked a model 19 days ago
liked a model 21 days ago
liked a model 23 days ago
liked 4 models about 1 month ago
liked 3 datasets about 2 months ago
liked 5 models about 2 months ago