MoCa

non-profit

Activity Feed

AI & ML interests

None defined yet.

Recent Activity

hongliu9903 authored a paper 3 days ago

Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training

hongliu9903 authored a paper 3 days ago

Chain of Thought Empowers Transformers to Solve Inherently Serial Problems

hongliu9903 authored a paper 3 days ago

Same Pre-training Loss, Better Downstream: Implicit Bias Matters for Language Models

View all activity

Organization Card

Community About org cards

Welcome to MoCa-Embed! 👋

This is the organization of MoCa, which refers to Modality-aware Continual Pre-training for multimodal embedding models. In this organization, we release code, data and model checkpoints for MoCa embeddings.

models 2

moca-embed/MoCa-Qwen25VL-7B

Zero-Shot Image Classification • 8B • Updated 3 days ago • 86 • 1

moca-embed/MoCa-Qwen25VL-3B

Zero-Shot Image Classification • 4B • Updated 3 days ago • 69 • 2

datasets 12

AI & ML interests

Recent Activity

Team members 3

models 2 Sort: Recently updated

datasets 12 Sort: Recently updated

models 2

datasets 12