OpenMOSS, Fudan NLP, SII

university

https://open-moss.com/en/

Activity Feed Request to join this org

AI & ML interests

LLM

Recent Activity

foreveronly12 updated a dataset 3 days ago

fnlp/MHA2MLA-corpus-smollm

foreveronly12 published a dataset 3 days ago

fnlp/MHA2MLA-corpus-smollm

Hzfinfdu updated a model 29 days ago

fnlp/Lorsa-Llama-3.1-8B

View all activity

fnlp's activity

foreveronly12

updated a dataset 3 days ago

fnlp/MHA2MLA-corpus-smollm

Updated 3 days ago • 197

foreveronly12

published a dataset 3 days ago

fnlp/MHA2MLA-corpus-smollm

Updated 3 days ago • 197

Hzfinfdu

updated a model 29 days ago

fnlp/Lorsa-Llama-3.1-8B

Updated 29 days ago

Hzfinfdu

updated a model about 1 month ago

fnlp/Lorsa-Pythia-160M

Updated about 1 month ago • 1

Hzfinfdu

updated a collection about 1 month ago

Low Rank Sparse Attention

Open source weights of Lorsa modules introduced in "Towards Understanding the Nature of Attention with Low-Rank Sparse Decomposition". • 3 items • Updated Apr 30 • 2

Hzfinfdu

published a model about 1 month ago

fnlp/Lorsa

Updated Apr 28 • 2

Hzfinfdu

updated a collection about 1 month ago

Low Rank Sparse Attention

Open source weights of Lorsa modules introduced in "Towards Understanding the Nature of Attention with Low-Rank Sparse Decomposition". • 3 items • Updated Apr 30 • 2

Hzfinfdu

published 2 models about 1 month ago

fnlp/Lorsa-Llama-3.1-8B

Updated 29 days ago

fnlp/Lorsa-Pythia-160M

Updated about 1 month ago • 1

Hzfinfdu

updated a collection about 1 month ago

Low Rank Sparse Attention

Open source weights of Lorsa modules introduced in "Towards Understanding the Nature of Attention with Low-Rank Sparse Decomposition". • 3 items • Updated Apr 30 • 2

xpqiu

authored a paper about 2 months ago

VisuoThink: Empowering LVLM Reasoning with Multimodal Tree Search

Paper • 2504.09130 • Published Apr 12 • 12

TaoJi

updated a dataset 2 months ago

fnlp/MHA2MLA-corpus-qwen1_5

Updated Apr 1 • 8

TaoJi

updated a collection 2 months ago

MHA2MLA

The MHA2MLA model published in the paper "Towards Economical Inference: Enabling DeepSeek's Multi-Head Latent Attention in Any Transformer-Based LLMs" • 22 items • Updated Apr 1 • 1

TaoJi

updated 2 datasets 2 months ago

fnlp/MHA2MLA-corpus-qwen2

Updated Apr 1 • 29

fnlp/MHA2MLA-corpus-mistral-v0_1

Updated Mar 31 • 15

TaoJi

published 2 datasets 2 months ago

fnlp/MHA2MLA-corpus-mistral-v0_1

Updated Mar 31 • 15

fnlp/MHA2MLA-corpus-qwen1_5

Updated Apr 1 • 8