AlbertShi's picture

5 13

AlbertShi

AlbertShi

·

AI & ML interests

None yet

Recent Activity

upvoted an article 24 days ago

Trainable Dynamic Mask Sparse Attention: Bridging Efficiency and Effectiveness in Long-Context Language Models

upvoted a paper about 1 month ago

Trainable Dynamic Mask Sparse Attention

reacted to JingzeShi's post with 🤗 about 1 month ago

Trainable selective sampling and sparse attention kernels are indispensable in the era of context engineering. We hope our work will be helpful to everyone! 🤗 https://huggingface.co/papers/2508.02124

View all activity

Organizations

liked a dataset 5 months ago

SmallDoge/SmallTalks

Viewer • Updated Apr 25 • 4.48M • 1.3k • 9

liked 3 models 5 months ago

SmallDoge/Doge-160M

Text Generation • 0.2B • Updated about 1 month ago • 7 • 6

SmallDoge/Doge-320M

Text Generation • 0.1B • Updated about 1 month ago • 11 • 6

SmallDoge/Doge-320M-Instruct

Question Answering • 0.3B • Updated about 1 month ago • 103 • 4

liked a dataset 6 months ago

SmallDoge/SmallThoughts

Viewer • Updated Jul 24 • 102k • 197 • 46

liked 8 models 7 months ago

SmallDoge/Doge-160M-Instruct

Question Answering • 0.2B • Updated about 1 month ago • 309 • 12

SmallDoge/Doge-20M-checkpoint

Text Generation • 0.0B • Updated Jun 25 • 2 • 5

SmallDoge/Doge-60M-checkpoint

Text Generation • 0.1B • Updated Feb 17 • 4 • 3

SmallDoge/Doge-160M-checkpoint

Text Generation • 0.2B • Updated Feb 17 • 8 • 3

SmallDoge/Doge-20M-Instruct

Question Answering • 0.0B • Updated Apr 17 • 55 • 4

SmallDoge/Doge-60M-Instruct

Question Answering • 0.1B • Updated about 1 month ago • 153 • 6

SmallDoge/Doge-20M

Text Generation • 0.0B • Updated Jun 25 • 330 • 9

SmallDoge/Doge-60M

Text Generation • 0.1B • Updated about 1 month ago • 51 • 4