ShaohanTian's picture

3

ShaohanTian

ShaohanTian

·

https://shaohanyun.top/

AI & ML interests

Natural Language Processing (NLP), Text-to-Image Generation

Recent Activity

updated a model 5 days ago

MGE-LLMs/SteelBERT

updated a Space 8 days ago

MGE-LLMs/README

reacted to schuler's post with 👍 11 days ago

📢 New Research Alert: Making Language Models Smaller & Smarter! Thrilled to share the latest technical report demonstrating how to reduce language model parameters by 77% while maintaining performance. The secret? Grouped pointwise convolutions. Yes. We brought a method from computer vision to the transformers arena. 🔑 Key Findings: • 77% parameter reduction. • Maintained model capabilities. • Improved generalization. Paper: https://www.researchgate.net/publication/388835829_SAVING_77_OF_THE_PARAMETERS_IN_LARGE_LANGUAGE_MODELS_TECHNICAL_REPORT Code: https://github.com/joaopauloschuler/less-parameters-llm

View all activity

Organizations

models

None public yet

datasets 1

ShaohanTian/curve-plot

Viewer • Updated Jun 28, 2024 • 10k • 45