MGE-LLMs/SteelBERT
Fill-Mask
•
Updated
•
9
•
5
ShaohanTian
ShaohanTian
·
AI & ML interests
Natural Language Processing (NLP), Text-to-Image Generation
Recent Activity
updated
a model
5 days ago
MGE-LLMs/SteelBERT
updated
a Space
8 days ago
MGE-LLMs/README
Organizations
ShaohanTian's activity
updated
a
model
5 days ago
updated
a
Space
8 days ago
reacted to
schuler's
post with 👍
12 days ago
Post
7213
📢 New Research Alert: Making Language Models Smaller & Smarter!
Thrilled to share the latest technical report demonstrating how to reduce language model parameters by 77% while maintaining performance.
The secret? Grouped pointwise convolutions. Yes. We brought a method from computer vision to the transformers arena.
🔑 Key Findings:
• 77% parameter reduction.
• Maintained model capabilities.
• Improved generalization.
Paper: https://www.researchgate.net/publication/388835829_SAVING_77_OF_THE_PARAMETERS_IN_LARGE_LANGUAGE_MODELS_TECHNICAL_REPORT
Code: https://github.com/joaopauloschuler/less-parameters-llm
Thrilled to share the latest technical report demonstrating how to reduce language model parameters by 77% while maintaining performance.
The secret? Grouped pointwise convolutions. Yes. We brought a method from computer vision to the transformers arena.
🔑 Key Findings:
• 77% parameter reduction.
• Maintained model capabilities.
• Improved generalization.
Paper: https://www.researchgate.net/publication/388835829_SAVING_77_OF_THE_PARAMETERS_IN_LARGE_LANGUAGE_MODELS_TECHNICAL_REPORT
Code: https://github.com/joaopauloschuler/less-parameters-llm
- 2 replies
liked
a
model
about 2 months ago
liked
a
model
6 months ago
updated
a
dataset
8 months ago
updated
a
Space
8 months ago
liked
a
Space
over 1 year ago