Fused Ion 's picture

Fused Ion

fusedion
Ā·

AI & ML interests

None yet

Recent Activity

Organizations

None yet

fusedion's activity

reacted to schuler's post with šŸ‘šŸ”„ 27 days ago
view post
Post
7226
šŸ“¢ New Research Alert: Making Language Models Smaller & Smarter!

Thrilled to share the latest technical report demonstrating how to reduce language model parameters by 77% while maintaining performance.

The secret? Grouped pointwise convolutions. Yes. We brought a method from computer vision to the transformers arena.

šŸ”‘ Key Findings:
ā€¢ 77% parameter reduction.
ā€¢ Maintained model capabilities.
ā€¢ Improved generalization.

Paper: https://www.researchgate.net/publication/388835829_SAVING_77_OF_THE_PARAMETERS_IN_LARGE_LANGUAGE_MODELS_TECHNICAL_REPORT
Code: https://github.com/joaopauloschuler/less-parameters-llm
  • 2 replies
Ā·
New activity in DAMO-NLP-SG/VideoLLaMA3-7B about 1 month ago

Max video length

1
#4 opened about 1 month ago by
fusedion
replied to takeraparterer's post about 1 month ago
New activity in ginipick/Dokdo-multimodal 2 months ago

Model details

#2 opened 2 months ago by
fusedion