Deconstructing Attention: Investigating Design Principles for Effective Language Modeling
Paper
•
2510.11602
•
Published
•
10
Constantinos Karouzos
ckarouzos
AI & ML interests
Natural Language Processing, Machine Learning for NLP, NLP Applications, Financial and Legal NLP, Domain
Adaptation, Unsupervised & Low-Resource Learning.
Recent Activity
upvoted
a
paper
about 8 hours ago
Deconstructing Attention: Investigating Design Principles for Effective
Language Modeling
upvoted
a
paper
7 days ago
Fine-Tuning on Noisy Instructions: Effects on Generalization and
Performance
upvoted
a
paper
28 days ago
ORPO: Monolithic Preference Optimization without Reference Model
Organizations
None yet