Softpick: No Attention Sink, No Massive Activations with Rectified Softmax
Paper
•
2504.20966
•
Published
•
21
Matthew Shorter
MattShorter
·
AI & ML interests
Self validating media generators
Recent Activity
upvoted
a
paper
3 days ago
Softpick: No Attention Sink, No Massive Activations with Rectified
Softmax
upvoted
a
paper
7 days ago
World Models
Organizations
