Mechanistic - a yicui Collection

yicui 's Collections

Coding

ICL

RL

TDD

Theory

Mechanistic

updated Nov 22, 2024

Massive Activations in Large Language Models

Paper • 2402.17762 • Published Feb 27, 2024 • 1
What Matters in Transformers? Not All Attention is Needed

Paper • 2406.15786 • Published Jun 22, 2024 • 32
The Super Weight in Large Language Models

Paper • 2411.07191 • Published Nov 11, 2024 • 5
Top-nσ: Not All Logits Are You Need

Paper • 2411.07641 • Published Nov 12, 2024 • 22