Writing in the Margins: Better Inference Pattern for Long Context Retrieval
Paper
•
2408.14906
•
Published
•
144
Long context
-
-
DuoAttention: Efficient Long-Context LLM Inference with Retrieval and Streaming Heads
Paper • 2410.10819 • Published • 7 -
LLMtimesMapReduce: Simplified Long-Sequence Processing using Large Language Models
Paper • 2410.09342 • Published • 39 -
PDFTriage: Question Answering over Long, Structured Documents
Paper • 2309.08872 • Published • 53 -
ComplexFuncBench: Exploring Multi-Step and Constrained Function Calling under Long-Context Scenario
Paper • 2501.10132 • Published • 22 -
Can Large Language Models Detect Errors in Long Chain-of-Thought Reasoning?
Paper • 2502.19361 • Published • 28 -
Interleaved Reasoning for Large Language Models via Reinforcement Learning
Paper • 2505.19640 • Published • 14 -
SuperWriter: Reflection-Driven Long-Form Generation with Large Language Models
Paper • 2506.04180 • Published • 33 -
Beyond Homogeneous Attention: Memory-Efficient LLMs via Fourier-Approximated KV Cache
Paper • 2506.11886 • Published • 20 -
Optimizing Length Compression in Large Reasoning Models
Paper • 2506.14755 • Published • 10 -
LongWriter-Zero: Mastering Ultra-Long Text Generation via Reinforcement Learning
Paper • 2506.18841 • Published • 56 -
SpeContext: Enabling Efficient Long-context Reasoning with Speculative Context Sparsity in LLMs
Paper • 2512.00722 • Published • 15 -
Beyond Real: Imaginary Extension of Rotary Position Embeddings for Long-Context LLMs
Paper • 2512.07525 • Published • 55