view article Article Accelerating LLM Code Generation Through Mask Store Streamlining By vivien β’ Jan 17 β’ 1
view article Article An Optimal Lossy Variant of Speculative Decoding By vivien β’ Jun 12, 2024 β’ 2
Husky: A Unified, Open-Source Language Agent for Multi-Step Reasoning Paper β’ 2406.06469 β’ Published Jun 10, 2024 β’ 25 β’ 2
view article Article Fast, High-Fidelity LLM Decoding with Regex Constraints By vivien β’ Feb 23, 2024 β’ 6