Doctor-Shotgun/TinyLlama-1.1B-32k
Text Generation
•
Updated
•
47
•
30
LLM Speculative Decoding Experiments
Tiny language models meant to serve as draft models for speculative decoding.
-
-
Doctor-Shotgun/TinyLlama-1.1B-32k-Instruct
Text Generation • Updated • 2.8k • 12 -
Doctor-Shotgun/smol_llama-220M-GQA-32k-theta
Text Generation • Updated • 18 • 1 -
Doctor-Shotgun/smol_llama-220M-GQA-32k-theta-sft
Text Generation • Updated • 17 • 2 -
Doctor-Shotgun/smol_llama-220M-GQA-32k-theta-sft-limarp
Text Generation • Updated • 15 -
Doctor-Shotgun/smol_llama-220M-GQA-32k-linear
Text Generation • Updated • 14