Teacher Logits Collection Logits captured from large models to act as the teacher for distillation • 3 items • Updated 19 days ago • 7
view article Article Fine-tuning LLMs to 1.58bit: extreme quantization made easy +4 Sep 18, 2024 • 272
view article Article Llama 3.1 - 405B, 70B & 8B with multilinguality and long context +6 Jul 23, 2024 • 241