This repository contains the LongSpec model described in LongSpec: Long-Context Lossless Speculative Decoding with Efficient Drafting and Verification.

For training and usage, see the code at https://github.com/sail-sg/LongSpec.

Downloads last month
49
Safetensors
Model size
551M params
Tensor type
F32
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support