Speculative Decoding

#1
by s0me-0ne - opened

Could you add this model as a valid speculative decoding model? And perhaps make it possible for advanced users to force a speculative model for future models?

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment