Speculative Decoders?
#141
by
Ano-Nimus
- opened
Hi, first of all thank you for the great model, I have been using it daily. It has very good capability in coding and even mathematics, as far as I have used it.
My only complaint is that it runs a little slowly (hardware issue of course), so I was wondering if there are any speculative decoding models or plans to release/make some?
Thanks.