Speculative Decoders?

#141
by Ano-Nimus - opened

Hi, first of all thank you for the great model, I have been using it daily. It has very good capability in coding and even mathematics, as far as I have used it.

My only complaint is that it runs a little slowly (hardware issue of course), so I was wondering if there are any speculative decoding models or plans to release/make some?

Thanks.

Sign up or log in to comment