Appreciate the model drop!
#2
by
Nitral-AI
- opened
But why is it only 4k? Its 2024 man, those are rookie numbers.
Hey @Nitral-AI , an extended context length version is forthcoming. Also, our models were trained with RoPE which allows them to accept inputs beyond 4K tokens in their current state.
Hi, thanks again for the inquiry! We’re currently working on closing out / responding to old tickets, so we’re closing this out for now, but if you require a follow-up response, please re-open and we will get back to you!
baileyk
changed discussion status to
closed