What is the context window of Athene-70b? 8k?

#10
by murat - opened

For example, Gradient AI has released long context versions of Llama 3 70b in May.

Source: https://lu.ma/longllama

Anyway, thank you for your work, folks!

Yes, the context window is 8k.

evan-nexusflow changed discussion status to closed

Sign up or log in to comment