From the config.json:
"max_position_embeddings": 500000,
But in the model card:
Context length: 32k
Which is it?Given it's based on Command-A with 256k context, I'm hoping it's the 500k from the config file :)
· Sign up or log in to comment