32k or 500k context?

#3
by gghfez - opened

From the config.json:

    "max_position_embeddings": 500000,

But in the model card:

Context length: 32k

Which is it?
Given it's based on Command-A with 256k context, I'm hoping it's the 500k from the config file :)

Sign up or log in to comment