This repository holds a Q4_K_M GGUF of Mistral Instruct v0.2 with the config.json swapped with their own v0.2 completions model config.json obtained directly from their CDN.

I can not manage to get it to use all 32k or 29k context but maybe this is user error.

Downloads last month: -; Downloads are not tracked for this model. How to track

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support