YAML Metadata Error: "base_model" with value "https://huggingface.co/advanced-stack/MistralAI-v0.1-GGUF" is not valid. Use a model id from https://hf.co/models.

Mistral 7b

Support for calm

These models support the calm language model runner. The particular quants selected for this repo are in support of calm, which is a language model runner that automatically uses the right prompts, templates, context size, etc.

From https://mistral.ai

Mistral-7B-v0.1 is a small, yet powerful model adaptable to many use-cases. Mistral 7B is better than Llama 2 13B on all benchmarks, has natural coding abilities, and 8k sequence length. Itโ€™s released under Apache 2.0 licence. We made it easy to deploy on any cloud, and of course on your gaming GPU

More info: https://mistral.ai/news/announcing-mistral-7b/

Downloads last month
15
GGUF
Model size
7.24B params
Architecture
llama
Hardware compatibility
Log In to view the estimation

4-bit

6-bit

16-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support