Mistral 7B - Holodeck
This is the GGUF version of this model designed to be used with Koboldcpp, the easy and versitile program for AI co-writing and more. Because this is a co-writing model, you are expected to use the Story Mode inside the KoboldAI Lite interface.
Model Description
Mistral 7B-Holodeck is a finetune created using Mistral's 7B model.
Training data
The training data contains around 3000 ebooks in various genres.
Most parts of the dataset have been prepended using the following text: [Genre: <genre1>, <genre2>]
### Limitations and Biases
Based on known problems with NLP technology, potential relevant factors include bias (gender, profession, race and religion).
- Downloads last month
- 231
Hardware compatibility
Log In
to view the estimation
2-bit
3-bit
4-bit
5-bit
6-bit
8-bit
16-bit
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
๐
Ask for provider support