Mistral 7B - Holodeck

This is the GGUF version of this model designed to be used with Koboldcpp, the easy and versitile program for AI co-writing and more. Because this is a co-writing model, you are expected to use the Story Mode inside the KoboldAI Lite interface.

Model Description

Mistral 7B-Holodeck is a finetune created using Mistral's 7B model.

Training data

The training data contains around 3000 ebooks in various genres. Most parts of the dataset have been prepended using the following text: [Genre: <genre1>, <genre2>]

### Limitations and Biases
Based on known problems with NLP technology, potential relevant factors include bias (gender, profession, race and religion).
Downloads last month
231
GGUF
Model size
7.24B params
Architecture
llama
Hardware compatibility
Log In to view the estimation

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

16-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support