Hugging Face's logo

Epiculous
/
Crunchy-onion-GGUF

GGUF
conversational
Model card Files Community

Crunchy-onion

This model is created by training Mixtral base model on LimaRP (ShareGPT format provided by SAO), theory of mind, and gnosis(provided by jeiku).

The 4-bit qlora was then merged into Mixtral Instruct resulting in what you see here.

Works best with Alpaca Instruct

Downloads last month
51
GGUF
Model size
46.7B params
Architecture
llama
Hardware compatibility
Log In to view the estimation

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Datasets used to train Epiculous/Crunchy-onion-GGUF

Collection including Epiculous/Crunchy-onion-GGUF