QuantFactory/Llama3.1-Allades-8B-GGUF

This is quantized version of nbeerbower/Llama3.1-Allades-8B created using llama.cpp

Original Model Card

Allades finetunes abliterated Llama 3.1 with 5 datasets to improve creative writing, reasoning, and roleplay.

ORPO tuned for 1 epoch with 2x RTX 3090 (sponsored by Schneewolf Labs).

Data was prepared with Llama 3.1 Instruct.

GGUF

Model size

8.03B params

Architecture

llama

Hardware compatibility

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Base model

Finetuned

Finetuned

Quantized

(15)

this model