⚡ExLlamaV2 quant of : Contrl-Stheno-v1-8B

➡️ Exl2 version : 0.3.1
➡️ Cal. dataset : Default.
📄 Measurement.json file.

Contrl-Stheno-8B-v1

Contrl-Stheno-8B-v1

Model banner

Model Information

Contrl-Stheno-8B-v1

Stheno = Stheno-v3.2 Contrl = Control-Nanuq 8b Parameters

Model Composition

An Experiment of mine which turned out to be great! It has dialogues I hadn't found even in 70B models.

Reccomended Templates & Prompts

Quantized Versions

GGUF Quantizations

mradermacher STATIC-GGUF

Imat GGUF Quantizations

mradermacher IMAT-GGUF

Thanks to these people (I just made a script and Stole SteelSkull's Readme Template)

Downloads last month
11
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for Meggido/Contrl-Stheno-v1-8B-6.5bpw-h8-exl2

Quantized
(4)
this model

Collection including Meggido/Contrl-Stheno-v1-8B-6.5bpw-h8-exl2