Formatting might be "chaotic".

Hello, travelers!

These are my GGUF-IQ-Imatrix quants of Captain-Eris_Violet-GRPO-v0.420.

Discussions

General discussion and author feedback.
Feedback is always welcome for potential issues with quants and as a way to guide the author in the future iterations.
Your comments for them are appreciated!

SillyTavern

[SillyTavern Presets]
Initially recommended master-import presets.

⛶ [Expand/Collapse] Additional setup.

SillyTavern Reasoning Block Parsing Example...

Downloads last month: 561

GGUF

Model size

12.2B params

Architecture

llama

3-bit

4-bit

5-bit

6-bit

8-bit

16-bit

View +2 files

Inference Providers NEW

This model is not currently available via any of the supported Inference Providers.

The model cannot be deployed to the HF Inference API: The model has no library tag.

Model tree for Lewdiculous/Captain-Eris_Violet-GRPO-v0.420-GGUF-IQ-Imatrix

Base model

Nitral-AI/Captain-Eris-Diogenes_Twilight-V0.420-12B

Quantized

(8)

this model

Collection including Lewdiculous/Captain-Eris_Violet-GRPO-v0.420-GGUF-IQ-Imatrix

Quantized Models (GGUF, IQ, Imatrix)

Collection

Various quantizations of models in the GGUF format. Models with a "checkmark" are personal favorites. An "orange arrow" means it's being uploaded. • 94 items • Updated 2 days ago • 54