Configuration Parsing Warning: In config.json: "quantization_config.bits" must be an integer

Abliterated version of Rombo-Org/Rombo-LLM-V3.1-QWQ-32b, utilizing code from refusal_direction.

For more information about the Abliterated technique, refer to this article and check out @FailSpy.

GGUF

This model is licensed under the Qwen LICENSE AGREEMENT, Copyright (c) Alibaba Cloud. All Rights Reserved.

Downloads last month
12
Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.

Model tree for zetasepic/Rombo-LLM-V3.1-QWQ-32b-abliterate-6.5bpw-h8-exl2

Base model

Qwen/Qwen2.5-32B
Quantized
(70)
this model