Exllamav2 Quantized Version of huihui-ai/DeepSeek-R1-Distill-Llama-70B-abliterated
Use the measurement.json file to craft different quantized versions.
huihui-ai/DeepSeek-R1-Distill-Llama-70B-abliterated
This is an uncensored version of deepseek-ai/DeepSeek-R1-Distill-Llama-70B created with abliteration (see remove-refusals-with-transformers to know more about it).
This is a crude, proof-of-concept implementation to remove refusals from an LLM model without using TransformerLens.
Use with ollama
You can use huihui_ai/deepseek-r1-abliterated directly
ollama run huihui_ai/deepseek-r1-abliterated:70b
- Downloads last month
- 25
Inference Providers
NEW
This model is not currently available via any of the supported third-party Inference Providers, and
the model is not deployed on the HF Inference API.
Model tree for JackCloudman/DeepSeek-R1-Distill-Llama-70B-abliterated-4.0bpw-h6-exl2
Base model
deepseek-ai/DeepSeek-R1-Distill-Llama-70B