internlm2_5-20b-chat-abliterated

This is a new approach for abliterating models using CPU only. I was able to abliterate this model using free kaggle processing with no accelerator.

  1. Obtain refusal direction vector using a quant model with llama.cpp (llama-cpp-python and ggml-python).
  2. Orthogonalize each .safetensors files directly from original repo and upload to a new repo. (one at a time)

Check out the jupyter notebook for details of how this model was abliterated from internlm2_5-20b-chat.

Logo

Downloads last month
33
Safetensors
Model size
19.9B params
Tensor type
BF16
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for byroneverson/internlm2_5-20b-chat-abliterated

Finetuned
(1)
this model
Quantizations
2 models