Update README.md
Browse files
README.md
CHANGED
@@ -18,13 +18,15 @@ I experimented with a few recipes to remove refusals while preserving most of th
|
|
18 |
|
19 |
Note that this is fairly experimental, so it might not turn out as well as expected.
|
20 |
|
21 |
-
|
|
|
|
|
22 |
|
23 |

|
24 |
|
25 |
In the original technique, a refusal direction is computed by comparing the residual streams between target (harmful) and baseline (harmless) samples.
|
26 |
|
27 |
-
Here, the model was abliterated by computing a refusal direction for each layer, independently.
|
28 |
This is combined with a refusal weight of 1.5 to upscale the importance of this refusal direction in each layer.
|
29 |
|
30 |
This created a very high acceptance rate (>90%) and still produced coherent outputs.
|
|
|
18 |
|
19 |
Note that this is fairly experimental, so it might not turn out as well as expected.
|
20 |
|
21 |
+
I recommend using these generation parameters: `temperature=1.0`, `top_k=64`, `top_p=0.95`.
|
22 |
+
|
23 |
+
## ✂️ Layerwise abliteration
|
24 |
|
25 |

|
26 |
|
27 |
In the original technique, a refusal direction is computed by comparing the residual streams between target (harmful) and baseline (harmless) samples.
|
28 |
|
29 |
+
Here, the model was abliterated by computing a refusal direction based on hidden states (inspired by [Sumandora's repo](https://github.com/Sumandora/remove-refusals-with-transformers/)) for each layer, independently.
|
30 |
This is combined with a refusal weight of 1.5 to upscale the importance of this refusal direction in each layer.
|
31 |
|
32 |
This created a very high acceptance rate (>90%) and still produced coherent outputs.
|