mlabonne commited on
Commit
f8d39e5
·
verified ·
1 Parent(s): 52eca1d

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -2
README.md CHANGED
@@ -18,13 +18,15 @@ I experimented with a few recipes to remove refusals while preserving most of th
18
 
19
  Note that this is fairly experimental, so it might not turn out as well as expected.
20
 
21
- ## 🧠 Abliteration v2
 
 
22
 
23
  ![image/png](https://cdn-uploads.huggingface.co/production/uploads/61b8e2ba285851687028d395/HnBRigUfoQaCnpz96jnun.png)
24
 
25
  In the original technique, a refusal direction is computed by comparing the residual streams between target (harmful) and baseline (harmless) samples.
26
 
27
- Here, the model was abliterated by computing a refusal direction for each layer, independently.
28
  This is combined with a refusal weight of 1.5 to upscale the importance of this refusal direction in each layer.
29
 
30
  This created a very high acceptance rate (>90%) and still produced coherent outputs.
 
18
 
19
  Note that this is fairly experimental, so it might not turn out as well as expected.
20
 
21
+ I recommend using these generation parameters: `temperature=1.0`, `top_k=64`, `top_p=0.95`.
22
+
23
+ ## ✂️ Layerwise abliteration
24
 
25
  ![image/png](https://cdn-uploads.huggingface.co/production/uploads/61b8e2ba285851687028d395/HnBRigUfoQaCnpz96jnun.png)
26
 
27
  In the original technique, a refusal direction is computed by comparing the residual streams between target (harmful) and baseline (harmless) samples.
28
 
29
+ Here, the model was abliterated by computing a refusal direction based on hidden states (inspired by [Sumandora's repo](https://github.com/Sumandora/remove-refusals-with-transformers/)) for each layer, independently.
30
  This is combined with a refusal weight of 1.5 to upscale the importance of this refusal direction in each layer.
31
 
32
  This created a very high acceptance rate (>90%) and still produced coherent outputs.