venkycs commited on
Commit
d0f7bb6
·
verified ·
1 Parent(s): 160c945

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +10 -24
README.md CHANGED
@@ -5,32 +5,18 @@ pipeline_tag: image-text-to-text
5
  base_model: google/gemma-3-27b-it
6
  ---
7
 
8
- # 💎 Gemma 3 27B IT Abliterated
9
 
10
- ![image/png](https://cdn-uploads.huggingface.co/production/uploads/61b8e2ba285851687028d395/WjFfc8hhj20r5XK07Yny9.png)
11
- <center><a href="https://huggingface.co/mlabonne/gemma-3-4b-it-abliterated">Gemma 3 4B Abliterated</a> • <a href="https://huggingface.co/mlabonne/gemma-3-12b-it-abliterated">Gemma 3 12B Abliterated</a></center>
12
 
13
- This is an uncensored version of [google/gemma-3-27b-it](https://huggingface.co/google/gemma-3-27b-it) created with a new abliteration technique.
14
- See [this article](https://huggingface.co/blog/mlabonne/abliteration) to know more about abliteration.
15
 
16
- I was playing with model weights and noticed that Gemma 3 was much more resilient to abliteration than other models like Qwen 2.5.
17
- I experimented with a few recipes to remove refusals while preserving most of the model capabilities.
 
18
 
19
- Note that this is fairly experimental, so it might not turn out as well as expected.
 
 
 
20
 
21
- I recommend using these generation parameters: `temperature=1.0`, `top_k=64`, `top_p=0.95`.
22
-
23
- ## ✂️ Layerwise abliteration
24
-
25
- ![image/png](https://cdn-uploads.huggingface.co/production/uploads/61b8e2ba285851687028d395/HnBRigUfoQaCnpz96jnun.png)
26
-
27
- In the original technique, a refusal direction is computed by comparing the residual streams between target (harmful) and baseline (harmless) samples.
28
-
29
- Here, the model was abliterated by computing a refusal direction based on hidden states (inspired by [Sumandora's repo](https://github.com/Sumandora/remove-refusals-with-transformers/)) for each layer, independently.
30
- This is combined with a refusal weight of 1.5 to upscale the importance of this refusal direction in each layer.
31
-
32
- This created a very high acceptance rate (>90%) and still produced coherent outputs.
33
-
34
- ## ⚡️ Quantization
35
-
36
- TBD.
 
5
  base_model: google/gemma-3-27b-it
6
  ---
7
 
8
+ 💎 Gemma 3 27B IT Abliterated
9
 
 
 
10
 
11
+ This is an experimental, uncensored version of google/gemma-3-27b-it created using a new abliteration technique. It removes refusals while keeping most of the model’s capabilities intact.
 
12
 
13
+ Key Features:
14
+ • Tool Calling Enabled: This version includes tool support, making it more flexible for various tasks.
15
+ • Minimal Fine-tuning: The model has been minimally fine-tuned, focusing on improving output coherence and handling requests effectively.
16
 
17
+ Recommended Generation Parameters:
18
+ • temperature=1.0
19
+ • top_k=64
20
+ • top_p=0.95
21
 
22
+ Abliteration - The model is abliterated by computing refusal directions based on hidden states for each layer independently.