Update README.md
Browse files
README.md
CHANGED
@@ -5,32 +5,18 @@ pipeline_tag: image-text-to-text
|
|
5 |
base_model: google/gemma-3-27b-it
|
6 |
---
|
7 |
|
8 |
-
|
9 |
|
10 |
-

|
11 |
-
<center><a href="https://huggingface.co/mlabonne/gemma-3-4b-it-abliterated">Gemma 3 4B Abliterated</a> • <a href="https://huggingface.co/mlabonne/gemma-3-12b-it-abliterated">Gemma 3 12B Abliterated</a></center>
|
12 |
|
13 |
-
This is an uncensored version of
|
14 |
-
See [this article](https://huggingface.co/blog/mlabonne/abliteration) to know more about abliteration.
|
15 |
|
16 |
-
|
17 |
-
|
|
|
18 |
|
19 |
-
|
|
|
|
|
|
|
20 |
|
21 |
-
|
22 |
-
|
23 |
-
## ✂️ Layerwise abliteration
|
24 |
-
|
25 |
-

|
26 |
-
|
27 |
-
In the original technique, a refusal direction is computed by comparing the residual streams between target (harmful) and baseline (harmless) samples.
|
28 |
-
|
29 |
-
Here, the model was abliterated by computing a refusal direction based on hidden states (inspired by [Sumandora's repo](https://github.com/Sumandora/remove-refusals-with-transformers/)) for each layer, independently.
|
30 |
-
This is combined with a refusal weight of 1.5 to upscale the importance of this refusal direction in each layer.
|
31 |
-
|
32 |
-
This created a very high acceptance rate (>90%) and still produced coherent outputs.
|
33 |
-
|
34 |
-
## ⚡️ Quantization
|
35 |
-
|
36 |
-
TBD.
|
|
|
5 |
base_model: google/gemma-3-27b-it
|
6 |
---
|
7 |
|
8 |
+
💎 Gemma 3 27B IT Abliterated
|
9 |
|
|
|
|
|
10 |
|
11 |
+
This is an experimental, uncensored version of google/gemma-3-27b-it created using a new “abliteration” technique. It removes refusals while keeping most of the model’s capabilities intact.
|
|
|
12 |
|
13 |
+
Key Features:
|
14 |
+
• Tool Calling Enabled: This version includes tool support, making it more flexible for various tasks.
|
15 |
+
• Minimal Fine-tuning: The model has been minimally fine-tuned, focusing on improving output coherence and handling requests effectively.
|
16 |
|
17 |
+
Recommended Generation Parameters:
|
18 |
+
• temperature=1.0
|
19 |
+
• top_k=64
|
20 |
+
• top_p=0.95
|
21 |
|
22 |
+
Abliteration - The model is abliterated by computing refusal directions based on hidden states for each layer independently.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|