fullmetalcache commited on
Commit
b4c8bd3
·
verified ·
1 Parent(s): 777c0d4

Fix files that werent tracked with LFS

Browse files
README.md CHANGED
@@ -9,8 +9,56 @@ tags:
9
 
10
  # 🦙 Llama-3.2-3B-Instruct-abliterated
11
 
12
- NOTE: FORKED FROM https://huggingface.co/huihui-ai/Llama-3.2-3B-Instruct-abliterated
13
 
14
  This is an uncensored version of Llama 3.2 3B Instruct created with abliteration (see [this article](https://huggingface.co/blog/mlabonne/abliteration) to know more about it).
15
 
16
  Special thanks to [@FailSpy](https://huggingface.co/failspy) for the original code and technique. Please follow him if you're interested in abliterated models.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
9
 
10
  # 🦙 Llama-3.2-3B-Instruct-abliterated
11
 
12
+
13
 
14
  This is an uncensored version of Llama 3.2 3B Instruct created with abliteration (see [this article](https://huggingface.co/blog/mlabonne/abliteration) to know more about it).
15
 
16
  Special thanks to [@FailSpy](https://huggingface.co/failspy) for the original code and technique. Please follow him if you're interested in abliterated models.
17
+
18
+ ## ollama
19
+
20
+ You can use [huihui_ai/llama3.2-abliterate:3b](https://ollama.com/huihui_ai/llama3.2-abliterate:3b) directly,
21
+ ```
22
+ ollama run huihui_ai/llama3.2-abliterate
23
+ ```
24
+ or create your own model using the following methods.
25
+
26
+ 1. Download this model.
27
+ ```
28
+ huggingface-cli download huihui-ai/Llama-3.2-3B-Instruct-abliterated --local-dir ./huihui-ai/Llama-3.2-3B-Instruct-abliterated
29
+ ```
30
+ 2. Get Llama-3.2-3B-Instruct model for reference.
31
+ ```
32
+ ollama pull llama3.2
33
+ ```
34
+ 3. Export Llama-3.2-3B-Instruct model parameters.
35
+ ```
36
+ ollama show llama3.2 --modelfile > Modelfile
37
+ ```
38
+ 4. Modify Modelfile, Remove all comment lines (indicated by #) before the "FROM" keyword. Replace the "FROM" with the following content.
39
+ ```
40
+ FROM huihui-ai/Llama-3.2-3B-Instruct-abliterated
41
+ ```
42
+ 5. Use ollama create to then create the quantized model.
43
+ ```
44
+ ollama create --quantize q4_K_M -f Modelfile Llama-3.2-3B-Instruct-abliterated-q4_K_M
45
+ ```
46
+ 6. Run model
47
+ ```
48
+ ollama run Llama-3.2-3B-Instruct-abliterated-q4_K_M
49
+ ```
50
+
51
+ The running architecture is llama.
52
+
53
+ ## Evaluations
54
+ The following data has been re-evaluated and calculated as the average for each test.
55
+
56
+ | Benchmark | Llama-3.2-3B-Instruct | Llama-3.2-3B-Instruct-abliterated |
57
+ |-------------|-----------------------|-----------------------------------|
58
+ | IF_Eval | 76.55 | **76.76** |
59
+ | MMLU Pro | 27.88 | **28.00** |
60
+ | TruthfulQA | 50.55 | **50.73** |
61
+ | BBH | 41.81 | **41.86** |
62
+ | GPQA | 28.39 | **28.41** |
63
+
64
+ The script used for evaluation can be found inside this repository under /eval.sh, or click [here](https://huggingface.co/huihui-ai/Llama-3.2-3B-Instruct-abliterated/blob/main/eval.sh)
model-00001-of-00002.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b456bb67b734522457b92786af55aa900789044a9daf475922ae711b994215c4
3
+ size 4965799096
model-00002-of-00002.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0048e4a819059833d185d2467230e5eafde404b656203bc54aa76e344eb6695f
3
+ size 2247734992