antiven0m commited on
Commit
2ef3a20
1 Parent(s): 5b1ba62

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +36 -0
README.md CHANGED
@@ -1,3 +1,39 @@
1
  ---
 
 
 
 
 
 
2
  license: cc-by-nc-4.0
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ base_model:
3
+ - SanjiWatsuki/Kunoichi-DPO-v2-7B
4
+ - macadeliccc/WestLake-7B-v2-laser-truthy-dpo
5
+ tags:
6
+ - mergekit
7
+ - merge
8
  license: cc-by-nc-4.0
9
+ language:
10
+ - en
11
+ library_name: transformers
12
  ---
13
+ ![Finch](https://i.imgur.com/xGpoByi.jpeg)
14
+
15
+ # Finch
16
+
17
+ ## A SLERP merge of my two current fav 7B models
18
+ [macadeliccc/WestLake-7B-v2-laser-truthy-dpo](https://huggingface.co/macadeliccc/WestLake-7B-v2-laser-truthy-dpo) & [SanjiWatsuki/Kunoichi-DPO-v2-7B](https://huggingface.co/SanjiWatsuki/Kunoichi-DPO-v2-7B)
19
+
20
+ A set of GGUF quants of [Finch](https://huggingface.co/antiven0m/finch)
21
+
22
+ ```yaml
23
+ base_model: macadeliccc/WestLake-7B-v2-laser-truthy-dpo
24
+ dtype: float16
25
+ merge_method: slerp
26
+ parameters:
27
+ t:
28
+ - filter: self_attn
29
+ value: [0.0, 0.5, 0.3, 0.7, 1.0]
30
+ - filter: mlp
31
+ value: [1.0, 0.5, 0.7, 0.3, 0.0]
32
+ - value: 0.5
33
+ slices:
34
+ - sources:
35
+ - layer_range: [0, 32]
36
+ model: macadeliccc/WestLake-7B-v2-laser-truthy-dpo
37
+ - layer_range: [0, 32]
38
+ model: SanjiWatsuki/Kunoichi-DPO-v2-7B
39
+ ```