schonsense commited on
Commit
dd34421
·
verified ·
1 Parent(s): 5697b92

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +51 -50
README.md CHANGED
@@ -1,50 +1,51 @@
1
- ---
2
- base_model: []
3
- library_name: transformers
4
- tags:
5
- - mergekit
6
- - merge
7
-
8
- ---
9
- # Jotun_flam
10
-
11
- This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
12
-
13
- ## Merge Details
14
- ### Merge Method
15
-
16
- This model was merged using the passthrough merge method.
17
-
18
- ### Models Merged
19
-
20
- The following models were included in the merge:
21
- * schonsense/flam-kit
22
- * schonsense/Llama-3.3-70B-Inst-Ablit-Flammades-SLERP
23
-
24
- ### Configuration
25
-
26
- The following YAML configuration was used to produce this model:
27
-
28
- ```yaml
29
- slices:
30
- - sources:
31
- - model: schonsense/Llama-3.3-70B-Inst-Ablit-Flammades-SLERP
32
- layer_range: [0, 19]
33
- - sources:
34
- - model: schonsense/flam-kit
35
- layer_range: [20, 39]
36
- - sources:
37
- - model: schonsense/Llama-3.3-70B-Inst-Ablit-Flammades-SLERP
38
- layer_range: [21, 40]
39
- - sources:
40
- - model: schonsense/flam-kit
41
- layer_range: [40, 59]
42
- - sources:
43
- - model: schonsense/Llama-3.3-70B-Inst-Ablit-Flammades-SLERP
44
- layer_range: [41, 80]
45
-
46
-
47
- merge_method: passthrough
48
- dtype: float16
49
-
50
- ```
 
 
1
+ ---
2
+ base_model:
3
+ - schonsense/Llama-3.3-70B-Inst-Ablit-Flammades-SLERP
4
+ - schonsense/flam-kit
5
+ library_name: transformers
6
+ tags:
7
+ - mergekit
8
+ - merge
9
+ ---
10
+ # Jotun_flam
11
+
12
+ This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
13
+
14
+ ## Merge Details
15
+ ### Merge Method
16
+
17
+ This model was merged using the passthrough merge method.
18
+
19
+ ### Models Merged
20
+
21
+ The following models were included in the merge:
22
+ * schonsense/flam-kit
23
+ * schonsense/Llama-3.3-70B-Inst-Ablit-Flammades-SLERP
24
+
25
+ ### Configuration
26
+
27
+ The following YAML configuration was used to produce this model:
28
+
29
+ ```yaml
30
+ slices:
31
+ - sources:
32
+ - model: schonsense/Llama-3.3-70B-Inst-Ablit-Flammades-SLERP
33
+ layer_range: [0, 19]
34
+ - sources:
35
+ - model: schonsense/flam-kit
36
+ layer_range: [20, 39]
37
+ - sources:
38
+ - model: schonsense/Llama-3.3-70B-Inst-Ablit-Flammades-SLERP
39
+ layer_range: [21, 40]
40
+ - sources:
41
+ - model: schonsense/flam-kit
42
+ layer_range: [40, 59]
43
+ - sources:
44
+ - model: schonsense/Llama-3.3-70B-Inst-Ablit-Flammades-SLERP
45
+ layer_range: [41, 80]
46
+
47
+
48
+ merge_method: passthrough
49
+ dtype: float16
50
+
51
+ ```