Update README.md
Browse files
README.md
CHANGED
@@ -124,7 +124,7 @@ This model was merged using the SLERP merge method.
|
|
124 |
### Models Merged
|
125 |
|
126 |
The following models were included in the merge:
|
127 |
-
* IceLatteRP
|
128 |
* IceMochaccinoRP-7b
|
129 |
|
130 |
### Configuration
|
@@ -136,11 +136,11 @@ slices:
|
|
136 |
- sources:
|
137 |
- model: IceMochaccinoRP-7b
|
138 |
layer_range: [0, 32]
|
139 |
-
- model: IceLatteRP
|
140 |
layer_range: [0, 32]
|
141 |
|
142 |
merge_method: slerp
|
143 |
-
base_model: IceLatteRP
|
144 |
parameters:
|
145 |
t:
|
146 |
- filter: self_attn
|
|
|
124 |
### Models Merged
|
125 |
|
126 |
The following models were included in the merge:
|
127 |
+
* IceLatteRP-7b
|
128 |
* IceMochaccinoRP-7b
|
129 |
|
130 |
### Configuration
|
|
|
136 |
- sources:
|
137 |
- model: IceMochaccinoRP-7b
|
138 |
layer_range: [0, 32]
|
139 |
+
- model: IceLatteRP-7b
|
140 |
layer_range: [0, 32]
|
141 |
|
142 |
merge_method: slerp
|
143 |
+
base_model: IceLatteRP-7b
|
144 |
parameters:
|
145 |
t:
|
146 |
- filter: self_attn
|