AlekseiPravdin
commited on
Commit
•
b2bed68
1
Parent(s):
dd68ed6
Upload folder using huggingface_hub
Browse files
KukulStanta-7B-Seamaiiza-7B-v1-slerp-merge.fp16.bin
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:297abe513d044e4ba62d2eb5ed1fdf71534740df5de5003ae4a59fc071662129
|
3 |
+
size 14048491360
|
README.md
CHANGED
@@ -14,9 +14,10 @@ KukulStanta-7B-Seamaiiza-7B-v1-slerp-merge is a merge of the following models us
|
|
14 |
* [Nitral-AI/KukulStanta-7B](https://huggingface.co/Nitral-AI/KukulStanta-7B)
|
15 |
* [AlekseiPravdin/Seamaiiza-7B-v1](https://huggingface.co/AlekseiPravdin/Seamaiiza-7B-v1)
|
16 |
|
17 |
-
## 🧩 Configuration
|
18 |
|
19 |
-
```
|
|
|
20 |
- sources:
|
21 |
- model: Nitral-AI/KukulStanta-7B
|
22 |
layer_range: [0, 31]
|
@@ -31,4 +32,5 @@ parameters:
|
|
31 |
- filter: mlp
|
32 |
value: [1, 0.5, 0.7, 0.3, 0]
|
33 |
- value: 0.5
|
34 |
-
dtype: float16
|
|
|
|
14 |
* [Nitral-AI/KukulStanta-7B](https://huggingface.co/Nitral-AI/KukulStanta-7B)
|
15 |
* [AlekseiPravdin/Seamaiiza-7B-v1](https://huggingface.co/AlekseiPravdin/Seamaiiza-7B-v1)
|
16 |
|
17 |
+
## 🧩 Merge Configuration
|
18 |
|
19 |
+
```yaml
|
20 |
+
slices:
|
21 |
- sources:
|
22 |
- model: Nitral-AI/KukulStanta-7B
|
23 |
layer_range: [0, 31]
|
|
|
32 |
- filter: mlp
|
33 |
value: [1, 0.5, 0.7, 0.3, 0]
|
34 |
- value: 0.5
|
35 |
+
dtype: float16
|
36 |
+
```
|