Update README.md
Browse files
README.md
CHANGED
@@ -4,7 +4,7 @@ library_name: transformers
|
|
4 |
tags:
|
5 |
- mergekit
|
6 |
- merge
|
7 |
-
|
8 |
---
|
9 |
|
10 |
# Antler 7B Evolve
|
@@ -15,8 +15,7 @@ tags:
|
|
15 |
|
16 |
This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit), using **Evolutionary Model Merging**.
|
17 |
|
18 |
-
Generally better than Antler-7B at writing novels, especially at maintaining
|
19 |
-
|
20 |
## Example
|
21 |
|
22 |
### Input
|
@@ -162,4 +161,4 @@ slices:
|
|
162 |
weight: 0.397020374822854
|
163 |
- layer_range: [24, 32]
|
164 |
model: evol_merge_storage\input_models\Antler7B_2159541861
|
165 |
-
```
|
|
|
4 |
tags:
|
5 |
- mergekit
|
6 |
- merge
|
7 |
+
license: apache-2.0
|
8 |
---
|
9 |
|
10 |
# Antler 7B Evolve
|
|
|
15 |
|
16 |
This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit), using **Evolutionary Model Merging**.
|
17 |
|
18 |
+
Generally better than Antler-7B at writing novels, especially at maintaining context, but can fall short on eroticism compared to the original model. It also tends to generate eos tokens quite early, which I'm currently working on improving.
|
|
|
19 |
## Example
|
20 |
|
21 |
### Input
|
|
|
161 |
weight: 0.397020374822854
|
162 |
- layer_range: [24, 32]
|
163 |
model: evol_merge_storage\input_models\Antler7B_2159541861
|
164 |
+
```
|