Update README.md
Browse files
README.md
CHANGED
@@ -1,3 +1,22 @@
|
|
1 |
---
|
2 |
license: other
|
|
|
|
|
|
|
3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
---
|
2 |
license: other
|
3 |
+
language:
|
4 |
+
- en
|
5 |
+
inference: false
|
6 |
---
|
7 |
+
|
8 |
+
# OPT-6.7B-Nerybus-Mix
|
9 |
+
|
10 |
+
This is an experimental model containing a ***parameter-wise 50/50 blend (weighted average)*** of the weights of *NerysV2-6.7B* and *ErebusV1-6.7B*
|
11 |
+
Preliminary testing produces pretty coherent outputs, however, it seems less impressive than the 2.7B variant of Nerybus, as both 6.7B source models appear more similar than their 2.7B counterparts.
|
12 |
+
|
13 |
+
# License
|
14 |
+
The two models used for this blend, *NerysV2-6.7B* and *ErebusV1-6.7B* are made by **Mr. Seeker**.
|
15 |
+
- https://huggingface.co/KoboldAI/OPT-6.7B-Erebus
|
16 |
+
- https://huggingface.co/KoboldAI/OPT-6B-nerys-v2
|
17 |
+
The base OPT-6.7B model is licensed under the OPT-175B license, Copyright (c) Meta Platforms, Inc. All Rights Reserved.
|
18 |
+
|
19 |
+
# Evaluation Results
|
20 |
+
No formal evaluation is available for this model at this time. This blend was created in FP16, due to available memory constraints.
|
21 |
+
|
22 |
+
It is recommend to use this model with the KoboldAI software. All feedback and comments can be directed to Concedo on the KoboldAI discord.
|