Update README.md
Browse files
README.md
CHANGED
@@ -11,7 +11,7 @@ tags:
|
|
11 |
|
12 |
### Model Description
|
13 |
|
14 |
-
This model is a
|
15 |
|
16 |
base model, **openchat/openchat-3.5-0106**
|
17 |
|
@@ -19,7 +19,7 @@ code expert, **beowolx/CodeNinja-1.0-OpenChat-7B**
|
|
19 |
|
20 |
math expert, **meta-math/MetaMath-Mistral-7B**
|
21 |
|
22 |
-
This is the
|
23 |
``` yaml
|
24 |
base_model: openchat/openchat-3.5-0106
|
25 |
experts:
|
|
|
11 |
|
12 |
### Model Description
|
13 |
|
14 |
+
This model is a Mixture of Experts merged LLM consisting of 3 mistral based models:
|
15 |
|
16 |
base model, **openchat/openchat-3.5-0106**
|
17 |
|
|
|
19 |
|
20 |
math expert, **meta-math/MetaMath-Mistral-7B**
|
21 |
|
22 |
+
This is the Mergekit config used in the merging process:
|
23 |
``` yaml
|
24 |
base_model: openchat/openchat-3.5-0106
|
25 |
experts:
|