Update README.md
#1
by
mlabonne
- opened
README.md
CHANGED
@@ -14,6 +14,25 @@ CatMarcoro14-7B-slerp is a merge of the following models using [LazyMergekit](ht
|
|
14 |
* [cookinai/CatMacaroni-Slerp](https://huggingface.co/cookinai/CatMacaroni-Slerp)
|
15 |
* [EmbeddedLLM/Mistral-7B-Merge-14-v0.2](https://huggingface.co/EmbeddedLLM/Mistral-7B-Merge-14-v0.2)
|
16 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
17 |
## 🧩 Configuration
|
18 |
|
19 |
```yaml
|
|
|
14 |
* [cookinai/CatMacaroni-Slerp](https://huggingface.co/cookinai/CatMacaroni-Slerp)
|
15 |
* [EmbeddedLLM/Mistral-7B-Merge-14-v0.2](https://huggingface.co/EmbeddedLLM/Mistral-7B-Merge-14-v0.2)
|
16 |
|
17 |
+
## 🏆 Evaluation
|
18 |
+
|
19 |
+
### Open LLM Leaderboard
|
20 |
+
|
21 |
+
TBD.
|
22 |
+
|
23 |
+
### Nous
|
24 |
+
|
25 |
+
| Model |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
|
26 |
+
|------------------------------------------------------------|------:|------:|---------:|-------:|------:|
|
27 |
+
|[**CatMarcoro14-7B-slerp**](https://huggingface.co/occultml/CatMarcoro14-7B-slerp)| **45.21**| **75.91**| **63.81**| <u>**47.31**</u>| **58.06**|
|
28 |
+
|[OpenHermes-2.5-Mistral-7B](https://huggingface.co/teknium/OpenHermes-2.5-Mistral-7B)| 42.75| 72.99| 52.99| 40.94| 52.42|
|
29 |
+
|[NeuralHermes-2.5-Mistral-7B](https://huggingface.co/mlabonne/NeuralHermes-2.5-Mistral-7B)| 43.67| 73.24| 55.37| 41.76| 53.51|
|
30 |
+
|[Marcoro14-7B-slerp](https://huggingface.co/mlabonne/Marcoro14-7B-slerp) | 44.66| <u>76.24</u>| 64.15| 45.64| 57.67|
|
31 |
+
|[Daredevil-7B](https://huggingface.co/shadowml/Daredevil-7B)| 44.85| 76.07| <u>64.89</u>| 47.07| <u>58.22</u>|
|
32 |
+
|[Nous-Hermes-2-SOLAR-10.7B](https://huggingface.co/NousResearch/Nous-Hermes-2-SOLAR-10.7B)| <u>47.79</u>| 74.69| 55.92| 44.84| 55.81|
|
33 |
+
|
34 |
+
See the complete evaluation [here](https://gist.github.com/mlabonne/64891517f7026cfc84107021859b5a5f).
|
35 |
+
|
36 |
## 🧩 Configuration
|
37 |
|
38 |
```yaml
|