Files changed (1) hide show
  1. README.md +19 -0
README.md CHANGED
@@ -14,6 +14,25 @@ CatMarcoro14-7B-slerp is a merge of the following models using [LazyMergekit](ht
14
  * [cookinai/CatMacaroni-Slerp](https://huggingface.co/cookinai/CatMacaroni-Slerp)
15
  * [EmbeddedLLM/Mistral-7B-Merge-14-v0.2](https://huggingface.co/EmbeddedLLM/Mistral-7B-Merge-14-v0.2)
16
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
17
  ## 🧩 Configuration
18
 
19
  ```yaml
 
14
  * [cookinai/CatMacaroni-Slerp](https://huggingface.co/cookinai/CatMacaroni-Slerp)
15
  * [EmbeddedLLM/Mistral-7B-Merge-14-v0.2](https://huggingface.co/EmbeddedLLM/Mistral-7B-Merge-14-v0.2)
16
 
17
+ ## 🏆 Evaluation
18
+
19
+ ### Open LLM Leaderboard
20
+
21
+ TBD.
22
+
23
+ ### Nous
24
+
25
+ | Model |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
26
+ |------------------------------------------------------------|------:|------:|---------:|-------:|------:|
27
+ |[**CatMarcoro14-7B-slerp**](https://huggingface.co/occultml/CatMarcoro14-7B-slerp)| **45.21**| **75.91**| **63.81**| <u>**47.31**</u>| **58.06**|
28
+ |[OpenHermes-2.5-Mistral-7B](https://huggingface.co/teknium/OpenHermes-2.5-Mistral-7B)| 42.75| 72.99| 52.99| 40.94| 52.42|
29
+ |[NeuralHermes-2.5-Mistral-7B](https://huggingface.co/mlabonne/NeuralHermes-2.5-Mistral-7B)| 43.67| 73.24| 55.37| 41.76| 53.51|
30
+ |[Marcoro14-7B-slerp](https://huggingface.co/mlabonne/Marcoro14-7B-slerp) | 44.66| <u>76.24</u>| 64.15| 45.64| 57.67|
31
+ |[Daredevil-7B](https://huggingface.co/shadowml/Daredevil-7B)| 44.85| 76.07| <u>64.89</u>| 47.07| <u>58.22</u>|
32
+ |[Nous-Hermes-2-SOLAR-10.7B](https://huggingface.co/NousResearch/Nous-Hermes-2-SOLAR-10.7B)| <u>47.79</u>| 74.69| 55.92| 44.84| 55.81|
33
+
34
+ See the complete evaluation [here](https://gist.github.com/mlabonne/64891517f7026cfc84107021859b5a5f).
35
+
36
  ## 🧩 Configuration
37
 
38
  ```yaml