Update README.md
Browse files
README.md
CHANGED
@@ -27,7 +27,8 @@ model-index:
|
|
27 |
value: 79.41
|
28 |
name: strict accuracy
|
29 |
source:
|
30 |
-
url:
|
|
|
31 |
name: Open LLM Leaderboard
|
32 |
- task:
|
33 |
type: text-generation
|
@@ -42,7 +43,8 @@ model-index:
|
|
42 |
value: 31.39
|
43 |
name: normalized accuracy
|
44 |
source:
|
45 |
-
url:
|
|
|
46 |
name: Open LLM Leaderboard
|
47 |
- task:
|
48 |
type: text-generation
|
@@ -57,7 +59,8 @@ model-index:
|
|
57 |
value: 19.18
|
58 |
name: exact match
|
59 |
source:
|
60 |
-
url:
|
|
|
61 |
name: Open LLM Leaderboard
|
62 |
- task:
|
63 |
type: text-generation
|
@@ -72,7 +75,8 @@ model-index:
|
|
72 |
value: 6.82
|
73 |
name: acc_norm
|
74 |
source:
|
75 |
-
url:
|
|
|
76 |
name: Open LLM Leaderboard
|
77 |
- task:
|
78 |
type: text-generation
|
@@ -87,7 +91,8 @@ model-index:
|
|
87 |
value: 8.57
|
88 |
name: acc_norm
|
89 |
source:
|
90 |
-
url:
|
|
|
91 |
name: Open LLM Leaderboard
|
92 |
- task:
|
93 |
type: text-generation
|
@@ -104,15 +109,19 @@ model-index:
|
|
104 |
value: 32.14
|
105 |
name: accuracy
|
106 |
source:
|
107 |
-
url:
|
|
|
108 |
name: Open LLM Leaderboard
|
|
|
|
|
109 |
---
|
110 |
# ZEUS
|
111 |
|
112 |
-
|
113 |
-
|
114 |
-
|
115 |
-
|
|
|
116 |
|
117 |
## Merge Details
|
118 |
|
|
|
27 |
value: 79.41
|
28 |
name: strict accuracy
|
29 |
source:
|
30 |
+
url: >-
|
31 |
+
https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=T145/Llama-3.1-8B-Instruct-Zeus
|
32 |
name: Open LLM Leaderboard
|
33 |
- task:
|
34 |
type: text-generation
|
|
|
43 |
value: 31.39
|
44 |
name: normalized accuracy
|
45 |
source:
|
46 |
+
url: >-
|
47 |
+
https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=T145/Llama-3.1-8B-Instruct-Zeus
|
48 |
name: Open LLM Leaderboard
|
49 |
- task:
|
50 |
type: text-generation
|
|
|
59 |
value: 19.18
|
60 |
name: exact match
|
61 |
source:
|
62 |
+
url: >-
|
63 |
+
https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=T145/Llama-3.1-8B-Instruct-Zeus
|
64 |
name: Open LLM Leaderboard
|
65 |
- task:
|
66 |
type: text-generation
|
|
|
75 |
value: 6.82
|
76 |
name: acc_norm
|
77 |
source:
|
78 |
+
url: >-
|
79 |
+
https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=T145/Llama-3.1-8B-Instruct-Zeus
|
80 |
name: Open LLM Leaderboard
|
81 |
- task:
|
82 |
type: text-generation
|
|
|
91 |
value: 8.57
|
92 |
name: acc_norm
|
93 |
source:
|
94 |
+
url: >-
|
95 |
+
https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=T145/Llama-3.1-8B-Instruct-Zeus
|
96 |
name: Open LLM Leaderboard
|
97 |
- task:
|
98 |
type: text-generation
|
|
|
109 |
value: 32.14
|
110 |
name: accuracy
|
111 |
source:
|
112 |
+
url: >-
|
113 |
+
https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=T145/Llama-3.1-8B-Instruct-Zeus
|
114 |
name: Open LLM Leaderboard
|
115 |
+
license: apache-2.0
|
116 |
+
pipeline_tag: text-generation
|
117 |
---
|
118 |
# ZEUS
|
119 |
|
120 |
+
Taking inspiration from [Dampfinchen/Llama-3.1-8B-Ultra-Instruct](https://huggingface.co/Dampfinchen/Llama-3.1-8B-Ultra-Instruct) and
|
121 |
+
[brucethemoose](https://huggingface.co/brucethemoose/CaPlatTessDolXaBoros-Yi-34B-200K-DARE-Ties-HighDensity),
|
122 |
+
the goal of this merge is to create an abliterated, conversational AI within 8B parameters that's coherent over long conversations.
|
123 |
+
Using "Ultra-Instruct" as a baseline (which has problems with grammar and coherent conversations), preliminary results seem to show these goals are met.
|
124 |
+
Expect responses in the Markdown format by default.
|
125 |
|
126 |
## Merge Details
|
127 |
|