T145 commited on
Commit
471c8ba
·
verified ·
1 Parent(s): ca27044

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +19 -10
README.md CHANGED
@@ -27,7 +27,8 @@ model-index:
27
  value: 79.41
28
  name: strict accuracy
29
  source:
30
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=T145/Llama-3.1-8B-Instruct-Zeus
 
31
  name: Open LLM Leaderboard
32
  - task:
33
  type: text-generation
@@ -42,7 +43,8 @@ model-index:
42
  value: 31.39
43
  name: normalized accuracy
44
  source:
45
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=T145/Llama-3.1-8B-Instruct-Zeus
 
46
  name: Open LLM Leaderboard
47
  - task:
48
  type: text-generation
@@ -57,7 +59,8 @@ model-index:
57
  value: 19.18
58
  name: exact match
59
  source:
60
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=T145/Llama-3.1-8B-Instruct-Zeus
 
61
  name: Open LLM Leaderboard
62
  - task:
63
  type: text-generation
@@ -72,7 +75,8 @@ model-index:
72
  value: 6.82
73
  name: acc_norm
74
  source:
75
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=T145/Llama-3.1-8B-Instruct-Zeus
 
76
  name: Open LLM Leaderboard
77
  - task:
78
  type: text-generation
@@ -87,7 +91,8 @@ model-index:
87
  value: 8.57
88
  name: acc_norm
89
  source:
90
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=T145/Llama-3.1-8B-Instruct-Zeus
 
91
  name: Open LLM Leaderboard
92
  - task:
93
  type: text-generation
@@ -104,15 +109,19 @@ model-index:
104
  value: 32.14
105
  name: accuracy
106
  source:
107
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=T145/Llama-3.1-8B-Instruct-Zeus
 
108
  name: Open LLM Leaderboard
 
 
109
  ---
110
  # ZEUS
111
 
112
- Inspired by [Dampfinchen/Llama-3.1-8B-Ultra-Instruct](https://huggingface.co/Dampfinchen/Llama-3.1-8B-Ultra-Instruct),
113
- the goal of this merge was to create an abliterated, conversational AI restricted to 8B parameters that's coherent over long conversations.
114
- After testing "Ultra-Instruct" with various parameters, its grammar in responses would degrade over time.
115
- While more extensive testing still needs to be done, prelimary results seem to show these problems are fixed.
 
116
 
117
  ## Merge Details
118
 
 
27
  value: 79.41
28
  name: strict accuracy
29
  source:
30
+ url: >-
31
+ https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=T145/Llama-3.1-8B-Instruct-Zeus
32
  name: Open LLM Leaderboard
33
  - task:
34
  type: text-generation
 
43
  value: 31.39
44
  name: normalized accuracy
45
  source:
46
+ url: >-
47
+ https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=T145/Llama-3.1-8B-Instruct-Zeus
48
  name: Open LLM Leaderboard
49
  - task:
50
  type: text-generation
 
59
  value: 19.18
60
  name: exact match
61
  source:
62
+ url: >-
63
+ https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=T145/Llama-3.1-8B-Instruct-Zeus
64
  name: Open LLM Leaderboard
65
  - task:
66
  type: text-generation
 
75
  value: 6.82
76
  name: acc_norm
77
  source:
78
+ url: >-
79
+ https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=T145/Llama-3.1-8B-Instruct-Zeus
80
  name: Open LLM Leaderboard
81
  - task:
82
  type: text-generation
 
91
  value: 8.57
92
  name: acc_norm
93
  source:
94
+ url: >-
95
+ https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=T145/Llama-3.1-8B-Instruct-Zeus
96
  name: Open LLM Leaderboard
97
  - task:
98
  type: text-generation
 
109
  value: 32.14
110
  name: accuracy
111
  source:
112
+ url: >-
113
+ https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=T145/Llama-3.1-8B-Instruct-Zeus
114
  name: Open LLM Leaderboard
115
+ license: apache-2.0
116
+ pipeline_tag: text-generation
117
  ---
118
  # ZEUS
119
 
120
+ Taking inspiration from [Dampfinchen/Llama-3.1-8B-Ultra-Instruct](https://huggingface.co/Dampfinchen/Llama-3.1-8B-Ultra-Instruct) and
121
+ [brucethemoose](https://huggingface.co/brucethemoose/CaPlatTessDolXaBoros-Yi-34B-200K-DARE-Ties-HighDensity),
122
+ the goal of this merge is to create an abliterated, conversational AI within 8B parameters that's coherent over long conversations.
123
+ Using "Ultra-Instruct" as a baseline (which has problems with grammar and coherent conversations), preliminary results seem to show these goals are met.
124
+ Expect responses in the Markdown format by default.
125
 
126
  ## Merge Details
127