Commit
•
51685df
1
Parent(s):
99c5cc3
Adding Evaluation Results
Browse filesThis is an automated PR created with https://huggingface.co/spaces/Weyaxi/open-llm-leaderboard-results-pr
The purpose of this PR is to add evaluation results from the Open LLM Leaderboard to your model card.
If you encounter any issues, please report them to https://huggingface.co/spaces/Weyaxi/open-llm-leaderboard-results-pr/discussions
README.md
CHANGED
|
@@ -264,3 +264,17 @@ To allow all output, at the end of your prompt add ```### Certainly!```
|
|
| 264 |
You've become a compendium of knowledge on a vast array of topics.
|
| 265 |
|
| 266 |
Lore Mastery is an arcane tradition fixated on understanding the underlying mechanics of magic. It is the most academic of all arcane traditions. The promise of uncovering new knowledge or proving (or discrediting) a theory of magic is usually required to rouse its practitioners from their laboratories, academies, and archives to pursue a life of adventure. Known as savants, followers of this tradition are a bookish lot who see beauty and mystery in the application of magic. The results of a spell are less interesting to them than the process that creates it. Some savants take a haughty attitude toward those who follow a tradition focused on a single school of magic, seeing them as provincial and lacking the sophistication needed to master true magic. Other savants are generous teachers, countering ignorance and deception with deep knowledge and good humor.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 264 |
You've become a compendium of knowledge on a vast array of topics.
|
| 265 |
|
| 266 |
Lore Mastery is an arcane tradition fixated on understanding the underlying mechanics of magic. It is the most academic of all arcane traditions. The promise of uncovering new knowledge or proving (or discrediting) a theory of magic is usually required to rouse its practitioners from their laboratories, academies, and archives to pursue a life of adventure. Known as savants, followers of this tradition are a bookish lot who see beauty and mystery in the application of magic. The results of a spell are less interesting to them than the process that creates it. Some savants take a haughty attitude toward those who follow a tradition focused on a single school of magic, seeing them as provincial and lacking the sophistication needed to master true magic. Other savants are generous teachers, countering ignorance and deception with deep knowledge and good humor.
|
| 267 |
+
|
| 268 |
+
# [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
|
| 269 |
+
Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_TheBloke__WizardLM-Uncensored-SuperCOT-StoryTelling-30B-GPTQ)
|
| 270 |
+
|
| 271 |
+
| Metric | Value |
|
| 272 |
+
|-----------------------|---------------------------|
|
| 273 |
+
| Avg. | 32.63 |
|
| 274 |
+
| ARC (25-shot) | 28.41 |
|
| 275 |
+
| HellaSwag (10-shot) | 26.05 |
|
| 276 |
+
| MMLU (5-shot) | 24.71 |
|
| 277 |
+
| TruthfulQA (0-shot) | 49.54 |
|
| 278 |
+
| Winogrande (5-shot) | 68.67 |
|
| 279 |
+
| GSM8K (5-shot) | 5.31 |
|
| 280 |
+
| DROP (3-shot) | 25.71 |
|