AlekseiPravdin
commited on
Commit
•
27ac2cd
1
Parent(s):
98000bc
Upload folder using huggingface_hub
Browse files
README.md
CHANGED
@@ -82,12 +82,12 @@ This fusion model combines the robust generative capabilities of Nitral-AI/Kukul
|
|
82 |
|
83 |
### Nitral-AI/KukulStanta-7B
|
84 |
|
85 |
-
- **AI2 Reasoning Challenge (25-Shot):** 68.43
|
86 |
-
- **HellaSwag (10-Shot):** 86.37
|
87 |
-
- **MMLU (5-Shot):** 65.00
|
88 |
-
- **TruthfulQA (0-shot):** 62.19
|
89 |
-
- **Winogrande (5-shot):** 80.03
|
90 |
-
- **GSM8k (5-shot):** 63.68
|
91 |
|
92 |
## Limitations
|
93 |
|
|
|
82 |
|
83 |
### Nitral-AI/KukulStanta-7B
|
84 |
|
85 |
+
- **AI2 Reasoning Challenge (25-Shot):** 68.43 (normalized accuracy)
|
86 |
+
- **HellaSwag (10-Shot):** 86.37 (normalized accuracy)
|
87 |
+
- **MMLU (5-Shot):** 65.00 (accuracy)
|
88 |
+
- **TruthfulQA (0-shot):** 62.19
|
89 |
+
- **Winogrande (5-shot):** 80.03 (accuracy)
|
90 |
+
- **GSM8k (5-shot):** 63.68 (accuracy)
|
91 |
|
92 |
## Limitations
|
93 |
|