mobiuslabsgmbh
/

Mixtral-8x7B-Instruct-v0.1-hf-attn-4bit-moe-2bit-metaoffload-HQQ

Text Generation

Mixture of Experts

Model card Files Files and versions Community

mobicham commited on Feb 26, 2024

Commit

c4deccd

•

1 Parent(s): d8057bb

Update README.md

Files changed (1) hide show

README.md +7 -2

README.md CHANGED Viewed

@@ -25,8 +25,13 @@ The difference between this model and https://huggingface.co/mobiuslabsgmbh/Mixt
 |-------------------|------------------|------------------|
 | Runtime VRAM      | 90 GB            | <b>13 GB</b>     |
 | ARC (25-shot)     | 70.22            | 66.47            |
-| TruthfulQA-MC2    | 64.57            | 62.85            |
-| Winogrande (5-shot)| 81.36           | 79.40            |
 ## Screencast

 |-------------------|------------------|------------------|
 | Runtime VRAM      | 90 GB            | <b>13 GB</b>     |
 | ARC (25-shot)     | 70.22            | 66.47            |
+| Hellaswag (10-shot)|     87.63       |   84.78         |
+| MMLU (5-shot)      |      71.16      |  67.35          |
+| TruthfulQA-MC2    | 64.58            | 62.85            |
+| Winogrande (5-shot)| 81.37           | 79.40            |
+| GSM8K (5-shot)|      60.73      |        45.86    |
+| Average|   72.62         |  67.79         |
 ## Screencast