File size: 922 Bytes
f43c1aa |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 |
| Tasks |Version|Filter|n-shot| Metric |Value | |Stderr|
|-------------|------:|------|-----:|--------|-----:|---|-----:|
|openbookqa | 1|none | 0|acc |0.3200|± |0.0209|
| | |none | 0|acc_norm|0.4320|± |0.0222|
|arc_challenge| 1|none | 0|acc |0.4701|± |0.0146|
| | |none | 0|acc_norm|0.4957|± |0.0146|
|arc_easy | 1|none | 0|acc |0.7837|± |0.0084|
| | |none | 0|acc_norm|0.7757|± |0.0086|
|winogrande | 1|none | 0|acc |0.7111|± |0.0127|
|hellaswag | 1|none | 0|acc |0.5935|± |0.0049|
| | |none | 0|acc_norm|0.7798|± |0.0041|
|piqa | 1|none | 0|acc |0.7824|± |0.0096|
| | |none | 0|acc_norm|0.7884|± |0.0095|
|boolq | 2|none | 0|acc |0.8034|± |0.0070|
|