File size: 922 Bytes
f43c1aa |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 |
| Tasks |Version|Filter|n-shot| Metric |Value | |Stderr|
|-------------|------:|------|-----:|--------|-----:|---|-----:|
|openbookqa | 1|none | 0|acc |0.3240|± |0.0210|
| | |none | 0|acc_norm|0.4400|± |0.0222|
|arc_challenge| 1|none | 0|acc |0.4582|± |0.0146|
| | |none | 0|acc_norm|0.4940|± |0.0146|
|arc_easy | 1|none | 0|acc |0.7811|± |0.0085|
| | |none | 0|acc_norm|0.7740|± |0.0086|
|winogrande | 1|none | 0|acc |0.7245|± |0.0126|
|hellaswag | 1|none | 0|acc |0.5950|± |0.0049|
| | |none | 0|acc_norm|0.7812|± |0.0041|
|piqa | 1|none | 0|acc |0.7802|± |0.0097|
| | |none | 0|acc_norm|0.7927|± |0.0095|
|boolq | 2|none | 0|acc |0.8058|± |0.0069|
|