File size: 922 Bytes
53a2780 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 |
| Tasks |Version|Filter|n-shot| Metric |Value | |Stderr|
|-------------|------:|------|-----:|--------|-----:|---|-----:|
|openbookqa | 1|none | 0|acc |0.3140|± |0.0208|
| | |none | 0|acc_norm|0.4220|± |0.0221|
|arc_challenge| 1|none | 0|acc |0.4898|± |0.0146|
| | |none | 0|acc_norm|0.5196|± |0.0146|
|arc_easy | 1|none | 0|acc |0.7988|± |0.0082|
| | |none | 0|acc_norm|0.7803|± |0.0085|
|winogrande | 1|none | 0|acc |0.7269|± |0.0125|
|hellaswag | 1|none | 0|acc |0.5818|± |0.0049|
| | |none | 0|acc_norm|0.7718|± |0.0042|
|piqa | 1|none | 0|acc |0.7856|± |0.0096|
| | |none | 0|acc_norm|0.7992|± |0.0093|
|boolq | 2|none | 0|acc |0.7936|± |0.0071|
|