| Tasks |Version|Filter|n-shot| Metric |Value | |Stderr| |-------------|------:|------|-----:|--------|-----:|---|-----:| |openbookqa | 1|none | 0|acc |0.3080|± |0.0207| | | |none | 0|acc_norm|0.4080|± |0.0220| |arc_challenge| 1|none | 0|acc |0.4761|± |0.0146| | | |none | 0|acc_norm|0.4983|± |0.0146| |arc_easy | 1|none | 0|acc |0.7854|± |0.0084| | | |none | 0|acc_norm|0.7761|± |0.0086| |winogrande | 1|none | 0|acc |0.7111|± |0.0127| |hellaswag | 1|none | 0|acc |0.5773|± |0.0049| | | |none | 0|acc_norm|0.7669|± |0.0042| |piqa | 1|none | 0|acc |0.7813|± |0.0096| | | |none | 0|acc_norm|0.7949|± |0.0094| |boolq | 2|none | 0|acc |0.7856|± |0.0072|