File size: 922 Bytes
f43c1aa |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 |
| Tasks |Version|Filter|n-shot| Metric |Value | |Stderr|
|-------------|------:|------|-----:|--------|-----:|---|-----:|
|openbookqa | 1|none | 0|acc |0.2280|± |0.0188|
| | |none | 0|acc_norm|0.3420|± |0.0212|
|arc_challenge| 1|none | 0|acc |0.3746|± |0.0141|
| | |none | 0|acc_norm|0.3865|± |0.0142|
|arc_easy | 1|none | 0|acc |0.7172|± |0.0092|
| | |none | 0|acc_norm|0.6684|± |0.0097|
|winogrande | 1|none | 0|acc |0.5959|± |0.0138|
|hellaswag | 1|none | 0|acc |0.4990|± |0.0050|
| | |none | 0|acc_norm|0.6716|± |0.0047|
|piqa | 1|none | 0|acc |0.7242|± |0.0104|
| | |none | 0|acc_norm|0.7388|± |0.0102|
|boolq | 2|none | 0|acc |0.7064|± |0.0080|
|