| library_name: transformers | |
| license: apache-2.0 | |
| datasets: | |
| - lmqg/qag_itquad | |
| language: | |
| - it | |
| | Tasks | Metric |Value | |Stderr| | |
| |------------|--------|-----:|---|-----:| | |
| |hellaswag_it|acc |0.4439|± |0.0052| | |
| | |acc_norm|0.5962|± |0.0051| | |
| |arc_it |acc |0.1257|± |0.0097| | |
| | |acc_norm|0.4414|± |0.0145| | |