interface change: use namedtuple for metric result so that we can add an `accuracy` property and have dot-access e00b8f2 jgauthier commited on Jul 8, 2022
update metric to support new dataset repr, and evaluating multiple suites in one call 5cd2907 jgauthier commited on Jul 8, 2022
disable truncation. longer sequences are handled just fine, AFAICS af46379 jgauthier commited on Jul 7, 2022
add tokenizer config from perplexity metric. truncation breaks tests 4bd2962 jgauthier commited on Jul 7, 2022