mt5-base-itquad-qg-ae / eval /metric.first.answer.paragraph.questions_answers.lmqg_qg_itquad.default.json
asahi417's picture
model update
2a45a27
raw
history blame
658 Bytes
{"test": {"QAAlignedF1Score (BERTScore)": 0.8197821918119429, "QAAlignedRecall (BERTScore)": 0.8283015506704319, "QAAlignedPrecision (BERTScore)": 0.8119330094011925, "QAAlignedF1Score (MoverScore)": 0.5634931819025477, "QAAlignedRecall (MoverScore)": 0.5675011475834276, "QAAlignedPrecision (MoverScore)": 0.5599723189991794}, "validation": {"QAAlignedF1Score (BERTScore)": 0.8080914056798597, "QAAlignedRecall (BERTScore)": 0.835892198567779, "QAAlignedPrecision (BERTScore)": 0.782811450155633, "QAAlignedF1Score (MoverScore)": 0.5546692619043326, "QAAlignedRecall (MoverScore)": 0.5736236114784989, "QAAlignedPrecision (MoverScore)": 0.5379608477857356}}