model update

README.md

@@ -46,38 +46,38 @@ model-index:
     - name: MoverScore (Question Generation)
       type: moverscore_question_generation
       value: 56.79
-    - name: BLEU4 (Question & Answer Generation)
-      type: bleu4_question_answer_generation
+    - name: BLEU4 (Question & Answer Generation (with Gold Answer))
+      type: bleu4_question_answer_generation_with_gold_answer
       value: 15.44
-    - name: ROUGE-L (Question & Answer Generation)
-      type: rouge_l_question_answer_generation
+    - name: ROUGE-L (Question & Answer Generation (with Gold Answer))
+      type: rouge_l_question_answer_generation_with_gold_answer
       value: 40.08
-    - name: METEOR (Question & Answer Generation)
-      type: meteor_question_answer_generation
+    - name: METEOR (Question & Answer Generation (with Gold Answer))
+      type: meteor_question_answer_generation_with_gold_answer
       value: 34.31
-    - name: BERTScore (Question & Answer Generation)
-      type: bertscore_question_answer_generation
+    - name: BERTScore (Question & Answer Generation (with Gold Answer))
+      type: bertscore_question_answer_generation_with_gold_answer
       value: 86.62
-    - name: MoverScore (Question & Answer Generation)
-      type: moverscore_question_answer_generation
+    - name: MoverScore (Question & Answer Generation (with Gold Answer))
+      type: moverscore_question_answer_generation_with_gold_answer
       value: 60.68
-    - name: QAAlignedF1Score-BERTScore (Question & Answer Generation) [Gold Answer]
-      type: qa_aligned_f1_score_bertscore_question_answer_generation_gold_answer
+    - name: QAAlignedF1Score-BERTScore (Question & Answer Generation (with Gold Answer)) [Gold Answer]
+      type: qa_aligned_f1_score_bertscore_question_answer_generation_with_gold_answer_gold_answer
       value: 87.66
-    - name: QAAlignedRecall-BERTScore (Question & Answer Generation) [Gold Answer]
-      type: qa_aligned_recall_bertscore_question_answer_generation_gold_answer
+    - name: QAAlignedRecall-BERTScore (Question & Answer Generation (with Gold Answer)) [Gold Answer]
+      type: qa_aligned_recall_bertscore_question_answer_generation_with_gold_answer_gold_answer
       value: 87.57
-    - name: QAAlignedPrecision-BERTScore (Question & Answer Generation) [Gold Answer]
-      type: qa_aligned_precision_bertscore_question_answer_generation_gold_answer
+    - name: QAAlignedPrecision-BERTScore (Question & Answer Generation (with Gold Answer)) [Gold Answer]
+      type: qa_aligned_precision_bertscore_question_answer_generation_with_gold_answer_gold_answer
       value: 87.76
-    - name: QAAlignedF1Score-MoverScore (Question & Answer Generation) [Gold Answer]
-      type: qa_aligned_f1_score_moverscore_question_answer_generation_gold_answer
+    - name: QAAlignedF1Score-MoverScore (Question & Answer Generation (with Gold Answer)) [Gold Answer]
+      type: qa_aligned_f1_score_moverscore_question_answer_generation_with_gold_answer_gold_answer
       value: 61.6
-    - name: QAAlignedRecall-MoverScore (Question & Answer Generation) [Gold Answer]
-      type: qa_aligned_recall_moverscore_question_answer_generation_gold_answer
+    - name: QAAlignedRecall-MoverScore (Question & Answer Generation (with Gold Answer)) [Gold Answer]
+      type: qa_aligned_recall_moverscore_question_answer_generation_with_gold_answer_gold_answer
       value: 61.48
-    - name: QAAlignedPrecision-MoverScore (Question & Answer Generation) [Gold Answer]
-      type: qa_aligned_precision_moverscore_question_answer_generation_gold_answer
+    - name: QAAlignedPrecision-MoverScore (Question & Answer Generation (with Gold Answer)) [Gold Answer]
+      type: qa_aligned_precision_moverscore_question_answer_generation_with_gold_answer_gold_answer
       value: 61.73
 ---
 
@@ -132,7 +132,7 @@ output = pipe("<hl> Dopo il 1971 <hl> , l' OPEC ha tardato ad adeguare i prezzi
 | ROUGE_L    |   21.93 | default | [lmqg/qg_itquad](https://huggingface.co/datasets/lmqg/qg_itquad) |
 
 
-- ***Metric (Question & Answer Generation)***: QAG metrics are computed with *the gold answer* and generated question on it for this model, as the model cannot provide an answer. [raw metric file](https://huggingface.co/lmqg/mt5-small-itquad-qg/raw/main/eval/metric.first.answer.paragraph.questions_answers.lmqg_qg_itquad.default.json)
+- ***Metric (Question & Answer Generation, Reference Answer)***: Each question is generated from *the gold answer*. [raw metric file](https://huggingface.co/lmqg/mt5-small-itquad-qg/raw/main/eval/metric.first.answer.paragraph.questions_answers.lmqg_qg_itquad.default.json)
 
 |                                 |   Score | Type    | Dataset                                                          |
 |:--------------------------------|--------:|:--------|:-----------------------------------------------------------------|