model update
Browse files
README.md
CHANGED
@@ -51,6 +51,12 @@ model-index:
|
|
51 |
- name: MoverScore
|
52 |
type: moverscore
|
53 |
value: 0.583354319136371
|
|
|
|
|
|
|
|
|
|
|
|
|
54 |
---
|
55 |
|
56 |
# Model Card of `lmqg/mt5-small-esquad-multitask`
|
@@ -119,6 +125,13 @@ question = pipe('generate question: del <hl> Ministerio de Desarrollo Urbano <hl
|
|
119 |
| [lmqg/qg_esquad](https://huggingface.co/datasets/lmqg/qg_esquad) | default | 0.088 | 0.231 | 0.217 | 0.834 | 0.583 | [link](https://huggingface.co/lmqg/mt5-small-esquad-multitask/raw/main/eval/metric.first.sentence.paragraph_answer.question.lmqg_qg_esquad.default.json) |
|
120 |
|
121 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
122 |
|
123 |
|
124 |
## Training hyperparameters
|
|
|
51 |
- name: MoverScore
|
52 |
type: moverscore
|
53 |
value: 0.583354319136371
|
54 |
+
- name: QAAlignedF1Score (BERTScore)
|
55 |
+
type: qa_aligned_f1_score_bertscore
|
56 |
+
value: 0.7976244828929961
|
57 |
+
- name: QAAlignedF1Score (MoverScore)
|
58 |
+
type: qa_aligned_f1_score_moverscore
|
59 |
+
value: 0.5475287486181891
|
60 |
---
|
61 |
|
62 |
# Model Card of `lmqg/mt5-small-esquad-multitask`
|
|
|
125 |
| [lmqg/qg_esquad](https://huggingface.co/datasets/lmqg/qg_esquad) | default | 0.088 | 0.231 | 0.217 | 0.834 | 0.583 | [link](https://huggingface.co/lmqg/mt5-small-esquad-multitask/raw/main/eval/metric.first.sentence.paragraph_answer.question.lmqg_qg_esquad.default.json) |
|
126 |
|
127 |
|
128 |
+
### Metrics (QAG)
|
129 |
+
|
130 |
+
| Dataset | Type | QA Aligned F1 Score (BERTScore) | QA Aligned F1 Score (MoverScore) | Link |
|
131 |
+
|:--------|:-----|--------------------------------:|---------------------------------:|-----:|
|
132 |
+
| [lmqg/qg_esquad](https://huggingface.co/datasets/lmqg/qg_esquad) | default | 0.798 | 0.548 | [link](https://huggingface.co/lmqg/mt5-small-esquad-multitask/raw/main/eval/metric.first.answer.paragraph.questions_answers.lmqg_qg_esquad.default.json) |
|
133 |
+
|
134 |
+
|
135 |
|
136 |
|
137 |
## Training hyperparameters
|