carlosep93
commited on
Commit
·
7b11e16
1
Parent(s):
43b643b
Update README.md
Browse files
README.md
CHANGED
@@ -121,7 +121,7 @@ The model was trained using shards of 10 million sentences, for a total of 8.000
|
|
121 |
|
122 |
### Variable and metrics
|
123 |
|
124 |
-
We use the BLEU score for evaluation on test sets: [Flores-101](https://github.com/facebookresearch/flores), [TaCon](https://elrc-share.eu/repository/browse/tacon-spanish-constitution-mt-test-set/84a96138b98611ec9c1a00155d02670628f3e6857b0f422abd82abc3795ec8c2/), [United Nations](https://zenodo.org/record/3888414#.Y33-_tLMIW0), [Cybersecurity](https://elrc-share.eu/repository/browse/cyber-mt-test-set/2bd93faab98c11ec9c1a00155d026706b96a490ed3e140f0a29a80a08c46e91e/), [wmt19 biomedical test set](), [wmt13 news test set](https://elrc-share.eu/repository/browse/catalan-wmt2013-machine-translation-shared-task-test-set/84a96139b98611ec9c1a00155d0267061a0aa1b62e2248e89aab4952f3c230fc/)
|
125 |
|
126 |
### Evaluation results
|
127 |
|
@@ -129,15 +129,14 @@ Below are the evaluation results on the machine translation from Spanish to Cata
|
|
129 |
|
130 |
| Test set | SoftCatalà | Google Translate |mt-plantl-es-ca|
|
131 |
|----------------------|------------|------------------|---------------|
|
132 |
-
| Spanish Constitution |
|
133 |
-
| United Nations |
|
134 |
-
|
|
135 |
-
| Flores 101
|
136 |
-
|
|
137 |
-
|
|
138 |
-
| wmt
|
139 |
-
|
|
140 |
-
| Average | | 51,4 | |
|
141 |
|
142 |
## Additional information
|
143 |
|
|
|
121 |
|
122 |
### Variable and metrics
|
123 |
|
124 |
+
We use the BLEU score for evaluation on test sets: [Flores-101](https://github.com/facebookresearch/flores), [TaCon](https://elrc-share.eu/repository/browse/tacon-spanish-constitution-mt-test-set/84a96138b98611ec9c1a00155d02670628f3e6857b0f422abd82abc3795ec8c2/), [United Nations](https://zenodo.org/record/3888414#.Y33-_tLMIW0), [Cybersecurity](https://elrc-share.eu/repository/browse/cyber-mt-test-set/2bd93faab98c11ec9c1a00155d026706b96a490ed3e140f0a29a80a08c46e91e/), [wmt19 biomedical test set](), [wmt13 news test set](https://elrc-share.eu/repository/browse/catalan-wmt2013-machine-translation-shared-task-test-set/84a96139b98611ec9c1a00155d0267061a0aa1b62e2248e89aab4952f3c230fc/)
|
125 |
|
126 |
### Evaluation results
|
127 |
|
|
|
129 |
|
130 |
| Test set | SoftCatalà | Google Translate |mt-plantl-es-ca|
|
131 |
|----------------------|------------|------------------|---------------|
|
132 |
+
| Spanish Constitution | **63,6** | 61,7 | 63,0 |
|
133 |
+
| United Nations | 73,8 | 74,8 | **74,9** |
|
134 |
+
| Flores 101 dev | 22 | **23,1** | 22,5 |
|
135 |
+
| Flores 101 devtest | 22,7 | **23,6** | 23,1 |
|
136 |
+
| Cybersecurity | 61,4 | **69,5** | 67,3 |
|
137 |
+
| wmt 19 biomedical | 60,2 | 59,7 | **60,6** |
|
138 |
+
| wmt 13 news | 21,3 | **22,4** | 22,0 |
|
139 |
+
| Average | 46,4 | **47,8** | 47,6 |
|
|
|
140 |
|
141 |
## Additional information
|
142 |
|