Hugging Face's logo

Helsinki-NLP
/
opus-mt-tc-bible-big-ine-deu_eng_fra_por_spa

Translation
Transformers
PyTorch
Safetensors
marian
text2text-generation
opus-mt-tc-bible
Eval Results
Inference Endpoints
Model card Files Community
Edit model card

opus-mt-tc-bible-big-ine-deu_eng_fra_por_spa

Table of Contents

Model Details

Neural machine translation model for translating from Indo-European languages (ine) to unknown (deu+eng+fra+por+spa).

This model is part of the OPUS-MT project, an effort to make neural machine translation models widely available and accessible for many languages in the world. All models are originally trained using the amazing framework of Marian NMT, an efficient NMT implementation written in pure C++. The models have been converted to pyTorch using the transformers library by huggingface. Training data is taken from OPUS and training pipelines use the procedures of OPUS-MT-train. Model Description:

This is a multilingual translation model with multiple target languages. A sentence initial language token is required in the form of >>id<< (id = valid target language ID), e.g. >>deu<<

Uses

This model can be used for translation and text-to-text generation.

Risks, Limitations and Biases

CONTENT WARNING: Readers should be aware that the model is trained on various public data sets that may contain content that is disturbing, offensive, and can propagate historical and current stereotypes.

Significant research has explored bias and fairness issues with language models (see, e.g., Sheng et al. (2021) and Bender et al. (2021)).

How to Get Started With the Model

A short example code:

from transformers import MarianMTModel, MarianTokenizer

src_text = [
    ">>deu<< Replace this with text in an accepted source language.",
    ">>spa<< This is the second sentence."
]

model_name = "pytorch-models/opus-mt-tc-bible-big-ine-deu_eng_fra_por_spa"
tokenizer = MarianTokenizer.from_pretrained(model_name)
model = MarianMTModel.from_pretrained(model_name)
translated = model.generate(**tokenizer(src_text, return_tensors="pt", padding=True))

for t in translated:
    print( tokenizer.decode(t, skip_special_tokens=True) )

You can also use OPUS-MT models with the transformers pipelines, for example:

from transformers import pipeline
pipe = pipeline("translation", model="Helsinki-NLP/opus-mt-tc-bible-big-ine-deu_eng_fra_por_spa")
print(pipe(">>deu<< Replace this with text in an accepted source language."))

Training

Evaluation

langpair testset chr-F BLEU #sent #words
afr-deu tatoeba-test-v2021-08-07 0.68516 48.8 1583 9105
afr-eng tatoeba-test-v2021-08-07 0.73535 60.8 1374 9622
afr-spa tatoeba-test-v2021-08-07 0.72814 57.6 448 2783
awa-eng tatoeba-test-v2021-08-07 0.62154 42.4 279 1335
bel-deu tatoeba-test-v2021-08-07 0.65145 44.1 551 4182
bel-eng tatoeba-test-v2021-08-07 0.62648 44.8 2500 18571
bel-fra tatoeba-test-v2021-08-07 0.66291 47.4 283 2005
bel-spa tatoeba-test-v2021-08-07 0.66644 46.5 205 1412
ben-eng tatoeba-test-v2021-08-07 0.62742 46.1 2500 13978
bos_Latn-eng tatoeba-test-v2021-08-07 0.76603 62.5 301 1826
bre-eng tatoeba-test-v2021-08-07 0.47135 26.2 383 2065
bul-deu tatoeba-test-v2021-08-07 0.68593 49.1 314 2224
bul-eng tatoeba-test-v2021-08-07 0.69980 55.5 10000 71872
bul-fra tatoeba-test-v2021-08-07 0.69233 52.4 446 3669
bul-spa tatoeba-test-v2021-08-07 0.66731 49.2 286 1783
cat-deu tatoeba-test-v2021-08-07 0.65296 45.7 723 5676
cat-eng tatoeba-test-v2021-08-07 0.70714 55.6 1631 12627
cat-fra tatoeba-test-v2021-08-07 0.71112 53.7 700 5664
cat-por tatoeba-test-v2021-08-07 0.74022 56.3 747 6119
cat-spa tatoeba-test-v2021-08-07 0.85238 74.0 1534 12094
ces-deu tatoeba-test-v2021-08-07 0.68073 50.1 3490 27155
ces-eng tatoeba-test-v2021-08-07 0.68902 53.6 13824 105010
ces-fra tatoeba-test-v2021-08-07 0.70071 53.5 438 3346
ces-spa tatoeba-test-v2021-08-07 0.69957 52.5 1807 12716
cym-eng tatoeba-test-v2021-08-07 0.65153 47.5 818 5563
dan-deu tatoeba-test-v2021-08-07 0.72320 53.7 9998 76055
dan-eng tatoeba-test-v2021-08-07 0.75679 62.3 10795 79684
dan-fra tatoeba-test-v2021-08-07 0.76077 61.8 1731 11882
dan-por tatoeba-test-v2021-08-07 0.76460 58.8 873 5360
dan-spa tatoeba-test-v2021-08-07 0.71685 53.8 5000 35528
deu-deu tatoeba-test-v2021-08-07 0.60029 37.6 2500 20806
deu-eng tatoeba-test-v2021-08-07 0.65647 48.4 17565 149462
deu-fra tatoeba-test-v2021-08-07 0.66811 48.7 12418 102721
deu-por tatoeba-test-v2021-08-07 0.62766 42.2 10000 81482
deu-spa tatoeba-test-v2021-08-07 0.67276 48.2 10521 82570
dsb-deu tatoeba-test-v2021-08-07 0.55993 34.5 640 4469
ell-deu tatoeba-test-v2021-08-07 0.68199 51.9 2500 17025
ell-eng tatoeba-test-v2021-08-07 0.76316 63.6 10899 68682
ell-fra tatoeba-test-v2021-08-07 0.74291 59.1 1506 9726
ell-por tatoeba-test-v2021-08-07 0.69593 50.0 885 5196
ell-spa tatoeba-test-v2021-08-07 0.64482 47.9 1829 10828
eng-deu tatoeba-test-v2021-08-07 0.61606 39.7 17565 151568
eng-eng tatoeba-test-v2021-08-07 0.82285 65.4 12062 115106
eng-fra tatoeba-test-v2021-08-07 0.67435 49.4 12681 106378
eng-por tatoeba-test-v2021-08-07 0.70975 51.9 13222 105265
eng-spa tatoeba-test-v2021-08-07 0.71497 53.9 16583 134710
fao-eng tatoeba-test-v2021-08-07 0.55253 40.1 294 1984
fas-deu tatoeba-test-v2021-08-07 0.57907 34.2 3185 25590
fas-eng tatoeba-test-v2021-08-07 0.58280 39.2 3762 31480
fas-fra tatoeba-test-v2021-08-07 0.57554 35.7 376 3377
fra-deu tatoeba-test-v2021-08-07 0.67258 47.6 12418 100545
fra-eng tatoeba-test-v2021-08-07 0.71355 56.3 12681 101754
fra-fra tatoeba-test-v2021-08-07 0.63538 43.9 1000 7757
fra-por tatoeba-test-v2021-08-07 0.69703 50.7 10518 77650
fra-spa tatoeba-test-v2021-08-07 0.71014 53.3 10294 78406
fry-eng tatoeba-test-v2021-08-07 0.55802 37.9 220 1573
gla-eng tatoeba-test-v2021-08-07 0.44054 27.0 955 6611
gla-spa tatoeba-test-v2021-08-07 0.44549 23.0 289 1608
gle-eng tatoeba-test-v2021-08-07 0.63566 48.1 1913 11190
glg-eng tatoeba-test-v2021-08-07 0.69249 54.1 1015 8421
glg-por tatoeba-test-v2021-08-07 0.76777 61.5 433 3105
glg-spa tatoeba-test-v2021-08-07 0.80359 68.8 2121 17443
gos-deu tatoeba-test-v2021-08-07 0.44004 17.2 207 1168
gos-eng tatoeba-test-v2021-08-07 0.37952 20.8 1154 5635
gsw-eng tatoeba-test-v2021-08-07 0.48360 32.5 205 990
hbs-deu tatoeba-test-v2021-08-07 0.68769 50.7 1959 15559
hbs-eng tatoeba-test-v2021-08-07 0.68956 54.9 10017 68934
hbs-fra tatoeba-test-v2021-08-07 0.66551 47.0 474 3370
hbs-spa tatoeba-test-v2021-08-07 0.70241 53.4 607 3766
hin-eng tatoeba-test-v2021-08-07 0.64048 47.1 5000 33943
hrv-deu tatoeba-test-v2021-08-07 0.66676 48.9 782 5734
hrv-eng tatoeba-test-v2021-08-07 0.71884 56.8 1480 10620
hrv-fra tatoeba-test-v2021-08-07 0.62438 42.3 258 1943
hrv-spa tatoeba-test-v2021-08-07 0.68433 52.9 254 1702
hsb-deu tatoeba-test-v2021-08-07 0.61176 40.9 666 4818
hye-eng tatoeba-test-v2021-08-07 0.50806 29.0 1121 5066
isl-deu tatoeba-test-v2021-08-07 0.66238 47.4 969 6279
isl-eng tatoeba-test-v2021-08-07 0.64466 48.1 2503 19788
isl-spa tatoeba-test-v2021-08-07 0.61980 42.5 238 1229
ita-deu tatoeba-test-v2021-08-07 0.67198 47.8 10094 79762
ita-eng tatoeba-test-v2021-08-07 0.79538 68.3 17320 119214
ita-fra tatoeba-test-v2021-08-07 0.76540 62.7 10091 66377
ita-por tatoeba-test-v2021-08-07 0.73006 54.1 3066 25668
ita-spa tatoeba-test-v2021-08-07 0.76476 61.0 5000 34937
kur_Latn-deu tatoeba-test-v2021-08-07 0.38732 23.8 223 1323
kur_Latn-eng tatoeba-test-v2021-08-07 0.39058 22.8 290 1708
lad-deu tatoeba-test-v2021-08-07 0.40264 10.1 220 1175
lad-eng tatoeba-test-v2021-08-07 0.47244 26.5 768 4184
lad-spa tatoeba-test-v2021-08-07 0.51096 26.7 276 1448
lad_Latn-eng tatoeba-test-v2021-08-07 0.53303 37.2 672 3665
lad_Latn-spa tatoeba-test-v2021-08-07 0.59686 42.3 239 1239
lat-deu tatoeba-test-v2021-08-07 0.42426 25.2 2016 13326
lat-eng tatoeba-test-v2021-08-07 0.41822 23.5 10298 100152
lat-spa tatoeba-test-v2021-08-07 0.44259 23.3 3129 34036
lav-eng tatoeba-test-v2021-08-07 0.70077 55.0 1631 11213
lit-deu tatoeba-test-v2021-08-07 0.65720 46.5 1115 8531
lit-eng tatoeba-test-v2021-08-07 0.71630 57.3 2528 17855
lit-spa tatoeba-test-v2021-08-07 0.67909 50.9 454 2751
ltz-deu tatoeba-test-v2021-08-07 0.63420 47.0 347 2208
ltz-eng tatoeba-test-v2021-08-07 0.64228 53.6 293 1840
mar-eng tatoeba-test-v2021-08-07 0.64526 47.0 10396 67527
mkd-eng tatoeba-test-v2021-08-07 0.66313 52.4 10010 65667
mkd-spa tatoeba-test-v2021-08-07 0.71066 55.7 217 1121
nds-deu tatoeba-test-v2021-08-07 0.66221 47.6 9999 74564
nds-eng tatoeba-test-v2021-08-07 0.61480 44.4 2500 17589
nds-fra tatoeba-test-v2021-08-07 0.61459 45.9 857 5676
nds-por tatoeba-test-v2021-08-07 0.60646 41.8 207 1256
nds-spa tatoeba-test-v2021-08-07 0.63982 44.6 923 5540
nld-deu tatoeba-test-v2021-08-07 0.72111 54.8 10218 74131
nld-eng tatoeba-test-v2021-08-07 0.73199 59.3 12696 89978
nld-fra tatoeba-test-v2021-08-07 0.67269 46.7 11548 82974
nld-por tatoeba-test-v2021-08-07 0.68204 48.9 2500 17326
nld-spa tatoeba-test-v2021-08-07 0.69314 51.0 10113 74981
nno-eng tatoeba-test-v2021-08-07 0.69230 55.8 460 3524
nob-deu tatoeba-test-v2021-08-07 0.68483 48.8 3525 33592
nob-eng tatoeba-test-v2021-08-07 0.71685 57.4 4539 36823
nob-fra tatoeba-test-v2021-08-07 0.70312 52.6 323 2269
nob-spa tatoeba-test-v2021-08-07 0.73880 56.2 885 6866
nor-deu tatoeba-test-v2021-08-07 0.68518 48.9 3651 34575
nor-eng tatoeba-test-v2021-08-07 0.71465 57.3 5000 40355
nor-fra tatoeba-test-v2021-08-07 0.71415 55.2 477 3213
nor-por tatoeba-test-v2021-08-07 0.67705 45.8 481 4182
nor-spa tatoeba-test-v2021-08-07 0.73721 56.0 960 7311
oci-eng tatoeba-test-v2021-08-07 0.41564 22.9 841 5299
oci-fra tatoeba-test-v2021-08-07 0.47832 27.0 806 6302
pes-eng tatoeba-test-v2021-08-07 0.58486 39.7 3757 31411
pms-eng tatoeba-test-v2021-08-07 0.39772 20.2 269 2059
pol-deu tatoeba-test-v2021-08-07 0.66592 47.9 5000 37421
pol-eng tatoeba-test-v2021-08-07 0.67680 51.8 10099 75766
pol-fra tatoeba-test-v2021-08-07 0.65788 47.7 3087 24257
pol-por tatoeba-test-v2021-08-07 0.64124 43.1 705 5063
pol-spa tatoeba-test-v2021-08-07 0.65488 46.9 2544 18113
por-deu tatoeba-test-v2021-08-07 0.66941 46.8 10000 81246
por-eng tatoeba-test-v2021-08-07 0.75755 62.4 13222 105351
por-fra tatoeba-test-v2021-08-07 0.74773 58.6 10518 80459
por-por tatoeba-test-v2021-08-07 0.72256 51.8 2500 19220
por-spa tatoeba-test-v2021-08-07 0.78598 63.6 10947 87335
ron-deu tatoeba-test-v2021-08-07 0.67249 49.1 1141 7893
ron-eng tatoeba-test-v2021-08-07 0.71740 57.3 5508 40717
ron-fra tatoeba-test-v2021-08-07 0.69777 53.0 1925 13347
ron-por tatoeba-test-v2021-08-07 0.72413 53.5 681 4593
ron-spa tatoeba-test-v2021-08-07 0.72960 56.3 1959 12679
rus-deu tatoeba-test-v2021-08-07 0.67364 48.2 12800 98842
rus-eng tatoeba-test-v2021-08-07 0.68851 53.7 19425 147872
rus-fra tatoeba-test-v2021-08-07 0.66299 49.1 11490 80579
rus-por tatoeba-test-v2021-08-07 0.64106 43.4 10000 74713
rus-spa tatoeba-test-v2021-08-07 0.67610 49.1 10506 75246
slv-deu tatoeba-test-v2021-08-07 0.72746 55.2 492 3003
slv-eng tatoeba-test-v2021-08-07 0.70580 55.4 2495 16940
slv-fra tatoeba-test-v2021-08-07 0.61642 43.0 448 3792
sqi-eng tatoeba-test-v2021-08-07 0.71252 56.5 1109 8129
srp_Cyrl-eng tatoeba-test-v2021-08-07 0.65934 52.0 1580 10181
swe-deu tatoeba-test-v2021-08-07 0.70356 53.5 3410 23494
swe-eng tatoeba-test-v2021-08-07 0.74751 62.7 10362 68513
swe-fra tatoeba-test-v2021-08-07 0.71714 56.7 1407 9580
swe-por tatoeba-test-v2021-08-07 0.68849 48.7 320 2032
swe-spa tatoeba-test-v2021-08-07 0.70160 53.3 1351 8235
ukr-deu tatoeba-test-v2021-08-07 0.68602 50.8 10319 64646
ukr-eng tatoeba-test-v2021-08-07 0.68162 52.4 13127 88607
ukr-fra tatoeba-test-v2021-08-07 0.66118 48.4 10035 63227
ukr-por tatoeba-test-v2021-08-07 0.65923 46.6 3372 21315
ukr-spa tatoeba-test-v2021-08-07 0.67601 49.7 10115 59284
urd-eng tatoeba-test-v2021-08-07 0.52376 33.0 1663 12029
yid-eng tatoeba-test-v2021-08-07 0.43640 19.1 2483 15452
yid-fra tatoeba-test-v2021-08-07 0.43410 20.2 384 2455
afr-deu flores101-devtest 0.57090 27.9 1012 25094
afr-eng flores101-devtest 0.73127 52.4 1012 24721
afr-fra flores101-devtest 0.60726 34.8 1012 28343
afr-por flores101-devtest 0.60399 34.4 1012 26519
afr-spa flores101-devtest 0.50655 22.1 1012 29199
ast-fra flores101-devtest 0.56575 30.8 1012 28343
ast-por flores101-devtest 0.56438 30.4 1012 26519
ast-spa flores101-devtest 0.49455 21.1 1012 29199
bel-deu flores101-devtest 0.46177 11.8 1012 25094
bel-eng flores101-devtest 0.49344 15.6 1012 24721
bel-fra flores101-devtest 0.49372 16.5 1012 28343
bel-spa flores101-devtest 0.44802 13.8 1012 29199
ben-eng flores101-devtest 0.53648 23.9 1012 24721
ben-por flores101-devtest 0.48236 19.9 1012 26519
bul-por flores101-devtest 0.58471 30.8 1012 26519
cat-deu flores101-devtest 0.56499 27.4 1012 25094
cat-eng flores101-devtest 0.67443 42.3 1012 24721
cat-spa flores101-devtest 0.53140 24.4 1012 29199
ces-por flores101-devtest 0.57503 29.9 1012 26519
ces-spa flores101-devtest 0.49860 21.1 1012 29199
ckb-eng flores101-devtest 0.41310 15.8 1012 24721
cym-fra flores101-devtest 0.54610 28.6 1012 28343
dan-por flores101-devtest 0.60877 34.7 1012 26519
deu-eng flores101-devtest 0.65706 39.8 1012 24721
fas-fra flores101-devtest 0.54336 26.8 1012 28343
fra-eng flores101-devtest 0.66301 41.0 1012 24721
fra-por flores101-devtest 0.61592 35.7 1012 26519
gle-deu flores101-devtest 0.47354 17.0 1012 25094
gle-por flores101-devtest 0.50115 21.7 1012 26519
guj-deu flores101-devtest 0.42069 13.5 1012 25094
hin-deu flores101-devtest 0.49480 19.6 1012 25094
hin-eng flores101-devtest 0.59392 32.6 1012 24721
hrv-por flores101-devtest 0.57004 29.5 1012 26519
hye-deu flores101-devtest 0.47323 17.5 1012 25094
hye-eng flores101-devtest 0.54450 26.3 1012 24721
isl-eng flores101-devtest 0.53875 28.2 1012 24721
ita-deu flores101-devtest 0.54033 22.0 1012 25094
ita-fra flores101-devtest 0.59488 30.6 1012 28343
ita-spa flores101-devtest 0.51946 22.9 1012 29199
kea-spa flores101-devtest 0.46784 18.3 1012 29199
lav-por flores101-devtest 0.54017 24.6 1012 26519
lav-spa flores101-devtest 0.48185 19.3 1012 29199
lit-deu flores101-devtest 0.51261 21.4 1012 25094
lit-por flores101-devtest 0.53223 25.3 1012 26519
ltz-deu flores101-devtest 0.58286 29.2 1012 25094
ltz-por flores101-devtest 0.53241 27.0 1012 26519
mar-deu flores101-devtest 0.44237 14.1 1012 25094
mar-eng flores101-devtest 0.52755 23.8 1012 24721
mar-por flores101-devtest 0.45667 18.1 1012 26519
mkd-fra flores101-devtest 0.59219 32.8 1012 28343
nld-deu flores101-devtest 0.52899 21.5 1012 25094
nld-eng flores101-devtest 0.58230 29.8 1012 24721
nob-spa flores101-devtest 0.50054 21.2 1012 29199
npi-eng flores101-devtest 0.53179 24.8 1012 24721
npi-spa flores101-devtest 0.41165 13.6 1012 29199
pan-deu flores101-devtest 0.42831 13.6 1012 25094
pan-eng flores101-devtest 0.51203 22.2 1012 24721
pan-fra flores101-devtest 0.46357 19.2 1012 28343
pan-por flores101-devtest 0.44885 17.4 1012 26519
pol-deu flores101-devtest 0.50973 20.1 1012 25094
pol-eng flores101-devtest 0.55772 25.9 1012 24721
pol-fra flores101-devtest 0.54590 26.2 1012 28343
pol-spa flores101-devtest 0.47816 18.9 1012 29199
por-eng flores101-devtest 0.69438 45.5 1012 24721
por-fra flores101-devtest 0.63701 38.9 1012 28343
por-spa flores101-devtest 0.53216 25.0 1012 29199
ron-fra flores101-devtest 0.62744 36.2 1012 28343
rus-deu flores101-devtest 0.53823 23.1 1012 25094
rus-eng flores101-devtest 0.59829 31.7 1012 24721
rus-fra flores101-devtest 0.57384 29.8 1012 28343
rus-por flores101-devtest 0.56082 28.0 1012 26519
slk-eng flores101-devtest 0.62376 34.4 1012 24721
slk-por flores101-devtest 0.54486 26.6 1012 26519
slk-spa flores101-devtest 0.48253 20.0 1012 29199
slv-deu flores101-devtest 0.54130 23.8 1012 25094
slv-fra flores101-devtest 0.56838 29.2 1012 28343
slv-por flores101-devtest 0.55554 28.1 1012 26519
spa-deu flores101-devtest 0.51807 19.5 1012 25094
swe-spa flores101-devtest 0.51211 22.8 1012 29199
tgk-fra flores101-devtest 0.47290 19.6 1012 28343
tgk-spa flores101-devtest 0.41393 14.3 1012 29199
ukr-eng flores101-devtest 0.61588 34.3 1012 24721
ukr-fra flores101-devtest 0.58296 31.3 1012 28343
ukr-spa flores101-devtest 0.49535 21.1 1012 29199
urd-deu flores101-devtest 0.44211 15.2 1012 25094
afr-deu flores200-devtest 0.57712 28.7 1012 25094
afr-eng flores200-devtest 0.73690 53.4 1012 24721
afr-fra flores200-devtest 0.61332 35.7 1012 28343
afr-por flores200-devtest 0.60899 35.1 1012 26519
afr-spa flores200-devtest 0.50836 22.1 1012 29199
asm-eng flores200-devtest 0.42432 13.4 1012 24721
ast-deu flores200-devtest 0.52402 23.3 1012 25094
ast-eng flores200-devtest 0.60640 35.1 1012 24721
ast-fra flores200-devtest 0.57060 31.5 1012 28343
ast-por flores200-devtest 0.56982 30.8 1012 26519
ast-spa flores200-devtest 0.49452 21.1 1012 29199
awa-deu flores200-devtest 0.47101 16.3 1012 25094
awa-eng flores200-devtest 0.55042 25.7 1012 24721
awa-fra flores200-devtest 0.50230 22.1 1012 28343
awa-por flores200-devtest 0.49701 21.1 1012 26519
awa-spa flores200-devtest 0.43913 15.7 1012 29199
bel-deu flores200-devtest 0.46906 12.7 1012 25094
bel-eng flores200-devtest 0.49995 16.5 1012 24721
bel-fra flores200-devtest 0.49987 17.1 1012 28343
bel-por flores200-devtest 0.48319 15.7 1012 26519
bel-spa flores200-devtest 0.45393 14.4 1012 29199
ben-deu flores200-devtest 0.46413 16.3 1012 25094
ben-eng flores200-devtest 0.54681 24.5 1012 24721
ben-fra flores200-devtest 0.49843 21.9 1012 28343
ben-por flores200-devtest 0.49129 21.0 1012 26519
ben-spa flores200-devtest 0.43310 14.9 1012 29199
bho-deu flores200-devtest 0.41875 12.4 1012 25094
bho-eng flores200-devtest 0.48319 18.5 1012 24721
bho-fra flores200-devtest 0.44504 16.1 1012 28343
bho-por flores200-devtest 0.43627 15.5 1012 26519
bho-spa flores200-devtest 0.40189 12.6 1012 29199
bul-deu flores200-devtest 0.56591 26.8 1012 25094
bul-eng flores200-devtest 0.64922 37.8 1012 24721
bul-fra flores200-devtest 0.60386 33.3 1012 28343
bul-por flores200-devtest 0.59070 31.6 1012 26519
bul-spa flores200-devtest 0.50968 22.2 1012 29199
cat-deu flores200-devtest 0.57030 27.9 1012 25094
cat-eng flores200-devtest 0.67842 43.0 1012 24721
cat-fra flores200-devtest 0.63034 38.1 1012 28343
cat-por flores200-devtest 0.62567 37.3 1012 26519
cat-spa flores200-devtest 0.53260 24.5 1012 29199
ces-deu flores200-devtest 0.56613 27.1 1012 25094
ces-eng flores200-devtest 0.63574 36.5 1012 24721
ces-fra flores200-devtest 0.59573 32.8 1012 28343
ces-por flores200-devtest 0.58096 30.9 1012 26519
ces-spa flores200-devtest 0.50295 21.6 1012 29199
ckb-eng flores200-devtest 0.43075 16.7 1012 24721
ckb-fra flores200-devtest 0.41038 15.7 1012 28343
cym-deu flores200-devtest 0.51003 22.0 1012 25094
cym-eng flores200-devtest 0.67808 45.7 1012 24721
cym-fra flores200-devtest 0.55779 29.9 1012 28343
cym-por flores200-devtest 0.53930 27.9 1012 26519
cym-spa flores200-devtest 0.47129 19.6 1012 29199
dan-deu flores200-devtest 0.59897 30.7 1012 25094
dan-eng flores200-devtest 0.70142 46.2 1012 24721
dan-fra flores200-devtest 0.62669 37.1 1012 28343
dan-por flores200-devtest 0.61338 35.3 1012 26519
dan-spa flores200-devtest 0.52360 24.2 1012 29199
deu-eng flores200-devtest 0.66096 40.3 1012 24721
deu-fra flores200-devtest 0.61562 35.4 1012 28343
deu-por flores200-devtest 0.59775 33.3 1012 26519
deu-spa flores200-devtest 0.51787 23.3 1012 29199
ell-deu flores200-devtest 0.52003 22.0 1012 25094
ell-eng flores200-devtest 0.59074 31.6 1012 24721
ell-fra flores200-devtest 0.56636 29.9 1012 28343
ell-por flores200-devtest 0.54903 27.2 1012 26519
ell-spa flores200-devtest 0.48701 20.4 1012 29199
eng-deu flores200-devtest 0.63747 36.8 1012 25094
eng-fra flores200-devtest 0.69505 47.2 1012 28343
eng-por flores200-devtest 0.69743 47.3 1012 26519
eng-spa flores200-devtest 0.54954 26.6 1012 29199
fao-deu flores200-devtest 0.42943 16.3 1012 25094
fao-eng flores200-devtest 0.46227 22.9 1012 24721
fao-fra flores200-devtest 0.41404 18.3 1012 28343
fao-por flores200-devtest 0.41850 17.6 1012 26519
fra-deu flores200-devtest 0.57718 28.2 1012 25094
fra-eng flores200-devtest 0.66534 41.4 1012 24721
fra-por flores200-devtest 0.61987 36.2 1012 26519
fra-spa flores200-devtest 0.52646 24.1 1012 29199
fur-deu flores200-devtest 0.50429 20.5 1012 25094
fur-eng flores200-devtest 0.58954 32.0 1012 24721
fur-fra flores200-devtest 0.55699 28.6 1012 28343
fur-por flores200-devtest 0.54977 27.9 1012 26519
fur-spa flores200-devtest 0.47550 19.0 1012 29199
gla-eng flores200-devtest 0.43561 16.2 1012 24721
gla-fra flores200-devtest 0.41770 15.3 1012 28343
gla-por flores200-devtest 0.40473 14.7 1012 26519
gle-deu flores200-devtest 0.48622 18.1 1012 25094
gle-eng flores200-devtest 0.58337 30.7 1012 24721
gle-fra flores200-devtest 0.52798 24.6 1012 28343
gle-por flores200-devtest 0.51712 23.6 1012 26519
gle-spa flores200-devtest 0.45954 18.1 1012 29199
glg-deu flores200-devtest 0.56174 25.8 1012 25094
glg-eng flores200-devtest 0.65391 38.4 1012 24721
glg-fra flores200-devtest 0.61762 35.7 1012 28343
glg-por flores200-devtest 0.60170 32.9 1012 26519
glg-spa flores200-devtest 0.53214 24.3 1012 29199
guj-deu flores200-devtest 0.43101 14.2 1012 25094
guj-eng flores200-devtest 0.55857 26.4 1012 24721
guj-fra flores200-devtest 0.47047 19.8 1012 28343
guj-por flores200-devtest 0.45641 18.5 1012 26519
guj-spa flores200-devtest 0.42457 14.5 1012 29199
hat-deu flores200-devtest 0.49247 19.2 1012 25094
hat-eng flores200-devtest 0.58655 31.7 1012 24721
hat-fra flores200-devtest 0.60736 34.2 1012 28343
hat-por flores200-devtest 0.54733 27.3 1012 26519
hat-spa flores200-devtest 0.46963 17.9 1012 29199
hin-deu flores200-devtest 0.50305 20.3 1012 25094
hin-eng flores200-devtest 0.60811 34.0 1012 24721
hin-fra flores200-devtest 0.53919 25.9 1012 28343
hin-por flores200-devtest 0.53151 25.6 1012 26519
hin-spa flores200-devtest 0.46051 17.4 1012 29199
hne-deu flores200-devtest 0.48386 18.4 1012 25094
hne-eng flores200-devtest 0.59671 32.3 1012 24721
hne-fra flores200-devtest 0.52013 24.5 1012 28343
hne-por flores200-devtest 0.51345 23.8 1012 26519
hne-spa flores200-devtest 0.44481 16.3 1012 29199
hrv-deu flores200-devtest 0.55524 26.0 1012 25094
hrv-eng flores200-devtest 0.61977 34.9 1012 24721
hrv-fra flores200-devtest 0.59318 32.7 1012 28343
hrv-por flores200-devtest 0.57603 30.2 1012 26519
hrv-spa flores200-devtest 0.50242 21.5 1012 29199
hye-deu flores200-devtest 0.48676 19.2 1012 25094
hye-eng flores200-devtest 0.55729 27.0 1012 24721
hye-fra flores200-devtest 0.52152 25.2 1012 28343
hye-por flores200-devtest 0.51026 23.3 1012 26519
hye-spa flores200-devtest 0.45459 17.8 1012 29199
isl-deu flores200-devtest 0.48677 20.5 1012 25094
isl-eng flores200-devtest 0.54804 29.1 1012 24721
isl-fra flores200-devtest 0.51362 25.0 1012 28343
isl-por flores200-devtest 0.50201 23.8 1012 26519
isl-spa flores200-devtest 0.44801 17.5 1012 29199
ita-deu flores200-devtest 0.54589 22.9 1012 25094
ita-eng flores200-devtest 0.60660 30.9 1012 24721
ita-fra flores200-devtest 0.59811 31.0 1012 28343
ita-por flores200-devtest 0.57808 28.4 1012 26519
ita-spa flores200-devtest 0.52244 23.3 1012 29199
kea-deu flores200-devtest 0.48107 19.2 1012 25094
kea-eng flores200-devtest 0.59570 34.5 1012 24721
kea-fra flores200-devtest 0.53683 26.8 1012 28343
kea-por flores200-devtest 0.57642 30.3 1012 26519
kea-spa flores200-devtest 0.47048 18.6 1012 29199
lij-deu flores200-devtest 0.49270 19.4 1012 25094
lij-eng flores200-devtest 0.58369 30.8 1012 24721
lij-fra flores200-devtest 0.55002 28.6 1012 28343
lij-por flores200-devtest 0.54155 26.7 1012 26519
lij-spa flores200-devtest 0.46656 18.7 1012 29199
lim-deu flores200-devtest 0.44183 15.0 1012 25094
lim-eng flores200-devtest 0.46674 20.3 1012 24721
lim-fra flores200-devtest 0.43685 17.8 1012 28343
lim-por flores200-devtest 0.42699 16.3 1012 26519
lit-deu flores200-devtest 0.51669 21.9 1012 25094
lit-eng flores200-devtest 0.57849 30.5 1012 24721
lit-fra flores200-devtest 0.55896 29.0 1012 28343
lit-por flores200-devtest 0.53960 26.3 1012 26519
lit-spa flores200-devtest 0.48120 19.7 1012 29199
lmo-deu flores200-devtest 0.44732 14.2 1012 25094
lmo-eng flores200-devtest 0.51710 23.3 1012 24721
lmo-fra flores200-devtest 0.49129 21.5 1012 28343
lmo-por flores200-devtest 0.49153 21.4 1012 26519
lmo-spa flores200-devtest 0.43363 15.4 1012 29199
ltz-deu flores200-devtest 0.58897 29.8 1012 25094
ltz-eng flores200-devtest 0.62250 36.2 1012 24721
ltz-fra flores200-devtest 0.57460 31.6 1012 28343
ltz-por flores200-devtest 0.53674 27.1 1012 26519
ltz-spa flores200-devtest 0.46048 18.8 1012 29199
mag-deu flores200-devtest 0.49176 18.9 1012 25094
mag-eng flores200-devtest 0.59691 32.2 1012 24721
mag-fra flores200-devtest 0.52068 24.1 1012 28343
mag-por flores200-devtest 0.52006 23.8 1012 26519
mag-spa flores200-devtest 0.44945 16.5 1012 29199
mai-deu flores200-devtest 0.46893 16.5 1012 25094
mai-eng flores200-devtest 0.56282 27.7 1012 24721
mai-fra flores200-devtest 0.50286 22.2 1012 28343
mai-por flores200-devtest 0.49523 21.6 1012 26519
mai-spa flores200-devtest 0.44271 15.9 1012 29199
mar-deu flores200-devtest 0.44712 14.8 1012 25094
mar-eng flores200-devtest 0.54222 25.4 1012 24721
mar-fra flores200-devtest 0.47383 19.6 1012 28343
mar-por flores200-devtest 0.46593 18.7 1012 26519
mar-spa flores200-devtest 0.41912 14.0 1012 29199
mkd-deu flores200-devtest 0.56267 26.8 1012 25094
mkd-eng flores200-devtest 0.64902 38.8 1012 24721
mkd-fra flores200-devtest 0.60051 33.9 1012 28343
mkd-por flores200-devtest 0.59197 32.9 1012 26519
mkd-spa flores200-devtest 0.50972 22.8 1012 29199
nld-deu flores200-devtest 0.53072 21.8 1012 25094
nld-eng flores200-devtest 0.58671 30.5 1012 24721
nld-fra flores200-devtest 0.55677 27.5 1012 28343
nld-por flores200-devtest 0.53989 25.6 1012 26519
nld-spa flores200-devtest 0.48443 19.5 1012 29199
nno-deu flores200-devtest 0.56707 27.3 1012 25094
nno-eng flores200-devtest 0.67683 43.2 1012 24721
nno-fra flores200-devtest 0.59829 34.3 1012 28343
nno-por flores200-devtest 0.58723 32.5 1012 26519
nno-spa flores200-devtest 0.50217 22.0 1012 29199
nob-deu flores200-devtest 0.56197 26.5 1012 25094
nob-eng flores200-devtest 0.66428 41.7 1012 24721
nob-fra flores200-devtest 0.59531 33.1 1012 28343
nob-por flores200-devtest 0.58521 31.7 1012 26519
nob-spa flores200-devtest 0.50418 21.4 1012 29199
npi-deu flores200-devtest 0.44364 14.6 1012 25094
npi-eng flores200-devtest 0.54309 26.1 1012 24721
npi-fra flores200-devtest 0.47458 19.7 1012 28343
npi-por flores200-devtest 0.46702 18.9 1012 26519
npi-spa flores200-devtest 0.41720 13.9 1012 29199
oci-deu flores200-devtest 0.56668 26.9 1012 25094
oci-eng flores200-devtest 0.70282 46.8 1012 24721
oci-fra flores200-devtest 0.64408 39.1 1012 28343
oci-por flores200-devtest 0.62256 35.7 1012 26519
oci-spa flores200-devtest 0.51705 22.3 1012 29199
pan-deu flores200-devtest 0.44428 15.1 1012 25094
pan-eng flores200-devtest 0.52652 23.0 1012 24721
pan-fra flores200-devtest 0.47743 19.9 1012 28343
pan-por flores200-devtest 0.46585 18.8 1012 26519
pan-spa flores200-devtest 0.41798 14.5 1012 29199
pap-deu flores200-devtest 0.53397 23.5 1012 25094
pap-eng flores200-devtest 0.67741 43.1 1012 24721
pap-fra flores200-devtest 0.57787 31.1 1012 28343
pap-por flores200-devtest 0.59003 32.9 1012 26519
pap-spa flores200-devtest 0.49768 21.8 1012 29199
pes-deu flores200-devtest 0.50787 20.9 1012 25094
pes-eng flores200-devtest 0.58693 31.1 1012 24721
pes-fra flores200-devtest 0.55060 27.9 1012 28343
pes-por flores200-devtest 0.54139 26.6 1012 26519
pes-spa flores200-devtest 0.47230 18.6 1012 29199
pol-deu flores200-devtest 0.51514 20.8 1012 25094
pol-eng flores200-devtest 0.56021 26.2 1012 24721
pol-fra flores200-devtest 0.55176 27.0 1012 28343
pol-por flores200-devtest 0.52998 24.3 1012 26519
pol-spa flores200-devtest 0.48344 19.4 1012 29199
por-deu flores200-devtest 0.58002 29.3 1012 25094
por-eng flores200-devtest 0.69694 46.0 1012 24721
por-fra flores200-devtest 0.64146 39.6 1012 28343
por-spa flores200-devtest 0.53508 25.3 1012 29199
prs-deu flores200-devtest 0.49849 20.4 1012 25094
prs-eng flores200-devtest 0.58120 32.0 1012 24721
prs-fra flores200-devtest 0.53939 27.0 1012 28343
prs-por flores200-devtest 0.53479 26.7 1012 26519
prs-spa flores200-devtest 0.46241 18.3 1012 29199
ron-deu flores200-devtest 0.57214 27.4 1012 25094
ron-eng flores200-devtest 0.66701 40.4 1012 24721
ron-fra flores200-devtest 0.63234 37.2 1012 28343
ron-por flores200-devtest 0.61838 35.4 1012 26519
ron-spa flores200-devtest 0.52856 24.3 1012 29199
rus-deu flores200-devtest 0.54446 23.9 1012 25094
rus-eng flores200-devtest 0.60131 32.0 1012 24721
rus-fra flores200-devtest 0.57986 30.4 1012 28343
rus-por flores200-devtest 0.56600 28.7 1012 26519
rus-spa flores200-devtest 0.49871 21.2 1012 29199
scn-deu flores200-devtest 0.46523 17.0 1012 25094
scn-eng flores200-devtest 0.53341 26.1 1012 24721
scn-fra flores200-devtest 0.51481 25.0 1012 28343
scn-por flores200-devtest 0.50343 23.8 1012 26519
scn-spa flores200-devtest 0.44756 17.1 1012 29199
slk-deu flores200-devtest 0.53932 23.6 1012 25094
slk-eng flores200-devtest 0.63137 35.4 1012 24721
slk-fra flores200-devtest 0.56587 29.9 1012 28343
slk-por flores200-devtest 0.54523 27.3 1012 26519
slk-spa flores200-devtest 0.48275 20.1 1012 29199
slv-deu flores200-devtest 0.54583 24.5 1012 25094
slv-eng flores200-devtest 0.59952 32.4 1012 24721
slv-fra flores200-devtest 0.57418 30.3 1012 28343
slv-por flores200-devtest 0.55838 28.4 1012 26519
slv-spa flores200-devtest 0.49438 20.7 1012 29199
spa-deu flores200-devtest 0.52303 20.0 1012 25094
spa-eng flores200-devtest 0.57648 26.7 1012 24721
srd-deu flores200-devtest 0.47651 18.6 1012 25094
srd-eng flores200-devtest 0.56624 30.5 1012 24721
srd-fra flores200-devtest 0.52746 26.8 1012 28343
srd-por flores200-devtest 0.52301 26.4 1012 26519
srd-spa flores200-devtest 0.45213 17.7 1012 29199
srp_Cyrl-deu flores200-devtest 0.57563 27.7 1012 25094
srp_Cyrl-eng flores200-devtest 0.66201 39.9 1012 24721
srp_Cyrl-fra flores200-devtest 0.61570 35.0 1012 28343
srp_Cyrl-por flores200-devtest 0.60561 33.6 1012 26519
srp_Cyrl-spa flores200-devtest 0.51500 22.4 1012 29199
swe-deu flores200-devtest 0.59607 31.6 1012 25094
swe-eng flores200-devtest 0.69032 46.0 1012 24721
swe-fra flores200-devtest 0.62610 37.8 1012 28343
swe-por flores200-devtest 0.60692 35.0 1012 26519
swe-spa flores200-devtest 0.51448 23.0 1012 29199
szl-deu flores200-devtest 0.51005 22.0 1012 25094
szl-eng flores200-devtest 0.57536 30.6 1012 24721
szl-fra flores200-devtest 0.54029 28.2 1012 28343
szl-por flores200-devtest 0.52911 26.5 1012 26519
szl-spa flores200-devtest 0.46280 18.8 1012 29199
tgk-deu flores200-devtest 0.45372 15.8 1012 25094
tgk-eng flores200-devtest 0.51096 22.1 1012 24721
tgk-fra flores200-devtest 0.48620 21.1 1012 28343
tgk-por flores200-devtest 0.46870 19.4 1012 26519
tgk-spa flores200-devtest 0.42689 15.1 1012 29199
tpi-deu flores200-devtest 0.41078 11.1 1012 25094
tpi-eng flores200-devtest 0.48619 20.1 1012 24721
tpi-fra flores200-devtest 0.43850 16.3 1012 28343
tpi-por flores200-devtest 0.43040 15.8 1012 26519
ukr-deu flores200-devtest 0.55290 25.1 1012 25094
ukr-eng flores200-devtest 0.62150 34.9 1012 24721
ukr-fra flores200-devtest 0.59093 32.5 1012 28343
ukr-por flores200-devtest 0.57706 30.7 1012 26519
ukr-spa flores200-devtest 0.50128 21.8 1012 29199
urd-deu flores200-devtest 0.45107 15.6 1012 25094
urd-eng flores200-devtest 0.53130 25.0 1012 24721
urd-fra flores200-devtest 0.48377 20.7 1012 28343
urd-por flores200-devtest 0.45290 18.5 1012 26519
urd-spa flores200-devtest 0.41342 13.8 1012 29199
vec-deu flores200-devtest 0.48212 18.5 1012 25094
vec-eng flores200-devtest 0.56243 29.3 1012 24721
vec-fra flores200-devtest 0.53340 26.4 1012 28343
vec-por flores200-devtest 0.52845 25.7 1012 26519
vec-spa flores200-devtest 0.46136 17.9 1012 29199
ces-eng generaltest2022 0.64599 40.2 1448 30675
deu-eng generaltest2022 0.54993 29.8 1984 37634
deu-fra generaltest2022 0.59361 35.6 1984 38276
eng-deu generaltest2022 0.59885 31.9 2037 38914
fra-deu generaltest2022 0.64266 40.1 2006 37696
rus-eng generaltest2022 0.63746 37.8 2016 38529
ukr-eng generaltest2022 0.60704 35.9 2018 34242
ces-deu multi30k_test_2016_flickr 0.56370 26.9 1000 12106
ces-eng multi30k_test_2016_flickr 0.57217 32.7 1000 12955
ces-fra multi30k_test_2016_flickr 0.57498 30.7 1000 13505
deu-eng multi30k_test_2016_flickr 0.60234 39.1 1000 12955
deu-fra multi30k_test_2016_flickr 0.60951 36.7 1000 13505
eng-deu multi30k_test_2016_flickr 0.62191 32.5 1000 12106
eng-fra multi30k_test_2016_flickr 0.69376 47.9 1000 13505
fra-deu multi30k_test_2016_flickr 0.59597 29.3 1000 12106
fra-eng multi30k_test_2016_flickr 0.64810 45.4 1000 12955
deu-eng multi30k_test_2017_flickr 0.61895 38.9 1000 11374
deu-fra multi30k_test_2017_flickr 0.60570 34.6 1000 12118
eng-deu multi30k_test_2017_flickr 0.61458 32.1 1000 10755
eng-fra multi30k_test_2017_flickr 0.69630 48.1 1000 12118
fra-deu multi30k_test_2017_flickr 0.58207 27.7 1000 10755
fra-eng multi30k_test_2017_flickr 0.67447 48.0 1000 11374
deu-eng multi30k_test_2017_mscoco 0.54299 30.9 461 5231
deu-fra multi30k_test_2017_mscoco 0.57789 32.3 461 5484
eng-deu multi30k_test_2017_mscoco 0.56164 27.3 461 5158
eng-fra multi30k_test_2017_mscoco 0.71453 51.9 461 5484
fra-deu multi30k_test_2017_mscoco 0.53897 23.9 461 5158
fra-eng multi30k_test_2017_mscoco 0.65274 46.5 461 5231
ces-deu multi30k_test_2018_flickr 0.51543 22.4 1071 13703
ces-eng multi30k_test_2018_flickr 0.57995 33.1 1071 14689
ces-fra multi30k_test_2018_flickr 0.53232 26.0 1071 15867
deu-eng multi30k_test_2018_flickr 0.58274 35.3 1071 14689
deu-fra multi30k_test_2018_flickr 0.55809 29.3 1071 15867
eng-deu multi30k_test_2018_flickr 0.58395 28.7 1071 13703
eng-fra multi30k_test_2018_flickr 0.63770 39.3 1071 15867
fra-deu multi30k_test_2018_flickr 0.53677 22.6 1071 13703
fra-eng multi30k_test_2018_flickr 0.62909 41.0 1071 14689
eng-fra newsdiscusstest2015 0.62144 35.7 1500 27975
fra-eng newsdiscusstest2015 0.60513 37.5 1500 26982
ces-deu newssyscomb2009 0.52473 21.7 502 11271
ces-eng newssyscomb2009 0.55107 28.0 502 11818
ces-fra newssyscomb2009 0.56925 28.7 502 12331
ces-spa newssyscomb2009 0.56161 28.8 502 12503
deu-eng newssyscomb2009 0.55367 29.2 502 11818
deu-fra newssyscomb2009 0.55730 27.1 502 12331
deu-spa newssyscomb2009 0.54844 27.6 502 12503
eng-deu newssyscomb2009 0.53204 22.3 502 11271
eng-fra newssyscomb2009 0.57875 28.8 502 12331
eng-spa newssyscomb2009 0.57849 30.5 502 12503
fra-deu newssyscomb2009 0.52855 22.5 502 11271
fra-eng newssyscomb2009 0.57071 30.6 502 11818
fra-spa newssyscomb2009 0.60067 34.0 502 12503
ita-deu newssyscomb2009 0.53245 22.1 502 11271
ita-eng newssyscomb2009 0.59274 33.7 502 11818
ita-fra newssyscomb2009 0.61167 33.8 502 12331
ita-spa newssyscomb2009 0.60645 35.1 502 12503
spa-deu newssyscomb2009 0.52676 21.8 502 11271
spa-fra newssyscomb2009 0.61003 33.6 502 12331
ces-deu newstest2008 0.52450 21.6 2051 47447
ces-eng newstest2008 0.52805 24.9 2051 49380
ces-fra newstest2008 0.54135 25.4 2051 52685
ces-spa newstest2008 0.53925 26.2 2051 52586
deu-eng newstest2008 0.53756 26.2 2051 49380
deu-fra newstest2008 0.54147 25.5 2051 52685
deu-spa newstest2008 0.53296 24.8 2051 52586
eng-deu newstest2008 0.52399 22.4 2051 47447
eng-fra newstest2008 0.54809 26.1 2051 52685
eng-spa newstest2008 0.56027 29.1 2051 52586
fra-deu newstest2008 0.52211 21.8 2051 47447
fra-eng newstest2008 0.53878 26.1 2051 49380
fra-spa newstest2008 0.58122 32.5 2051 52586
spa-deu newstest2008 0.51468 20.9 2051 47447
ces-deu newstest2009 0.52537 22.4 2525 62816
ces-eng newstest2009 0.54467 27.1 2525 65399
ces-fra newstest2009 0.54545 26.1 2525 69263
ces-spa newstest2009 0.54339 26.3 2525 68111
deu-eng newstest2009 0.53323 25.9 2525 65399
deu-fra newstest2009 0.53408 25.0 2525 69263
deu-spa newstest2009 0.52999 24.4 2525 68111
eng-deu newstest2009 0.52387 21.5 2525 62816
eng-fra newstest2009 0.57057 28.7 2525 69263
eng-spa newstest2009 0.57376 29.6 2525 68111
fra-deu newstest2009 0.51980 21.6 2525 62816
fra-eng newstest2009 0.56151 29.5 2525 65399
fra-spa newstest2009 0.58173 31.4 2525 68111
ita-deu newstest2009 0.52409 22.1 2525 62816
ita-eng newstest2009 0.58598 32.9 2525 65399
ita-fra newstest2009 0.58722 31.5 2525 69263
ita-spa newstest2009 0.59235 33.1 2525 68111
spa-deu newstest2009 0.51708 20.7 2525 62816
spa-eng newstest2009 0.56094 29.2 2525 65399
ces-deu newstest2010 0.53608 23.5 2489 61503
ces-eng newstest2010 0.56348 28.8 2489 61711
ces-fra newstest2010 0.55510 27.2 2489 66022
ces-spa newstest2010 0.57375 30.6 2489 65480
deu-eng newstest2010 0.57666 29.8 2489 61711
deu-fra newstest2010 0.56822 28.2 2489 66022
deu-spa newstest2010 0.58446 31.5 2489 65480
eng-deu newstest2010 0.54037 24.8 2489 61503
eng-fra newstest2010 0.58935 31.2 2489 66022
eng-spa newstest2010 0.61230 35.6 2489 65480
fra-deu newstest2010 0.52993 23.2 2489 61503
fra-eng newstest2010 0.58580 31.7 2489 61711
fra-spa newstest2010 0.61883 36.8 2489 65480
spa-deu newstest2010 0.54232 24.8 2489 61503
ces-deu newstest2011 0.52042 22.2 3003 72981
ces-eng newstest2011 0.55380 27.8 3003 74681
ces-fra newstest2011 0.55651 28.0 3003 80626
ces-spa newstest2011 0.56004 29.9 3003 79476
deu-eng newstest2011 0.54263 25.8 3003 74681
deu-fra newstest2011 0.54883 26.4 3003 80626
deu-spa newstest2011 0.55738 29.1 3003 79476
eng-deu newstest2011 0.52251 22.4 3003 72981
eng-fra newstest2011 0.60292 33.3 3003 80626
eng-spa newstest2011 0.61355 37.6 3003 79476
fra-deu newstest2011 0.52082 22.1 3003 72981
fra-eng newstest2011 0.58971 32.3 3003 74681
fra-spa newstest2011 0.62318 38.7 3003 79476
spa-fra newstest2011 0.60467 34.0 3003 80626
ces-deu newstest2012 0.52126 22.9 3003 72886
ces-eng newstest2012 0.54980 27.0 3003 72812
ces-fra newstest2012 0.55088 26.8 3003 78011
ces-spa newstest2012 0.55950 29.9 3003 79006
deu-eng newstest2012 0.55507 27.5 3003 72812
deu-fra newstest2012 0.55160 26.6 3003 78011
deu-spa newstest2012 0.56307 30.1 3003 79006
eng-deu newstest2012 0.52121 22.9 3003 72886
eng-fra newstest2012 0.58675 30.8 3003 78011
eng-spa newstest2012 0.61689 37.9 3003 79006
fra-deu newstest2012 0.52009 23.2 3003 72886
fra-eng newstest2012 0.58405 32.3 3003 72812
fra-spa newstest2012 0.62038 38.5 3003 79006
rus-deu newstest2012 0.47965 18.3 3003 72886
rus-eng newstest2012 0.61258 36.1 3003 72812
rus-fra newstest2012 0.52674 24.2 3003 78011
rus-spa newstest2012 0.53760 27.4 3003 79006
ces-deu newstest2013 0.54483 25.3 3000 63737
ces-eng newstest2013 0.57212 30.7 3000 64505
ces-fra newstest2013 0.55258 28.4 3000 70037
ces-spa newstest2013 0.56179 30.6 3000 70528
deu-eng newstest2013 0.57382 31.0 3000 64505
deu-fra newstest2013 0.55576 28.8 3000 70037
deu-spa newstest2013 0.56220 30.9 3000 70528
eng-deu newstest2013 0.54830 26.6 3000 63737
eng-fra newstest2013 0.58195 32.6 3000 70037
eng-spa newstest2013 0.59254 34.6 3000 70528
fra-deu newstest2013 0.53465 24.6 3000 63737
fra-eng newstest2013 0.58395 32.9 3000 64505
fra-spa newstest2013 0.58748 34.1 3000 70528
rus-deu newstest2013 0.51980 22.4 3000 63737
rus-eng newstest2013 0.55557 28.9 3000 64505
rus-fra newstest2013 0.54627 27.6 3000 70037
rus-spa newstest2013 0.55540 30.5 3000 70528
spa-deu newstest2013 0.53925 24.8 3000 63737
ces-eng newstest2014 0.61449 33.9 3003 68065
deu-eng newstest2014 0.58733 32.1 3003 67337
eng-deu newstest2014 0.57701 26.5 3003 62688
eng-fra newstest2014 0.63976 38.1 3003 77306
fra-eng newstest2014 0.62627 36.8 3003 70708
hin-eng newstest2014 0.56343 26.4 2507 55571
rus-eng newstest2014 0.62633 36.6 3003 69210
ces-eng newstest2015 0.56562 30.7 2656 53569
deu-eng newstest2015 0.59036 33.3 2169 46443
eng-deu newstest2015 0.58604 30.1 2169 44260
rus-eng newstest2015 0.58794 32.5 2818 64428
ces-eng newstest2016 0.58896 32.6 2999 64670
deu-eng newstest2016 0.63945 39.4 2999 64119
eng-deu newstest2016 0.62731 35.9 2999 62669
ron-eng newstest2016 0.63051 38.1 1999 47562
rus-eng newstest2016 0.58858 32.5 2998 69278
ces-eng newstest2017 0.55759 29.0 3005 61721
deu-eng newstest2017 0.60252 34.8 3004 64399
eng-deu newstest2017 0.57779 28.7 3004 61287
lav-eng newstest2017 0.51103 20.2 2001 47511
rus-eng newstest2017 0.61663 36.1 3001 69025
ces-eng newstest2018 0.56663 29.6 2983 63495
deu-eng newstest2018 0.65768 41.8 2998 67012
eng-deu newstest2018 0.67590 43.5 2998 64276
rus-eng newstest2018 0.58427 31.5 3000 71291
ces-deu newstest2019 0.53405 23.8 1997 48746
deu-eng newstest2019 0.62158 37.7 2000 39227
deu-fra newstest2019 0.61819 34.4 1701 42509
eng-deu newstest2019 0.64640 39.8 1997 48746
fra-deu newstest2019 0.59291 27.6 1701 36446
guj-eng newstest2019 0.51165 22.5 1016 17757
lit-eng newstest2019 0.58019 29.1 1000 25878
rus-eng newstest2019 0.62499 37.8 2000 42642
deu-eng newstest2020 0.56495 30.9 785 38220
deu-fra newstest2020 0.59211 31.6 1619 36890
eng-deu newstest2020 0.58436 30.2 1418 52383
fra-deu newstest2020 0.59478 26.6 1619 30265
pol-eng newstest2020 0.56674 27.7 1001 21755
rus-eng newstest2020 0.62387 33.6 991 20217
ces-eng newstest2021 0.54943 25.6 1000 22056
deu-eng newstest2021 0.58675 30.5 1000 20180
deu-fra newstest2021 0.57690 30.0 1000 23757
eng-deu newstest2021 0.55381 24.9 1002 27970
fra-deu newstest2021 0.63942 37.2 1026 26077
isl-eng newstest2021 0.53701 29.2 1000 22529
rus-eng newstest2021 0.60760 33.7 1000 21228
deu-eng newstestALL2020 0.56898 30.8 785 38220
eng-deu newstestALL2020 0.58436 30.2 1418 52383
rus-eng newstestALL2020 0.62387 33.6 991 20217
deu-eng newstestB2020 0.56571 30.3 785 37696
eng-deu newstestB2020 0.57458 29.7 1418 53092
rus-eng newstestB2020 0.62934 35.5 991 20423
afr-deu ntrex128 0.54806 25.7 1997 48761
afr-eng ntrex128 0.71452 50.6 1997 47673
afr-fra ntrex128 0.55624 28.2 1997 53481
afr-por ntrex128 0.54364 26.9 1997 51631
afr-spa ntrex128 0.57498 32.3 1997 54107
bel-deu ntrex128 0.48215 17.8 1997 48761
bel-eng ntrex128 0.55146 26.7 1997 47673
bel-fra ntrex128 0.49288 20.4 1997 53481
bel-por ntrex128 0.48488 19.9 1997 51631
bel-spa ntrex128 0.50933 23.7 1997 54107
ben-deu ntrex128 0.43995 13.7 1997 48761
ben-eng ntrex128 0.53312 24.9 1997 47673
ben-fra ntrex128 0.45297 17.1 1997 53481
ben-por ntrex128 0.44323 15.5 1997 51631
ben-spa ntrex128 0.46993 19.5 1997 54107
bul-deu ntrex128 0.51786 20.9 1997 48761
bul-eng ntrex128 0.59510 31.3 1997 47673
bul-fra ntrex128 0.53787 25.4 1997 53481
bul-por ntrex128 0.52650 24.2 1997 51631
bul-spa ntrex128 0.54950 28.4 1997 54107
cat-deu ntrex128 0.52907 22.5 1997 48761
cat-eng ntrex128 0.62247 34.6 1997 47673
cat-fra ntrex128 0.55858 27.5 1997 53481
cat-por ntrex128 0.55916 28.3 1997 51631
cat-spa ntrex128 0.61209 35.6 1997 54107
ces-deu ntrex128 0.52704 22.5 1997 48761
ces-eng ntrex128 0.60742 33.1 1997 47673
ces-fra ntrex128 0.54283 26.3 1997 53481
ces-por ntrex128 0.52392 24.1 1997 51631
ces-spa ntrex128 0.55467 28.9 1997 54107
cym-deu ntrex128 0.48064 19.1 1997 48761
cym-eng ntrex128 0.60592 34.7 1997 47673
cym-fra ntrex128 0.50667 23.9 1997 53481
cym-por ntrex128 0.48189 20.5 1997 51631
cym-spa ntrex128 0.52160 26.7 1997 54107
dan-deu ntrex128 0.53284 24.4 1997 48761
dan-eng ntrex128 0.62092 37.5 1997 47673
dan-fra ntrex128 0.53068 25.4 1997 53481
dan-por ntrex128 0.52754 26.2 1997 51631
dan-spa ntrex128 0.55304 29.8 1997 54107
deu-eng ntrex128 0.61371 33.7 1997 47673
deu-fra ntrex128 0.54844 27.4 1997 53481
deu-por ntrex128 0.53694 25.3 1997 51631
deu-spa ntrex128 0.56148 29.8 1997 54107
ell-deu ntrex128 0.51567 21.1 1997 48761
ell-eng ntrex128 0.60389 34.0 1997 47673
ell-fra ntrex128 0.53343 25.1 1997 53481
ell-por ntrex128 0.53030 25.9 1997 51631
ell-spa ntrex128 0.55542 29.7 1997 54107
eng-deu ntrex128 0.57592 28.9 1997 48761
eng-fra ntrex128 0.60159 33.9 1997 53481
eng-por ntrex128 0.59020 32.6 1997 51631
eng-spa ntrex128 0.62826 38.6 1997 54107
fao-deu ntrex128 0.42717 16.1 1997 48761
fao-eng ntrex128 0.48210 24.5 1997 47673
fao-fra ntrex128 0.40770 16.9 1997 53481
fao-por ntrex128 0.40603 16.2 1997 51631
fao-spa ntrex128 0.42980 18.8 1997 54107
fas-deu ntrex128 0.47062 15.7 1997 48761
fas-eng ntrex128 0.53552 24.0 1997 47673
fas-fra ntrex128 0.48958 20.1 1997 53481
fas-por ntrex128 0.47091 18.3 1997 51631
fas-spa ntrex128 0.49946 22.5 1997 54107
fra-deu ntrex128 0.52037 22.1 1997 48761
fra-eng ntrex128 0.59918 32.7 1997 47673
fra-por ntrex128 0.53484 25.0 1997 51631
fra-spa ntrex128 0.56500 30.3 1997 54107
gle-deu ntrex128 0.45357 16.0 1997 48761
gle-eng ntrex128 0.54960 27.0 1997 47673
gle-fra ntrex128 0.47041 18.7 1997 53481
gle-por ntrex128 0.45725 17.5 1997 51631
gle-spa ntrex128 0.48897 22.4 1997 54107
glg-deu ntrex128 0.52710 22.4 1997 48761
glg-eng ntrex128 0.63076 37.0 1997 47673
glg-fra ntrex128 0.55231 27.2 1997 53481
glg-por ntrex128 0.56272 28.9 1997 51631
glg-spa ntrex128 0.61675 36.6 1997 54107
guj-deu ntrex128 0.40361 11.9 1997 48761
guj-eng ntrex128 0.52283 23.0 1997 47673
guj-fra ntrex128 0.41597 14.7 1997 53481
guj-por ntrex128 0.40085 13.0 1997 51631
guj-spa ntrex128 0.44800 18.3 1997 54107
hin-deu ntrex128 0.45618 14.4 1997 48761
hin-eng ntrex128 0.57183 27.9 1997 47673
hin-fra ntrex128 0.47504 18.5 1997 53481
hin-por ntrex128 0.45829 16.9 1997 51631
hin-spa ntrex128 0.48784 21.4 1997 54107
hrv-deu ntrex128 0.53567 23.2 1997 48761
hrv-eng ntrex128 0.61932 34.8 1997 47673
hrv-fra ntrex128 0.55306 27.6 1997 53481
hrv-por ntrex128 0.53968 26.3 1997 51631
hrv-spa ntrex128 0.56765 30.4 1997 54107
hye-deu ntrex128 0.42987 14.0 1997 48761
hye-eng ntrex128 0.49189 20.9 1997 47673
hye-fra ntrex128 0.44434 17.2 1997 53481
hye-por ntrex128 0.43069 16.0 1997 51631
hye-spa ntrex128 0.45889 19.5 1997 54107
isl-deu ntrex128 0.48392 19.5 1997 48761
isl-eng ntrex128 0.54720 27.5 1997 47673
isl-fra ntrex128 0.49971 22.5 1997 53481
isl-por ntrex128 0.47811 20.2 1997 51631
isl-spa ntrex128 0.51060 25.1 1997 54107
ita-deu ntrex128 0.53354 23.3 1997 48761
ita-eng ntrex128 0.63069 37.1 1997 47673
ita-fra ntrex128 0.56721 29.1 1997 53481
ita-por ntrex128 0.56298 28.9 1997 51631
ita-spa ntrex128 0.58483 32.6 1997 54107
lav-deu ntrex128 0.48637 17.5 1997 48761
lav-eng ntrex128 0.55909 25.5 1997 47673
lav-fra ntrex128 0.49579 20.4 1997 53481
lav-por ntrex128 0.47936 18.9 1997 51631
lav-spa ntrex128 0.51105 23.3 1997 54107
lit-deu ntrex128 0.49203 18.0 1997 48761
lit-eng ntrex128 0.55075 25.7 1997 47673
lit-fra ntrex128 0.50667 21.9 1997 53481
lit-por ntrex128 0.49771 20.8 1997 51631
lit-spa ntrex128 0.52333 24.8 1997 54107
ltz-deu ntrex128 0.51232 22.0 1997 48761
ltz-eng ntrex128 0.58218 32.4 1997 47673
ltz-fra ntrex128 0.49182 21.6 1997 53481
ltz-por ntrex128 0.46871 20.3 1997 51631
ltz-spa ntrex128 0.48975 23.6 1997 54107
mar-deu ntrex128 0.42225 12.5 1997 48761
mar-eng ntrex128 0.51583 22.2 1997 47673
mar-fra ntrex128 0.43088 15.1 1997 53481
mar-por ntrex128 0.42394 14.6 1997 51631
mar-spa ntrex128 0.44945 17.7 1997 54107
mkd-deu ntrex128 0.52537 21.8 1997 48761
mkd-eng ntrex128 0.62757 35.8 1997 47673
mkd-fra ntrex128 0.54428 26.4 1997 53481
mkd-por ntrex128 0.52919 24.5 1997 51631
mkd-spa ntrex128 0.56365 30.0 1997 54107
nep-deu ntrex128 0.40783 11.6 1997 48761
nep-eng ntrex128 0.51242 23.1 1997 47673
nep-fra ntrex128 0.41414 14.5 1997 53481
nep-por ntrex128 0.41356 13.8 1997 51631
nep-spa ntrex128 0.43667 17.0 1997 54107
nld-deu ntrex128 0.55633 25.3 1997 48761
nld-eng ntrex128 0.63172 36.0 1997 47673
nld-fra ntrex128 0.55161 27.1 1997 53481
nld-por ntrex128 0.54074 26.8 1997 51631
nld-spa ntrex128 0.57106 31.7 1997 54107
nno-deu ntrex128 0.52489 23.9 1997 48761
nno-eng ntrex128 0.64889 41.6 1997 47673
nno-fra ntrex128 0.53358 26.2 1997 53481
nno-por ntrex128 0.52089 24.7 1997 51631
nno-spa ntrex128 0.54863 29.4 1997 54107
nob-deu ntrex128 0.54650 25.5 1997 48761
nob-eng ntrex128 0.64444 39.3 1997 47673
nob-fra ntrex128 0.55024 28.0 1997 53481
nob-por ntrex128 0.53537 25.9 1997 51631
nob-spa ntrex128 0.56899 31.4 1997 54107
pan-deu ntrex128 0.40429 11.6 1997 48761
pan-eng ntrex128 0.49942 20.6 1997 47673
pan-fra ntrex128 0.41440 14.8 1997 53481
pan-spa ntrex128 0.42840 16.6 1997 54107
pol-deu ntrex128 0.50884 20.4 1997 48761
pol-eng ntrex128 0.55781 26.2 1997 47673
pol-fra ntrex128 0.52511 23.9 1997 53481
pol-por ntrex128 0.50796 21.8 1997 51631
pol-spa ntrex128 0.53122 25.6 1997 54107
por-deu ntrex128 0.54003 23.7 1997 48761
por-eng ntrex128 0.63798 37.6 1997 47673
por-fra ntrex128 0.56317 28.3 1997 53481
por-spa ntrex128 0.59244 33.9 1997 54107
prs-deu ntrex128 0.44878 14.3 1997 48761
prs-eng ntrex128 0.52855 24.2 1997 47673
prs-fra ntrex128 0.46323 17.6 1997 53481
prs-por ntrex128 0.45211 16.9 1997 51631
prs-spa ntrex128 0.47595 20.5 1997 54107
pus-eng ntrex128 0.40630 13.0 1997 47673
ron-deu ntrex128 0.52534 21.6 1997 48761
ron-eng ntrex128 0.60733 32.2 1997 47673
ron-fra ntrex128 0.55222 26.1 1997 53481
ron-por ntrex128 0.54549 26.4 1997 51631
ron-spa ntrex128 0.57503 31.6 1997 54107
rus-deu ntrex128 0.49519 18.5 1997 48761
rus-eng ntrex128 0.55126 25.6 1997 47673
rus-fra ntrex128 0.51684 22.8 1997 53481
rus-por ntrex128 0.49329 20.4 1997 51631
rus-spa ntrex128 0.52316 24.8 1997 54107
slk-deu ntrex128 0.52066 22.0 1997 48761
slk-eng ntrex128 0.60940 33.0 1997 47673
slk-fra ntrex128 0.53303 25.8 1997 53481
slk-por ntrex128 0.51245 23.0 1997 51631
slk-spa ntrex128 0.54489 28.3 1997 54107
slv-deu ntrex128 0.52189 22.0 1997 48761
slv-eng ntrex128 0.58552 30.4 1997 47673
slv-fra ntrex128 0.53247 25.3 1997 53481
slv-por ntrex128 0.51817 23.4 1997 51631
slv-spa ntrex128 0.54582 27.7 1997 54107
spa-fra ntrex128 0.56549 28.3 1997 53481
spa-por ntrex128 0.56372 28.5 1997 51631
sqi-deu ntrex128 0.52259 21.7 1997 48761
sqi-eng ntrex128 0.62439 36.2 1997 47673
sqi-fra ntrex128 0.54643 26.2 1997 53481
sqi-por ntrex128 0.53857 26.2 1997 51631
sqi-spa ntrex128 0.56804 30.8 1997 54107
srp_Cyrl-deu ntrex128 0.48837 18.6 1997 48761
srp_Cyrl-eng ntrex128 0.54292 24.5 1997 47673
srp_Cyrl-fra ntrex128 0.48977 21.5 1997 53481
srp_Cyrl-por ntrex128 0.48429 20.5 1997 51631
srp_Cyrl-spa ntrex128 0.51373 24.9 1997 54107
swe-deu ntrex128 0.54871 25.9 1997 48761
swe-eng ntrex128 0.65427 41.2 1997 47673
swe-fra ntrex128 0.55294 28.2 1997 53481
swe-por ntrex128 0.53911 26.7 1997 51631
swe-spa ntrex128 0.57293 31.9 1997 54107
tgk_Cyrl-deu ntrex128 0.40503 11.8 1997 48761
tgk_Cyrl-eng ntrex128 0.45221 16.4 1997 47673
tgk_Cyrl-fra ntrex128 0.41930 14.4 1997 53481
tgk_Cyrl-por ntrex128 0.40576 12.7 1997 51631
tgk_Cyrl-spa ntrex128 0.43095 16.4 1997 54107
ukr-deu ntrex128 0.49644 18.5 1997 48761
ukr-eng ntrex128 0.55193 25.7 1997 47673
ukr-fra ntrex128 0.50914 21.8 1997 53481
ukr-por ntrex128 0.49879 21.3 1997 51631
ukr-spa ntrex128 0.52640 25.6 1997 54107
urd-deu ntrex128 0.43742 14.1 1997 48761
urd-eng ntrex128 0.52486 23.8 1997 47673
urd-fra ntrex128 0.45409 17.4 1997 53481
urd-por ntrex128 0.42660 14.6 1997 51631
urd-spa ntrex128 0.46414 19.4 1997 54107
ben-eng tico19-test 0.55418 27.3 2100 56824
ben-fra tico19-test 0.45176 18.3 2100 64661
ben-por tico19-test 0.49778 20.9 2100 62729
ben-spa tico19-test 0.51344 25.8 2100 66563
eng-fra tico19-test 0.62001 38.2 2100 64661
eng-por tico19-test 0.71654 48.3 2100 62729
eng-spa tico19-test 0.71947 50.2 2100 66563
fas-eng tico19-test 0.58617 31.6 2100 56315
fas-fra tico19-test 0.50453 23.9 2100 64661
fas-por tico19-test 0.55031 28.1 2100 62729
fas-spa tico19-test 0.56113 29.9 2100 66563
fra-eng tico19-test 0.60512 35.8 2100 56323
fra-por tico19-test 0.57530 33.0 2100 62729
fra-spa tico19-test 0.58823 35.6 2100 66563
hin-eng tico19-test 0.64146 39.6 2100 56323
hin-fra tico19-test 0.51582 25.4 2100 64661
hin-por tico19-test 0.57182 30.9 2100 62729
hin-spa tico19-test 0.58341 33.7 2100 66563
mar-eng tico19-test 0.51194 21.4 2100 56315
mar-fra tico19-test 0.43359 16.8 2100 64661
mar-por tico19-test 0.47089 20.3 2100 62729
mar-spa tico19-test 0.48435 22.8 2100 66563
nep-eng tico19-test 0.57060 30.1 2100 56824
nep-fra tico19-test 0.46212 19.7 2100 64661
nep-por tico19-test 0.51024 24.0 2100 62729
nep-spa tico19-test 0.51651 25.9 2100 66563
por-eng tico19-test 0.72228 47.4 2100 56315
por-fra tico19-test 0.58934 33.4 2100 64661
por-spa tico19-test 0.67509 44.1 2100 66563
prs-eng tico19-test 0.54979 26.6 2100 56824
prs-fra tico19-test 0.47627 21.0 2100 64661
prs-por tico19-test 0.52000 25.6 2100 62729
prs-spa tico19-test 0.54172 28.5 2100 66563
pus-eng tico19-test 0.48655 23.1 2100 56315
pus-fra tico19-test 0.40980 16.2 2100 64661
pus-por tico19-test 0.44879 19.5 2100 62729
pus-spa tico19-test 0.45280 20.4 2100 66563
rus-eng tico19-test 0.59787 30.4 2100 56323
rus-fra tico19-test 0.52211 24.1 2100 64661
rus-por tico19-test 0.56473 26.9 2100 62729
rus-spa tico19-test 0.58626 31.1 2100 66563
spa-fra tico19-test 0.59078 33.1 2100 64661
urd-eng tico19-test 0.51957 25.0 2100 56315
urd-fra tico19-test 0.43707 17.2 2100 64661
urd-por tico19-test 0.47484 20.1 2100 62729
urd-spa tico19-test 0.48812 22.4 2100 66563

Citation Information 

@article{tiedemann2023democratizing,
  title={Democratizing neural machine translation with {OPUS-MT}},
  author={Tiedemann, J{\"o}rg and Aulamo, Mikko and Bakshandaeva, Daria and Boggia, Michele and Gr{\"o}nroos, Stig-Arne and Nieminen, Tommi and Raganato, Alessandro and Scherrer, Yves and Vazquez, Raul and Virpioja, Sami},
  journal={Language Resources and Evaluation},
  number={58},
  pages={713--755},
  year={2023},
  publisher={Springer Nature},
  issn={1574-0218},
  doi={10.1007/s10579-023-09704-w}
}

@inproceedings{tiedemann-thottingal-2020-opus,
    title = "{OPUS}-{MT} {--} Building open translation services for the World",
    author = {Tiedemann, J{\"o}rg  and Thottingal, Santhosh},
    booktitle = "Proceedings of the 22nd Annual Conference of the European Association for Machine Translation",
    month = nov,
    year = "2020",
    address = "Lisboa, Portugal",
    publisher = "European Association for Machine Translation",
    url = "https://aclanthology.org/2020.eamt-1.61",
    pages = "479--480",
}

@inproceedings{tiedemann-2020-tatoeba,
    title = "The Tatoeba Translation Challenge {--} Realistic Data Sets for Low Resource and Multilingual {MT}",
    author = {Tiedemann, J{\"o}rg},
    booktitle = "Proceedings of the Fifth Conference on Machine Translation",
    month = nov,
    year = "2020",
    address = "Online",
    publisher = "Association for Computational Linguistics",
    url = "https://aclanthology.org/2020.wmt-1.139",
    pages = "1174--1182",
}

Acknowledgements

The work is supported by the HPLT project, funded by the European Union’s Horizon Europe research and innovation programme under grant agreement No 101070350. We are also grateful for the generous computational resources and IT infrastructure provided by CSC -- IT Center for Science, Finland, and the EuroHPC supercomputer LUMI.

Model conversion info

  • transformers version: 4.45.1
  • OPUS-MT git hash: 0882077
  • port time: Tue Oct 8 11:49:33 EEST 2024
  • port machine: LM0-400-22516.local
Downloads last month
4
Safetensors
Model size
230M params
Tensor type
F32
·
Inference Examples
Translation
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Collection including Helsinki-NLP/opus-mt-tc-bible-big-ine-deu_eng_fra_por_spa

Evaluation results

View on Papers With Code