opus-mt-sla-sla / README.md

system HF staff

Update README.md

3b24651 about 4 years ago

6.77 kB

	---
	language:
	-be
	-hr
	-mk
	-cs
	-ru
	-pl
	-bg
	-uk
	-sl
	-sla

	tags:
	- translation

	license: apache-2.0
	---

	### sla-sla

	* source group: Slavic languages
	* target group: Slavic languages
	* OPUS readme: [sla-sla](https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/sla-sla/README.md)

	* model: transformer
	* source language(s): bel bel_Latn bos_Latn bul bul_Latn ces dsb hrv hsb mkd orv_Cyrl pol rus slv srp_Cyrl srp_Latn ukr
	* target language(s): bel bel_Latn bos_Latn bul bul_Latn ces dsb hrv hsb mkd orv_Cyrl pol rus slv srp_Cyrl srp_Latn ukr
	* model: transformer
	* pre-processing: normalization + SentencePiece (spm32k,spm32k)
	* a sentence initial language token is required in the form of `>>id<<` (id = valid target language ID)
	* download original weights: [opus-2020-07-27.zip](https://object.pouta.csc.fi/Tatoeba-MT-models/sla-sla/opus-2020-07-27.zip)
	* test set translations: [opus-2020-07-27.test.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/sla-sla/opus-2020-07-27.test.txt)
	* test set scores: [opus-2020-07-27.eval.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/sla-sla/opus-2020-07-27.eval.txt)

	## Benchmarks

	\| testset \| BLEU \| chr-F \|
	\|-----------------------\|-------\|-------\|
	\| newstest2012-cesrus.ces.rus \| 15.9 \| 0.437 \|
	\| newstest2012-rusces.rus.ces \| 13.6 \| 0.403 \|
	\| newstest2013-cesrus.ces.rus \| 19.8 \| 0.473 \|
	\| newstest2013-rusces.rus.ces \| 17.9 \| 0.449 \|
	\| Tatoeba-test.bel-bul.bel.bul \| 100.0 \| 1.000 \|
	\| Tatoeba-test.bel-ces.bel.ces \| 33.5 \| 0.630 \|
	\| Tatoeba-test.bel-hbs.bel.hbs \| 45.4 \| 0.644 \|
	\| Tatoeba-test.bel-mkd.bel.mkd \| 19.3 \| 0.531 \|
	\| Tatoeba-test.bel-pol.bel.pol \| 46.9 \| 0.681 \|
	\| Tatoeba-test.bel-rus.bel.rus \| 58.5 \| 0.767 \|
	\| Tatoeba-test.bel-ukr.bel.ukr \| 55.1 \| 0.743 \|
	\| Tatoeba-test.bul-bel.bul.bel \| 10.7 \| 0.423 \|
	\| Tatoeba-test.bul-ces.bul.ces \| 36.9 \| 0.585 \|
	\| Tatoeba-test.bul-hbs.bul.hbs \| 53.7 \| 0.807 \|
	\| Tatoeba-test.bul-mkd.bul.mkd \| 31.9 \| 0.715 \|
	\| Tatoeba-test.bul-pol.bul.pol \| 38.6 \| 0.607 \|
	\| Tatoeba-test.bul-rus.bul.rus \| 44.8 \| 0.655 \|
	\| Tatoeba-test.bul-ukr.bul.ukr \| 49.9 \| 0.691 \|
	\| Tatoeba-test.ces-bel.ces.bel \| 30.9 \| 0.585 \|
	\| Tatoeba-test.ces-bul.ces.bul \| 75.8 \| 0.859 \|
	\| Tatoeba-test.ces-hbs.ces.hbs \| 50.0 \| 0.661 \|
	\| Tatoeba-test.ces-hsb.ces.hsb \| 7.9 \| 0.246 \|
	\| Tatoeba-test.ces-mkd.ces.mkd \| 24.6 \| 0.569 \|
	\| Tatoeba-test.ces-pol.ces.pol \| 44.3 \| 0.652 \|
	\| Tatoeba-test.ces-rus.ces.rus \| 50.8 \| 0.690 \|
	\| Tatoeba-test.ces-slv.ces.slv \| 4.9 \| 0.240 \|
	\| Tatoeba-test.ces-ukr.ces.ukr \| 52.9 \| 0.687 \|
	\| Tatoeba-test.dsb-pol.dsb.pol \| 16.3 \| 0.367 \|
	\| Tatoeba-test.dsb-rus.dsb.rus \| 12.7 \| 0.245 \|
	\| Tatoeba-test.hbs-bel.hbs.bel \| 32.9 \| 0.531 \|
	\| Tatoeba-test.hbs-bul.hbs.bul \| 100.0 \| 1.000 \|
	\| Tatoeba-test.hbs-ces.hbs.ces \| 40.3 \| 0.626 \|
	\| Tatoeba-test.hbs-mkd.hbs.mkd \| 19.3 \| 0.535 \|
	\| Tatoeba-test.hbs-pol.hbs.pol \| 45.0 \| 0.650 \|
	\| Tatoeba-test.hbs-rus.hbs.rus \| 53.5 \| 0.709 \|
	\| Tatoeba-test.hbs-ukr.hbs.ukr \| 50.7 \| 0.684 \|
	\| Tatoeba-test.hsb-ces.hsb.ces \| 17.9 \| 0.366 \|
	\| Tatoeba-test.mkd-bel.mkd.bel \| 23.6 \| 0.548 \|
	\| Tatoeba-test.mkd-bul.mkd.bul \| 54.2 \| 0.833 \|
	\| Tatoeba-test.mkd-ces.mkd.ces \| 12.1 \| 0.371 \|
	\| Tatoeba-test.mkd-hbs.mkd.hbs \| 19.3 \| 0.577 \|
	\| Tatoeba-test.mkd-pol.mkd.pol \| 53.7 \| 0.833 \|
	\| Tatoeba-test.mkd-rus.mkd.rus \| 34.2 \| 0.745 \|
	\| Tatoeba-test.mkd-ukr.mkd.ukr \| 42.7 \| 0.708 \|
	\| Tatoeba-test.multi.multi \| 48.5 \| 0.672 \|
	\| Tatoeba-test.orv-pol.orv.pol \| 10.1 \| 0.355 \|
	\| Tatoeba-test.orv-rus.orv.rus \| 10.6 \| 0.275 \|
	\| Tatoeba-test.orv-ukr.orv.ukr \| 7.5 \| 0.230 \|
	\| Tatoeba-test.pol-bel.pol.bel \| 29.8 \| 0.533 \|
	\| Tatoeba-test.pol-bul.pol.bul \| 36.8 \| 0.578 \|
	\| Tatoeba-test.pol-ces.pol.ces \| 43.6 \| 0.626 \|
	\| Tatoeba-test.pol-dsb.pol.dsb \| 0.9 \| 0.097 \|
	\| Tatoeba-test.pol-hbs.pol.hbs \| 42.4 \| 0.644 \|
	\| Tatoeba-test.pol-mkd.pol.mkd \| 19.3 \| 0.535 \|
	\| Tatoeba-test.pol-orv.pol.orv \| 0.7 \| 0.109 \|
	\| Tatoeba-test.pol-rus.pol.rus \| 49.6 \| 0.680 \|
	\| Tatoeba-test.pol-slv.pol.slv \| 7.3 \| 0.262 \|
	\| Tatoeba-test.pol-ukr.pol.ukr \| 46.8 \| 0.664 \|
	\| Tatoeba-test.rus-bel.rus.bel \| 34.4 \| 0.577 \|
	\| Tatoeba-test.rus-bul.rus.bul \| 45.5 \| 0.657 \|
	\| Tatoeba-test.rus-ces.rus.ces \| 48.0 \| 0.659 \|
	\| Tatoeba-test.rus-dsb.rus.dsb \| 10.7 \| 0.029 \|
	\| Tatoeba-test.rus-hbs.rus.hbs \| 44.6 \| 0.655 \|
	\| Tatoeba-test.rus-mkd.rus.mkd \| 34.9 \| 0.617 \|
	\| Tatoeba-test.rus-orv.rus.orv \| 0.1 \| 0.073 \|
	\| Tatoeba-test.rus-pol.rus.pol \| 45.2 \| 0.659 \|
	\| Tatoeba-test.rus-slv.rus.slv \| 30.4 \| 0.476 \|
	\| Tatoeba-test.rus-ukr.rus.ukr \| 57.6 \| 0.751 \|
	\| Tatoeba-test.slv-ces.slv.ces \| 42.5 \| 0.604 \|
	\| Tatoeba-test.slv-pol.slv.pol \| 39.6 \| 0.601 \|
	\| Tatoeba-test.slv-rus.slv.rus \| 47.2 \| 0.638 \|
	\| Tatoeba-test.slv-ukr.slv.ukr \| 36.4 \| 0.549 \|
	\| Tatoeba-test.ukr-bel.ukr.bel \| 36.9 \| 0.597 \|
	\| Tatoeba-test.ukr-bul.ukr.bul \| 56.4 \| 0.733 \|
	\| Tatoeba-test.ukr-ces.ukr.ces \| 52.1 \| 0.686 \|
	\| Tatoeba-test.ukr-hbs.ukr.hbs \| 47.1 \| 0.670 \|
	\| Tatoeba-test.ukr-mkd.ukr.mkd \| 20.8 \| 0.548 \|
	\| Tatoeba-test.ukr-orv.ukr.orv \| 0.2 \| 0.058 \|
	\| Tatoeba-test.ukr-pol.ukr.pol \| 50.1 \| 0.695 \|
	\| Tatoeba-test.ukr-rus.ukr.rus \| 63.9 \| 0.790 \|
	\| Tatoeba-test.ukr-slv.ukr.slv \| 14.5 \| 0.288 \|


	### System Info:
	- hf_name: sla-sla

	- source_languages: sla

	- target_languages: sla

	- opus_readme_url: https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/sla-sla/README.md

	- original_repo: Tatoeba-Challenge

	- tags: ['translation']

	- languages: ['be', 'hr', 'mk', 'cs', 'ru', 'pl', 'bg', 'uk', 'sl', 'sla']

	- src_constituents: {'bel', 'hrv', 'orv_Cyrl', 'mkd', 'bel_Latn', 'srp_Latn', 'bul_Latn', 'ces', 'bos_Latn', 'csb_Latn', 'dsb', 'hsb', 'rus', 'srp_Cyrl', 'pol', 'rue', 'bul', 'ukr', 'slv'}

	- tgt_constituents: {'bel', 'hrv', 'orv_Cyrl', 'mkd', 'bel_Latn', 'srp_Latn', 'bul_Latn', 'ces', 'bos_Latn', 'csb_Latn', 'dsb', 'hsb', 'rus', 'srp_Cyrl', 'pol', 'rue', 'bul', 'ukr', 'slv'}

	- src_multilingual: True

	- tgt_multilingual: True

	- prepro: normalization + SentencePiece (spm32k,spm32k)

	- url_model: https://object.pouta.csc.fi/Tatoeba-MT-models/sla-sla/opus-2020-07-27.zip

	- url_test_set: https://object.pouta.csc.fi/Tatoeba-MT-models/sla-sla/opus-2020-07-27.test.txt

	- src_alpha3: sla

	- tgt_alpha3: sla

	- short_pair: sla-sla

	- chrF2_score: 0.672

	- bleu: 48.5

	- brevity_penalty: 1.0

	- ref_len: 59320.0

	- src_name: Slavic languages

	- tgt_name: Slavic languages

	- train_date: 2020-07-27

	- src_alpha2: sla

	- tgt_alpha2: sla

	- prefer_old: False

	- long_pair: sla-sla

	- helsinki_git_sha: 480fcbe0ee1bf4774bcbe6226ad9f58e63f6c535

	- transformers_git_sha: 6bdf998dffa70030e42f512a586f33a15e648edd

	- port_machine: brutasse

	- port_time: 2020-08-19-00:09

	---
	language:
	-be
	-hr
	-mk
	-cs
	-ru
	-pl
	-bg
	-uk
	-sl
	-sla

	tags:
	- translation

	license: apache-2.0
	---

	### sla-sla

	* source group: Slavic languages
	* target group: Slavic languages
	* OPUS readme: [sla-sla](https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/sla-sla/README.md)

	* model: transformer
	* source language(s): bel bel_Latn bos_Latn bul bul_Latn ces dsb hrv hsb mkd orv_Cyrl pol rus slv srp_Cyrl srp_Latn ukr
	* target language(s): bel bel_Latn bos_Latn bul bul_Latn ces dsb hrv hsb mkd orv_Cyrl pol rus slv srp_Cyrl srp_Latn ukr
	* model: transformer
	* pre-processing: normalization + SentencePiece (spm32k,spm32k)
	* a sentence initial language token is required in the form of `>>id<<` (id = valid target language ID)
	* download original weights: [opus-2020-07-27.zip](https://object.pouta.csc.fi/Tatoeba-MT-models/sla-sla/opus-2020-07-27.zip)
	* test set translations: [opus-2020-07-27.test.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/sla-sla/opus-2020-07-27.test.txt)
	* test set scores: [opus-2020-07-27.eval.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/sla-sla/opus-2020-07-27.eval.txt)

	## Benchmarks

	\| testset \| BLEU \| chr-F \|
	\|-----------------------\|-------\|-------\|
	\| newstest2012-cesrus.ces.rus \| 15.9 \| 0.437 \|
	\| newstest2012-rusces.rus.ces \| 13.6 \| 0.403 \|
	\| newstest2013-cesrus.ces.rus \| 19.8 \| 0.473 \|
	\| newstest2013-rusces.rus.ces \| 17.9 \| 0.449 \|
	\| Tatoeba-test.bel-bul.bel.bul \| 100.0 \| 1.000 \|
	\| Tatoeba-test.bel-ces.bel.ces \| 33.5 \| 0.630 \|
	\| Tatoeba-test.bel-hbs.bel.hbs \| 45.4 \| 0.644 \|
	\| Tatoeba-test.bel-mkd.bel.mkd \| 19.3 \| 0.531 \|
	\| Tatoeba-test.bel-pol.bel.pol \| 46.9 \| 0.681 \|
	\| Tatoeba-test.bel-rus.bel.rus \| 58.5 \| 0.767 \|
	\| Tatoeba-test.bel-ukr.bel.ukr \| 55.1 \| 0.743 \|
	\| Tatoeba-test.bul-bel.bul.bel \| 10.7 \| 0.423 \|
	\| Tatoeba-test.bul-ces.bul.ces \| 36.9 \| 0.585 \|
	\| Tatoeba-test.bul-hbs.bul.hbs \| 53.7 \| 0.807 \|
	\| Tatoeba-test.bul-mkd.bul.mkd \| 31.9 \| 0.715 \|
	\| Tatoeba-test.bul-pol.bul.pol \| 38.6 \| 0.607 \|
	\| Tatoeba-test.bul-rus.bul.rus \| 44.8 \| 0.655 \|
	\| Tatoeba-test.bul-ukr.bul.ukr \| 49.9 \| 0.691 \|
	\| Tatoeba-test.ces-bel.ces.bel \| 30.9 \| 0.585 \|
	\| Tatoeba-test.ces-bul.ces.bul \| 75.8 \| 0.859 \|
	\| Tatoeba-test.ces-hbs.ces.hbs \| 50.0 \| 0.661 \|
	\| Tatoeba-test.ces-hsb.ces.hsb \| 7.9 \| 0.246 \|
	\| Tatoeba-test.ces-mkd.ces.mkd \| 24.6 \| 0.569 \|
	\| Tatoeba-test.ces-pol.ces.pol \| 44.3 \| 0.652 \|
	\| Tatoeba-test.ces-rus.ces.rus \| 50.8 \| 0.690 \|
	\| Tatoeba-test.ces-slv.ces.slv \| 4.9 \| 0.240 \|
	\| Tatoeba-test.ces-ukr.ces.ukr \| 52.9 \| 0.687 \|
	\| Tatoeba-test.dsb-pol.dsb.pol \| 16.3 \| 0.367 \|
	\| Tatoeba-test.dsb-rus.dsb.rus \| 12.7 \| 0.245 \|
	\| Tatoeba-test.hbs-bel.hbs.bel \| 32.9 \| 0.531 \|
	\| Tatoeba-test.hbs-bul.hbs.bul \| 100.0 \| 1.000 \|
	\| Tatoeba-test.hbs-ces.hbs.ces \| 40.3 \| 0.626 \|
	\| Tatoeba-test.hbs-mkd.hbs.mkd \| 19.3 \| 0.535 \|
	\| Tatoeba-test.hbs-pol.hbs.pol \| 45.0 \| 0.650 \|
	\| Tatoeba-test.hbs-rus.hbs.rus \| 53.5 \| 0.709 \|
	\| Tatoeba-test.hbs-ukr.hbs.ukr \| 50.7 \| 0.684 \|
	\| Tatoeba-test.hsb-ces.hsb.ces \| 17.9 \| 0.366 \|
	\| Tatoeba-test.mkd-bel.mkd.bel \| 23.6 \| 0.548 \|
	\| Tatoeba-test.mkd-bul.mkd.bul \| 54.2 \| 0.833 \|
	\| Tatoeba-test.mkd-ces.mkd.ces \| 12.1 \| 0.371 \|
	\| Tatoeba-test.mkd-hbs.mkd.hbs \| 19.3 \| 0.577 \|
	\| Tatoeba-test.mkd-pol.mkd.pol \| 53.7 \| 0.833 \|
	\| Tatoeba-test.mkd-rus.mkd.rus \| 34.2 \| 0.745 \|
	\| Tatoeba-test.mkd-ukr.mkd.ukr \| 42.7 \| 0.708 \|
	\| Tatoeba-test.multi.multi \| 48.5 \| 0.672 \|
	\| Tatoeba-test.orv-pol.orv.pol \| 10.1 \| 0.355 \|
	\| Tatoeba-test.orv-rus.orv.rus \| 10.6 \| 0.275 \|
	\| Tatoeba-test.orv-ukr.orv.ukr \| 7.5 \| 0.230 \|
	\| Tatoeba-test.pol-bel.pol.bel \| 29.8 \| 0.533 \|
	\| Tatoeba-test.pol-bul.pol.bul \| 36.8 \| 0.578 \|
	\| Tatoeba-test.pol-ces.pol.ces \| 43.6 \| 0.626 \|
	\| Tatoeba-test.pol-dsb.pol.dsb \| 0.9 \| 0.097 \|
	\| Tatoeba-test.pol-hbs.pol.hbs \| 42.4 \| 0.644 \|
	\| Tatoeba-test.pol-mkd.pol.mkd \| 19.3 \| 0.535 \|
	\| Tatoeba-test.pol-orv.pol.orv \| 0.7 \| 0.109 \|
	\| Tatoeba-test.pol-rus.pol.rus \| 49.6 \| 0.680 \|
	\| Tatoeba-test.pol-slv.pol.slv \| 7.3 \| 0.262 \|
	\| Tatoeba-test.pol-ukr.pol.ukr \| 46.8 \| 0.664 \|
	\| Tatoeba-test.rus-bel.rus.bel \| 34.4 \| 0.577 \|
	\| Tatoeba-test.rus-bul.rus.bul \| 45.5 \| 0.657 \|
	\| Tatoeba-test.rus-ces.rus.ces \| 48.0 \| 0.659 \|
	\| Tatoeba-test.rus-dsb.rus.dsb \| 10.7 \| 0.029 \|
	\| Tatoeba-test.rus-hbs.rus.hbs \| 44.6 \| 0.655 \|
	\| Tatoeba-test.rus-mkd.rus.mkd \| 34.9 \| 0.617 \|
	\| Tatoeba-test.rus-orv.rus.orv \| 0.1 \| 0.073 \|
	\| Tatoeba-test.rus-pol.rus.pol \| 45.2 \| 0.659 \|
	\| Tatoeba-test.rus-slv.rus.slv \| 30.4 \| 0.476 \|
	\| Tatoeba-test.rus-ukr.rus.ukr \| 57.6 \| 0.751 \|
	\| Tatoeba-test.slv-ces.slv.ces \| 42.5 \| 0.604 \|
	\| Tatoeba-test.slv-pol.slv.pol \| 39.6 \| 0.601 \|
	\| Tatoeba-test.slv-rus.slv.rus \| 47.2 \| 0.638 \|
	\| Tatoeba-test.slv-ukr.slv.ukr \| 36.4 \| 0.549 \|
	\| Tatoeba-test.ukr-bel.ukr.bel \| 36.9 \| 0.597 \|
	\| Tatoeba-test.ukr-bul.ukr.bul \| 56.4 \| 0.733 \|
	\| Tatoeba-test.ukr-ces.ukr.ces \| 52.1 \| 0.686 \|
	\| Tatoeba-test.ukr-hbs.ukr.hbs \| 47.1 \| 0.670 \|
	\| Tatoeba-test.ukr-mkd.ukr.mkd \| 20.8 \| 0.548 \|
	\| Tatoeba-test.ukr-orv.ukr.orv \| 0.2 \| 0.058 \|
	\| Tatoeba-test.ukr-pol.ukr.pol \| 50.1 \| 0.695 \|
	\| Tatoeba-test.ukr-rus.ukr.rus \| 63.9 \| 0.790 \|
	\| Tatoeba-test.ukr-slv.ukr.slv \| 14.5 \| 0.288 \|


	### System Info:
	- hf_name: sla-sla

	- source_languages: sla

	- target_languages: sla

	- opus_readme_url: https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/sla-sla/README.md

	- original_repo: Tatoeba-Challenge

	- tags: ['translation']

	- languages: ['be', 'hr', 'mk', 'cs', 'ru', 'pl', 'bg', 'uk', 'sl', 'sla']

	- src_constituents: {'bel', 'hrv', 'orv_Cyrl', 'mkd', 'bel_Latn', 'srp_Latn', 'bul_Latn', 'ces', 'bos_Latn', 'csb_Latn', 'dsb', 'hsb', 'rus', 'srp_Cyrl', 'pol', 'rue', 'bul', 'ukr', 'slv'}

	- tgt_constituents: {'bel', 'hrv', 'orv_Cyrl', 'mkd', 'bel_Latn', 'srp_Latn', 'bul_Latn', 'ces', 'bos_Latn', 'csb_Latn', 'dsb', 'hsb', 'rus', 'srp_Cyrl', 'pol', 'rue', 'bul', 'ukr', 'slv'}

	- src_multilingual: True

	- tgt_multilingual: True

	- prepro: normalization + SentencePiece (spm32k,spm32k)

	- url_model: https://object.pouta.csc.fi/Tatoeba-MT-models/sla-sla/opus-2020-07-27.zip

	- url_test_set: https://object.pouta.csc.fi/Tatoeba-MT-models/sla-sla/opus-2020-07-27.test.txt

	- src_alpha3: sla

	- tgt_alpha3: sla

	- short_pair: sla-sla

	- chrF2_score: 0.672

	- bleu: 48.5

	- brevity_penalty: 1.0

	- ref_len: 59320.0

	- src_name: Slavic languages

	- tgt_name: Slavic languages

	- train_date: 2020-07-27

	- src_alpha2: sla

	- tgt_alpha2: sla

	- prefer_old: False

	- long_pair: sla-sla

	- helsinki_git_sha: 480fcbe0ee1bf4774bcbe6226ad9f58e63f6c535

	- transformers_git_sha: 6bdf998dffa70030e42f512a586f33a15e648edd

	- port_machine: brutasse

	- port_time: 2020-08-19-00:09