|
--- |
|
license: mit |
|
language: |
|
- af |
|
- az |
|
- be |
|
- bg |
|
- bn |
|
- ca |
|
- cs |
|
- cy |
|
- da |
|
- de |
|
- el |
|
- en |
|
- eo |
|
- es |
|
- et |
|
- eu |
|
- fa |
|
- fi |
|
- fr |
|
- fy |
|
- ga |
|
- gl |
|
- gu |
|
- he |
|
- hi |
|
- hu |
|
- hy |
|
- id |
|
- is |
|
- it |
|
- ka |
|
- kk |
|
- ky |
|
- la |
|
- lt |
|
- lv |
|
- mg |
|
- mk |
|
- ml |
|
- mt |
|
- nl |
|
- pa |
|
- pl |
|
- pt |
|
- ro |
|
- ru |
|
- sk |
|
- sq |
|
- sv |
|
- ta |
|
- te |
|
- th |
|
- tr |
|
- uk |
|
- yi |
|
- yo |
|
datasets: |
|
- benjamin/compoundpiece |
|
--- |
|
|
|
CompoundPiece model trained only on Stage 1 training data (self-supervised training on hyphenated and non-hyphenated words scraped from the web). See [CompoundPiece: Evaluating and Improving Decompounding Performance of Language Models](https://arxiv.org/abs/2305.14214). |
|
|
|
# Citation |
|
|
|
``` |
|
@article{minixhofer2023compoundpiece, |
|
title={CompoundPiece: Evaluating and Improving Decompounding Performance of Language Models}, |
|
author={Minixhofer, Benjamin and Pfeiffer, Jonas and Vuli{\'c}, Ivan}, |
|
journal={arXiv preprint arXiv:2305.14214}, |
|
year={2023} |
|
} |
|
``` |
|
|
|
# License |
|
|
|
MIT |
