|
--- |
|
license: mit |
|
language: |
|
- af |
|
- az |
|
- be |
|
- bg |
|
- bn |
|
- ca |
|
- cs |
|
- cy |
|
- da |
|
- de |
|
- el |
|
- en |
|
- eo |
|
- es |
|
- et |
|
- eu |
|
- fa |
|
- fi |
|
- fr |
|
- fy |
|
- ga |
|
- gl |
|
- gu |
|
- he |
|
- hi |
|
- hu |
|
- hy |
|
- id |
|
- is |
|
- it |
|
- ka |
|
- kk |
|
- ky |
|
- la |
|
- lt |
|
- lv |
|
- mg |
|
- mk |
|
- ml |
|
- mt |
|
- nl |
|
- pa |
|
- pl |
|
- pt |
|
- ro |
|
- ru |
|
- sk |
|
- sq |
|
- sv |
|
- ta |
|
- te |
|
- th |
|
- tr |
|
- uk |
|
- yi |
|
- yo |
|
datasets: |
|
- benjamin/compoundpiece |
|
--- |
|
|
|
Compound normalization model from [CompoundPiece: Evaluating and Improving Decompounding Performance of Language Models](https://arxiv.org/abs/2305.14214). |
|
|
|
## Usage |
|
|
|
``` |
|
from transformers import pipeline |
|
|
|
pipe = pipeline("text2text-generation", "benjamin/compoundpiece") |
|
|
|
pipe("Hauswirtschaftslehre", max_length=32) |
|
# [{'generated_text': 'Haus-Wirtschaft-Lehre'}] |
|
``` |
