|
--- |
|
language: |
|
- ru |
|
- uk |
|
- be |
|
- kk |
|
- az |
|
- hy |
|
- ka |
|
- he |
|
- en |
|
- de |
|
- multilingual |
|
tags: |
|
- language classification |
|
datasets: |
|
- open_subtitles |
|
- tatoeba |
|
- oscar |
|
--- |
|
|
|
# RoBERTa for Single Language Classification |
|
## Training |
|
RoBERTa fine-tuned on small parts of Open Subtitles, Oscar and Tatoeba datasets (~9k samples per language). |
|
|
|
| data source | language | |
|
|-----------------|----------------| |
|
| open_subtitles | ka, he, en, de | |
|
| oscar | be, kk, az, hu | |
|
| tatoeba | ru, uk | |
|
|
|
## Validation |
|
The metrics obtained from validation on the another part of dataset (~1k samples per language). |
|
|
|
|index|class|f1-score|precision|recall|support| |
|
|---|---|---|---|---|---| |
|
|0|az|0\.998|0\.997|1\.0|997| |
|
|1|be|0\.996|0\.998|0\.994|1004| |
|
|2|de|0\.976|0\.966|0\.987|979| |
|
|3|en|0\.976|0\.986|0\.967|1020| |
|
|4|he|1\.0|1\.0|0\.999|1001| |
|
|5|hy|0\.994|0\.991|0\.998|993| |
|
|6|ka|0\.999|0\.999|0\.999|1000| |
|
|7|kk|0\.996|0\.998|0\.993|1005| |
|
|8|uk|0\.982|0\.997|0\.968|1030| |
|
|9|ru|0\.982|0\.968|0\.997|971| |
|
|10|macro\_avg|0\.99|0\.99|0\.99|10000| |
|
|11|weighted avg|0\.99|0\.99|0\.99|10000| |
