Commit
·
5dd2a91
1
Parent(s):
fb2efbd
Update README.md
Browse files
README.md
CHANGED
|
@@ -34,4 +34,18 @@ Romanian DistilBERT is 35% smaller than the original Romanian BERT.
|
|
| 34 |
| bert-base-romanian-cased-v1 | 477.2 | 124.4 |
|
| 35 |
| distilbert-base-romanian-cased | 312.7 | 81.3 |
|
| 36 |
|
|
|
|
| 37 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 34 |
| bert-base-romanian-cased-v1 | 477.2 | 124.4 |
|
| 35 |
| distilbert-base-romanian-cased | 312.7 | 81.3 |
|
| 36 |
|
| 37 |
+
## Evaluation
|
| 38 |
|
| 39 |
+
We evaluated the Romanian DistilBERT in comparison with the original Romanian BERT on 5 tasks:
|
| 40 |
+
|
| 41 |
+
- **UPOS**: Universal Part of Speech
|
| 42 |
+
- **XPOS**: Extended Part of Speech
|
| 43 |
+
- **NER**: Named Entity Recognition
|
| 44 |
+
- **SAPN**: Sentiment Anlaysis - Positive vs Negative
|
| 45 |
+
- **SAR**: Sentiment Analysis - Rating
|
| 46 |
+
- **DI**: Dialect identification
|
| 47 |
+
|
| 48 |
+
| Model | UPOS | XPOS | NER | SAPN | SAR | DI | STS |
|
| 49 |
+
|--------------------------------|:----:|:----:|:---:|:----:|:---:|:--:|:---:|
|
| 50 |
+
| bert-base-romanian-cased-v1 | 98.00 | 96.46 | 85.88 | 98.07 | 79.61 | 95.58 | 79.11 |
|
| 51 |
+
| distilbert-base-romanian-cased | 97.97 | 97.08 | 83.35 | 98.40 | 83.01 | 96.31 | 80.57 |
|