TajaKuzman
commited on
Update README.md
Browse files
README.md
CHANGED
@@ -115,8 +115,9 @@ The model can be used for classification into topic labels from the
|
|
115 |
[IPTC NewsCodes schema](https://iptc.org/std/NewsCodes/guidelines/#_what_are_the_iptc_newscodes) and can be
|
116 |
applied to any news text in a language, supported by the `xlm-roberta-large`.
|
117 |
|
118 |
-
Based on
|
119 |
-
the model achieves accuracy of 0.
|
|
|
120 |
|
121 |
## Intended use and limitations
|
122 |
|
|
|
115 |
[IPTC NewsCodes schema](https://iptc.org/std/NewsCodes/guidelines/#_what_are_the_iptc_newscodes) and can be
|
116 |
applied to any news text in a language, supported by the `xlm-roberta-large`.
|
117 |
|
118 |
+
Based on a manually-annotated test set (in Croatian, Slovenian, Catalan and Greek),
|
119 |
+
the model achieves accuracy of 0.84 and macro-F1 scores of 0.78 on instances, predicted with confidence level above 0.90 (80% of test set).
|
120 |
+
If we do not filter out instances, predicted with lower confidence score, the model achieves still a high accuracy of 0.78 and macro-F1 score of 0.72.
|
121 |
|
122 |
## Intended use and limitations
|
123 |
|