TajaKuzman commited on
Commit
822bd30
·
verified ·
1 Parent(s): 64dd067

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -2
README.md CHANGED
@@ -115,8 +115,9 @@ The model can be used for classification into topic labels from the
115
  [IPTC NewsCodes schema](https://iptc.org/std/NewsCodes/guidelines/#_what_are_the_iptc_newscodes) and can be
116
  applied to any news text in a language, supported by the `xlm-roberta-large`.
117
 
118
- Based on out multilingual manually-annotated test set (in Croatian, Slovenian, Catalan and Greek),
119
- the model achieves accuracy of 0.836 and macro-F1 scores of 0.778 on instances, predicted with confidence level above 0.90.
 
120
 
121
  ## Intended use and limitations
122
 
 
115
  [IPTC NewsCodes schema](https://iptc.org/std/NewsCodes/guidelines/#_what_are_the_iptc_newscodes) and can be
116
  applied to any news text in a language, supported by the `xlm-roberta-large`.
117
 
118
+ Based on a manually-annotated test set (in Croatian, Slovenian, Catalan and Greek),
119
+ the model achieves accuracy of 0.84 and macro-F1 scores of 0.78 on instances, predicted with confidence level above 0.90 (80% of test set).
120
+ If we do not filter out instances, predicted with lower confidence score, the model achieves still a high accuracy of 0.78 and macro-F1 score of 0.72.
121
 
122
  ## Intended use and limitations
123