osiria commited on
Commit
4ea16c7
·
1 Parent(s): 44602ce

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -75,7 +75,7 @@ Testing notebook: https://huggingface.co/osiria/deberta-italian-question-answeri
75
 
76
  <b>update: version 3.0 (LITEQA)</b>
77
 
78
- The 3.0 version, with the nickname LITEQA, further improves the performances by exploiting a 3-phases fine-tuning strategy: the model is first fine-tuned on the English SQuAD v2 (1 epoch, 20% warmup ratio, and max learning rate of 3e-5) then further fine-tuned on the Italian SQuAD (2 epochs, no warmup, initial learning rate of 3e-5) and lastly fine-tuned on the lowercase Italian SQuAD (1 epochs, no warmup, initial learning rate of 3e-5)
79
  This helps making the model generally more robust, but particularly in uncased settings.
80
 
81
  The 3.0 version can be downloaded from the <b>liteqa</b> branch of this repo
 
75
 
76
  <b>update: version 3.0 (LITEQA)</b>
77
 
78
+ The 3.0 version, with the nickname LITEQA, further improves the performances by exploiting a 3-phases fine-tuning strategy: the model is first fine-tuned on the English SQuAD v2 (1 epoch, 20% warmup ratio, and max learning rate of 3e-5) then further fine-tuned on the Italian SQuAD (2 epochs, no warmup, initial learning rate of 3e-5) and lastly fine-tuned on the lowercase Italian SQuAD (1 epoch, no warmup, initial learning rate of 3e-5).
79
  This helps making the model generally more robust, but particularly in uncased settings.
80
 
81
  The 3.0 version can be downloaded from the <b>liteqa</b> branch of this repo