Update README.md
Browse files
README.md
CHANGED
@@ -75,7 +75,7 @@ Testing notebook: https://huggingface.co/osiria/deberta-italian-question-answeri
|
|
75 |
|
76 |
<b>update: version 3.0 (LITEQA)</b>
|
77 |
|
78 |
-
The 3.0 version, with the nickname LITEQA, further improves the performances by exploiting a 3-phases fine-tuning strategy: the model is first fine-tuned on the English SQuAD v2 (1 epoch, 20% warmup ratio, and max learning rate of 3e-5) then further fine-tuned on the Italian SQuAD (2 epochs, no warmup, initial learning rate of 3e-5) and lastly fine-tuned on the lowercase Italian SQuAD (1
|
79 |
This helps making the model generally more robust, but particularly in uncased settings.
|
80 |
|
81 |
The 3.0 version can be downloaded from the <b>liteqa</b> branch of this repo
|
|
|
75 |
|
76 |
<b>update: version 3.0 (LITEQA)</b>
|
77 |
|
78 |
+
The 3.0 version, with the nickname LITEQA, further improves the performances by exploiting a 3-phases fine-tuning strategy: the model is first fine-tuned on the English SQuAD v2 (1 epoch, 20% warmup ratio, and max learning rate of 3e-5) then further fine-tuned on the Italian SQuAD (2 epochs, no warmup, initial learning rate of 3e-5) and lastly fine-tuned on the lowercase Italian SQuAD (1 epoch, no warmup, initial learning rate of 3e-5).
|
79 |
This helps making the model generally more robust, but particularly in uncased settings.
|
80 |
|
81 |
The 3.0 version can be downloaded from the <b>liteqa</b> branch of this repo
|