Update README.md
Browse files
README.md
CHANGED
|
@@ -3,3 +3,14 @@
|
|
| 3 |
This model is a distilbert-base-uncased model trained for 30 epochs (235k steps), 64 batch size with MarginMSE Loss on MS MARCO dataset.
|
| 4 |
|
| 5 |
The token embeddings were frozen.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 3 |
This model is a distilbert-base-uncased model trained for 30 epochs (235k steps), 64 batch size with MarginMSE Loss on MS MARCO dataset.
|
| 4 |
|
| 5 |
The token embeddings were frozen.
|
| 6 |
+
|
| 7 |
+
| Dataset | Model with updated token embeddings | Model with frozen embeddings |
|
| 8 |
+
| --- | :---: | :---: |
|
| 9 |
+
| TREC-DL 19 | 70.68 | 68.60 |
|
| 10 |
+
| TREC-DL 20 | 67.69 | 70.21 |
|
| 11 |
+
| FiQA | 28.89 | 28.6 |
|
| 12 |
+
| Robust04 | 39.56 | 39.08 |
|
| 13 |
+
| TREC-COVID v2 | 69.80 | 69.84 |
|
| 14 |
+
| TREC-NEWS | 37.97 | 38.27 |
|
| 15 |
+
| Avg. 4 BEIR tasks | 44.06 | 43.95 |
|
| 16 |
+
|