Update README.md
Browse files
README.md
CHANGED
|
@@ -431,7 +431,7 @@ To consult the data summary document with the respective licences, please send a
|
|
| 431 |
|
| 432 |
</details>
|
| 433 |
|
| 434 |
-
The model
|
| 435 |
|
| 436 |
We provide an extense Datasheet section following the best practices defined by [(Gebru et al., 2021)](https://arxiv.org/pdf/1803.09010).
|
| 437 |
|
|
|
|
| 431 |
|
| 432 |
</details>
|
| 433 |
|
| 434 |
+
The model is being trained for 3 epochs meaning that the total number of tokens seen during pre-training will amount to roughly 9.2 trillion tokens (currently still training).
|
| 435 |
|
| 436 |
We provide an extense Datasheet section following the best practices defined by [(Gebru et al., 2021)](https://arxiv.org/pdf/1803.09010).
|
| 437 |
|