Update README.md
Browse files
README.md
CHANGED
|
@@ -65,7 +65,7 @@ Along with the open weights, all training scripts and configuration files are ma
|
|
| 65 |
|
| 66 |
### Description
|
| 67 |
|
| 68 |
-
Transformer-based decoder-only language model that has been pre-trained from scratch on 7.
|
| 69 |
The pre-training corpus contains text in 35 European languages and code.
|
| 70 |
|
| 71 |
### Hyperparameters
|
|
|
|
| 65 |
|
| 66 |
### Description
|
| 67 |
|
| 68 |
+
Transformer-based decoder-only language model that has been pre-trained from scratch on 7.2 trillion tokens of highly curated data.
|
| 69 |
The pre-training corpus contains text in 35 European languages and code.
|
| 70 |
|
| 71 |
### Hyperparameters
|