Update README.md
Browse files
README.md
CHANGED
|
@@ -1,3 +1,6 @@
|
|
| 1 |
---
|
| 2 |
license: apache-2.0
|
| 3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
license: apache-2.0
|
| 3 |
---
|
| 4 |
+
Ru-adapted phi-2 (change the tokenizer and the embeddings layer like here: https://russiansuperglue.com/login/submit_info/2899). Unfortunately, they left no code behind so I can only hope my code's correct.
|
| 5 |
+
|
| 6 |
+
Model hasn't been trained yet. It will undergo full parameter second-stage pre-training.
|