File size: 324 Bytes
a94ca41 1ebb7db |
1 2 3 4 5 6 |
---
license: apache-2.0
---
Ru-adapted phi-2 (change the tokenizer and the embeddings layer like here: https://russiansuperglue.com/login/submit_info/2899). Unfortunately, they left no code behind so I can only hope my code's correct.
Model hasn't been trained yet. It will undergo full parameter second-stage pre-training. |