ru_adapted_phi-2 / README.md
Defetya's picture
Update README.md
1ebb7db verified
---
license: apache-2.0
---
Ru-adapted phi-2 (change the tokenizer and the embeddings layer like here: https://russiansuperglue.com/login/submit_info/2899). Unfortunately, they left no code behind so I can only hope my code's correct.
Model hasn't been trained yet. It will undergo full parameter second-stage pre-training.