ru_adapted_phi-2 / README.md
Defetya's picture
Update README.md
1ebb7db verified
metadata
license: apache-2.0

Ru-adapted phi-2 (change the tokenizer and the embeddings layer like here: https://russiansuperglue.com/login/submit_info/2899). Unfortunately, they left no code behind so I can only hope my code's correct.

Model hasn't been trained yet. It will undergo full parameter second-stage pre-training.