library_name: transformers | |
base_model: openai-community/gpt2 | |
license: apache-2.0 | |
language: | |
- en | |
# GPT-2, But With Mistral's Tokenizer | |
Finally, an answer to one of the biggest open questions in NLP: | |
**Q:** Wouldn't it be messed up if someone grafted the tokenizer from Mistral 7B onto GPT-2?<br /> | |
**A:** Ya :) | |