Tokenizer in .model format
#1
by
sitnich
- opened
Thank you so much for amazing model! Looking forward for the paper 🙏
Do you by chance plan to release the tokenizer in .model format?
I don't think we have an extended tokenizer somewhere in the .model format, besides this, in my opinion, the tokenizer in https://huggingface.co/RefalMachine/ruadapt_qwen2.5_7B_ext_u48_instruct is better.