Missing tokenizer.json

#1
by amitgalor - opened

When working offline (after downloading this model repo) it tries to download an external tokenizer. It would be helpful to have this tokenizer.config in the repo, to obviate outside requirements.

Done

benderrodriguez changed discussion status to closed
Your need to confirm your account before you can post a new comment.

Sign up or log in to comment