evo-1-131k-base / tokenizer_config.json

Commit History

Update byte tokenizer to be compatible with auto tokenizer and clean-up.
158e9d1
verified

pragaash commited on

Create tokenizer_config.json
2c3da52
verified

Zymrael commited on