Commit History
Update README.md
8eb9480
verified
Update README.md
36216cf
verified
Update batch encode plus first argument to match HF convention.
28fe393
verified
Update model.py
60eb4c7
verified
Update README.md
4a59285
verified
add pt ckpt
c9e2eda
Zymrael
commited on
Update README.md
3fa0ba0
verified
Fix auto tokenizer import reference format in auto map as list for slow and fast.
a9a132f
Pragaash
commited on
Replace tokenizer class with auto map for relative import of byte tokenizer.
72e0b3e
verified
Add tokenizer import reference to auto_map in config.json.
29194e9
verified
Remove tokenizer.json and replace tokenizer.py with correct version.
ebac1e8
verified
Update byte tokenizer to be compatible with auto tokenizer and clean-up.
158e9d1
verified
Update README.md
a7706a0
verified
Update tokenizer.py
bc8a8a8
verified
Update config.json
2e39d14
verified
Update README.md
b5ba251
verified
Update README.md
1e60015
verified
Update config.json
474761f
verified
Update tokenizer.py
a35de04
verified
Create tokenizer_config.json
2c3da52
verified
Update tokenizer.py
fa9cf26
verified
Update README.md
8da0917
verified
Update README.md
7ee12e6
verified
Update README.md
95173c3
verified
Create README.md
9c58b80
verified
init
27140ac
Zymrael
commited on