Commit History

config: increase vocab size
3e656cd
verified

stefan-it commited on

tokenizer: rename spm model files
4e70b0d

stefan-it commited on

tokeniuer: add spm
f144f38

stefan-it commited on

tokenizer: add initial config
3dc595a

stefan-it commited on

config: add initial version
45f8a6a

stefan-it commited on

initial commit
3edf92c

stefan-it commited on