Commit History

make `tokenizer_class` same as the actual class name
c2feee1
verified

tmanabe commited on

Update distilbert_japanese_tokenizer.py (#4)
93bd481

kajyuuen liwii commited on

Allow only unidic_lite (#2)
bcbdf6d

kajyuuen commited on

Improve tokenizers (#1)
1220bcd

kajyuuen commited on

Disable inference
e467730

kajyuuen commited on

Fix url
c24f0d3

kajyuuen commited on

Initial commit
a7345ac

kajyuuen commited on