Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up

malaysia-ai
/

sentencepiece-tokenizer

Model card Files Files and versions Community

sentencepiece-tokenizer

2 contributors

History: 2 commits

malaysia-ai2020's picture

malaysia-ai2020

Upload tokenizer

26c104e over 1 year ago

.gitattributes

1.52 kB

initial commit over 1 year ago
special_tokens_map.json

182 Bytes

Upload tokenizer over 1 year ago
tokenizer.json

1.44 MB

Upload tokenizer over 1 year ago
tokenizer_config.json

1.02 kB

Upload tokenizer over 1 year ago