Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up

malaysia-ai
/

sentencepiece-tokenizer

Model card Files Files and versions Community

sentencepiece-tokenizer

2 contributors

History: 5 commits

huseinzol05's picture

Upload tokenizer

bc485ee over 1 year ago

.gitattributes

1.52 kB

initial commit over 1 year ago
special_tokens_map.json

182 Bytes

Upload tokenizer over 1 year ago
tokenizer.json

1.34 MB

Upload tokenizer over 1 year ago
tokenizer_config.json

1.02 kB

Upload tokenizer over 1 year ago