Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
shantipriya
/
OdiaTokenizer
like
1
OdiaGenAIdata/pre_train_odia_data_processed
Oriya
sentencepiece
License:
cc-by-nc-sa-4.0
Model card
Files
Files and versions
Community
main
OdiaTokenizer
1 contributor
History:
7 commits
shantipriya
Create tokenizer_config.json
ca15fcc
verified
3 months ago
.gitattributes
Safe
1.52 kB
initial commit
3 months ago
README.md
Safe
3.42 kB
Update README.md
3 months ago
config.json
Safe
248 Bytes
Create config.json
3 months ago
odia_tokenizers_test.model
Safe
1.37 MB
LFS
Add SentencePiece tokenizer model for Odia
3 months ago
odia_tokenizers_test.vocab
Safe
1.3 MB
Add SentencePiece tokenizer model for Odia
3 months ago
tokenizer_config.json
Safe
245 Bytes
Create tokenizer_config.json
3 months ago