Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up

isaacus
/

kanon-tokenizer

Model card Files Files and versions Community

kanon-tokenizer

1 contributor

History: 4 commits

umarbutler's picture

Rewording.

1070605 verified 4 days ago

.gitattributes

1.52 kB

initial commit 18 days ago
README.md

1.36 kB

Rewording. 4 days ago
merges.txt

670 kB

initial commit 18 days ago
special_tokens_map.json

1.08 kB

initial commit 18 days ago
tiktoken_tokenizer.json

1.3 MB

initial commit 18 days ago
tokenizer.json

2.9 MB

initial commit 18 days ago
tokenizer_config.json

1.34 kB

initial commit 18 days ago
vocab.json

1.12 MB

initial commit 18 days ago