Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
Spaces:
Duplicated from
yenniejun/tokenizers-languages
iansun-sh
/
tokenizers-languages
like
0
Running
App
Files
Files
Community
Fetching metadata from the HF Docker repository...
40b05d1
tokenizers-languages
Ctrl+K
Ctrl+K
3 contributors
History:
35 commits
yenniejun
Add barchart showing shortest/longest median tokenized text
40b05d1
verified
about 1 year ago
.github
Create sync_hf_hub.yaml for syncing repo to HF
about 2 years ago
img
Adding images for README
about 2 years ago
.gitattributes
Safe
1.55 kB
Upload 2 files
about 1 year ago
LICENSE.txt
Safe
20.8 kB
Adding license
about 2 years ago
MassiveDatasetValidationData.csv
Safe
26.7 MB
LFS
Upload 2 files
about 1 year ago
README.md
Safe
1.69 kB
Updating link to blog post
over 1 year ago
app.py
Safe
7.61 kB
Add barchart showing shortest/longest median tokenized text
about 1 year ago
requirements.txt
Safe
1.08 kB
Update requirements.txt
about 1 year ago