Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up

Spaces:

mshukor
/

UnIVAL

Running

App Files Files Community

Fetching metadata from the HF Docker repository...

UnIVAL / fairseq /examples /m2m_100 /tokenizers

3 contributors

History: 1 commit

mshukor

init

26fd00c over 1 year ago

thirdparty
init over 1 year ago
README.md

733 Bytes

init over 1 year ago
seg_ja.sh

399 Bytes

init over 1 year ago
seg_ko.sh

397 Bytes

init over 1 year ago
tokenize_indic.py

727 Bytes

init over 1 year ago
tokenize_thai.py

323 Bytes

init over 1 year ago
tokenize_zh.py

309 Bytes

init over 1 year ago
tokenizer_ar.sh

758 Bytes

init over 1 year ago