mongolian-tokenizer-unigram / added_tokens.json
Billyyy's picture
Upload tokenizer
b54741a verified
raw
history blame contribute delete
21 Bytes
{
"<pad>": 32000
}