punjabi_albert / added_tokens.json
mirfan899's picture
Upload tokenizer
2a2320e
raw
history blame
72 Bytes
{
"<pad>": 3206,
"[CLS]": 3204,
"[MASK]": 3207,
"[SEP]": 3205
}