Canstralian's picture
Create tokenizers/vocab.json
40d9120 verified
raw
history blame
255 Bytes
{
"[PAD]": 0,
"[UNK]": 1,
"[CLS]": 2,
"[SEP]": 3,
"the": 4,
"to": 5,
"and": 6,
"in": 7,
"of": 8,
"a": 9,
"is": 10,
"it": 11,
"you": 12,
"for": 13,
"that": 14,
"with": 15,
"this": 16,
"on": 17,
"was": 18,
"at": 19
}