test123 / added_tokens.json
mapama247's picture
Upload added_tokens.json
9cd8ea4
raw
history blame contribute delete
112 Bytes
{"<PAD>": 50268, "<SEP>": 50265, "<EOS>": 50267, "<QST>": 50263, "<BOS>": 50266, "<CTX>": 50262, "<ANS>": 50264}