Pallas-0.3 / added_tokens.json
Mihaiii's picture
Upload tokenizer
41f1bd0
raw
history blame contribute delete
36 Bytes
{
"</s>": 64001,
"<s>": 64000
}