TinyDolphin-2.8.1b-jagr / added_tokens.json
Sandrian's picture
Upload tokenizer
beb2b20 verified
raw
history blame
90 Bytes
{
"</s>": 2,
"<s>": 1,
"<unk>": 0,
"<|im_end|>": 32000,
"<|im_start|>": 32001
}