TinyAiroboros-2.2.1 / added_tokens.json
aloobun's picture
Upload tokenizer
361bafc
raw
history blame
69 Bytes
{
"<|im_end|>": 32002,
"<|im_start|>": 32001,
"[PAD]": 32000
}