M3D-LaMed-Phi-3-4B / added_tokens.json
GoodBaiBai88's picture
Upload tokenizer
7252e07 verified
raw
history blame
378 Bytes
{
"<bx_end>": 32013,
"<bx_start>": 32012,
"<im_patch>": 32011,
"<|assistant|>": 32001,
"<|endoftext|>": 32000,
"<|end|>": 32007,
"<|placeholder1|>": 32002,
"<|placeholder2|>": 32003,
"<|placeholder3|>": 32004,
"<|placeholder4|>": 32005,
"<|placeholder5|>": 32008,
"<|placeholder6|>": 32009,
"<|system|>": 32006,
"<|user|>": 32010,
"[SEG]": 32014
}