Phi-3-mini-tokenizer / added_tokens.json
AlexHT_Hung
Revert "Upload tokenizer"
6d96773
raw
history blame contribute delete
296 Bytes
{
"<|assistant|>": 32001,
"<|endoftext|>": 32000,
"<|end|>": 32007,
"<|placeholder1|>": 32002,
"<|placeholder2|>": 32003,
"<|placeholder3|>": 32004,
"<|tool_calls|>": 32005,
"<|function_metadata|>": 32008,
"<|tool_results|>": 32009,
"<|system|>": 32006,
"<|user|>": 32010
}