XT-60M-v0.1 / added_tokens.json
styalai's picture
Upload tokenizer
1e638ff verified
raw
history blame contribute delete
197 Bytes
{
"</s>": 8001,
"<mask>": 8004,
"<pad>": 8003,
"<s>": 8000,
"<unk>": 8002,
"<|assistant|>": 8008,
"<|endoftext|>": 8005,
"<|end|>": 8007,
"<|system|>": 8009,
"<|user|>": 8006
}