jjezabek's picture
Upload tokenizer
43a0e8f verified
raw
history blame contribute delete
53 Bytes
{
"<|end_of_turn|>": 32000,
"<|pad_0|>": 32001
}