mil_ai_kolima-fine-tuned / added_tokens.json
1kmmk1's picture
Upload tokenizer
9bd4710 verified
raw
history blame contribute delete
65 Bytes
{
"<|endoftext|>": 51200,
"[EOS]": 51202,
"[PAD]": 51201
}