gpt2_dad_jokes / added_tokens.json
abhirajeshbhai's picture
Upload tokenizer
32b38bc
raw
history blame
101 Bytes
{
"<bos>": 50258,
"<eos>": 50259,
"<pad>": 50257,
"<|endoftext|>": 50256,
"JOKE:": 50260
}