CodeLlama_Instruction_TunedV3 / added_tokens.json
ClaudiaRichard's picture
Upload tokenizer
dcf6462 verified
raw
history blame
105 Bytes
{
"[PAD]": 32004,
"▁<EOT>": 32003,
"▁<MID>": 32001,
"▁<PRE>": 32000,
"▁<SUF>": 32002
}