code-llama-python-finetune2 / added_tokens.json
ashwincv0112's picture
Upload tokenizer
5dc7c4f
raw
history blame
87 Bytes
{
"▁<EOT>": 32003,
"▁<MID>": 32001,
"▁<PRE>": 32000,
"▁<SUF>": 32002
}