pgdyn-simp / added_tokens.json
liamcripwell's picture
Upload tokenizer
f24ad1c
raw
history blame
181 Bytes
{
"<COPY>": 50270,
"<DELETE>": 50273,
"<REPHRASE>": 50271,
"<RL_0>": 50265,
"<RL_1>": 50266,
"<RL_2>": 50267,
"<RL_3>": 50268,
"<RL_4>": 50269,
"<SPLIT>": 50272
}