CS224S_Quechua_Project / added_tokens.json
cportoca's picture
Upload tokenizer
c3bcf24 verified
raw
history blame contribute delete
30 Bytes
{
"</s>": 30,
"<s>": 29
}