nb-npsc-test / added_tokens.json
Jethuestad's picture
add tokenizer
403fdf4
raw
history blame contribute delete
45 Bytes
{
"</s>": 54,
"<s>": 53,
"[PAD]": 55
}