hmm-tokenizer / special_tokens_map.json
fenguhao's picture
Upload tokenizer
e9e0c9c verified
raw
history blame
43 Bytes
{
"bos_token": "0",
"eos_token": "1"
}