sentencepiece_ja / special_tokens_map.json
if001's picture
fix config
004c3d7
raw
history blame
121 Bytes
{"eos_token": "<EOS>", "unk_token": "<UNK>", "pad_token": "<PAD>", "bos_token": "<BOS>", "additional_special_tokens": []}