astroBERT / tokenizer_config.json

Commit History

Remove ` "add_special_tokens"` tokenizer config key
a4a1c6d
verified

jcrpaquin-cfa commited on

tokenizer max len and NER labels added
fdbc193

fgrezes commited on

astroBERT tokenizer nsp+mlm chkp 10350000
99bf156

fgrezes commited on