test_trainer / tokenizer_config.json
lsb's picture
Create tokenizer_config.json
6fd8041 verified
raw
history blame contribute delete
48 Bytes
{"do_lower_case": true, "model_max_length": 512}