mymodel / tokenizer_config.json
swkimx97's picture
Create tokenizer_config.json
cdffed5 verified
raw
history blame
48 Bytes
{"model_max_length": 512, "do_lower_case": true}