model-garden-lms
/

bert-base-token-dropping-finewebs-951k

Model card Files Files and versions Community

bert-base-token-dropping-finewebs-951k / tokenizer_config.json

stefan-it's picture

tokenizer: add config and vocab

ad0db57 verified about 2 months ago

49 Bytes

{"do_lower_case": false, "model_max_length": 512}