m2-bert-80M-8k-retrieval / tokenizer.json

Commit History

Add bert-base-cased tokenizer with model_max_length: 8192
fdd629a

Tom Aarsen commited on