sparql-tokenizer / tokenizer_config.json
felixb85's picture
add tokenizer
ef688d2
raw
history blame contribute delete
46 Bytes
{"tokenizer_class": "PreTrainedTokenizerFast"}