Rename tokenizer_vocab.json to tokenizer/tokenizer_vocab.json 7b41358 verified Fabrice-TIERCELIN commited on Apr 18, 2024
Rename tokenizer_tokenizer_config.json to tokenizer/tokenizer_tokenizer_config.json 2456f9e verified Fabrice-TIERCELIN commited on Apr 18, 2024
Rename tokenizer_special_tokens_map.json to tokenizer/tokenizer_special_tokens_map.json b68cfc2 verified Fabrice-TIERCELIN commited on Apr 18, 2024
Rename tokenizer_merges.txt to tokenizer/tokenizer_merges.txt 649449d verified Fabrice-TIERCELIN commited on Apr 18, 2024