Baichuan2-7B-Chat / tokenization_baichuan.py

Commit History

Update tokenization_baichuan.py
5e81b14

GradientGuru commited on

Fix BaichuanTokenizer to fit transformers>=4.34 (#8)
e837cb3

GradientGuru xu song commited on

Initial commit
d7183a9

GuoPD commited on