modern_french_normalisation / tokenizer_config.json

Commit History

commit files to HF hub
36c761d

rbawden commited on

commit files to HF hub
d60f838

rbawden commited on

udpated tok
22050c5

Rachel Bawden commited on

changed order of special tokens
0ceb0ce

Rachel Bawden commited on

redone tokeniser
d9498bd

Rachel Bawden commited on

updated tokeniser
16198b2

Rachel Bawden commited on

update tokenisation files
7470673

Rachel Bawden commited on

added converted fs model
08d8e1c

Rachel Bawden commited on