modern_french_normalisation / tokenizer.json

Commit History

commit files to HF hub
d60f838

rbawden commited on

changed special token order
8372434

Rachel Bawden commited on

redone tokeniser
d9498bd

Rachel Bawden commited on

updated tokeniser
16198b2

Rachel Bawden commited on

changed spm tokeniser
e7a1daa

Rachel Bawden commited on

changed spm tokeniser
cf76848

Rachel Bawden commited on

changed spm tokeniser
3dc8a40

Rachel Bawden commited on

changed spm tokeniser
a16187a

Rachel Bawden commited on

changed spm tokeniser
7e5cb53

Rachel Bawden commited on

changed spm tokeniser
9ec6a18

Rachel Bawden commited on

udpated merge order
987e461

Rachel Bawden commited on

udpated merge order
aaae445

Rachel Bawden commited on

udpated merge order
0353a7d

Rachel Bawden commited on

udpated merge order
9e03c1b

Rachel Bawden commited on

updated vocab
88943c4

Rachel Bawden commited on

updated vocab
5bfe9e0

Rachel Bawden commited on

updated vocab
0063fcd

Rachel Bawden commited on

regenerated model
97fc4a6

Rachel Bawden commited on

regenerated model
7f8e13c

Rachel Bawden commited on

added converted fs model
08d8e1c

Rachel Bawden commited on