pkscanvas commited on
Commit
fd71d2f
·
1 Parent(s): 2899ad9

Update added_tokens.json

Browse files

To resolve this error : AssertionError: Non-consecutive added token ' <=' found. Should have index 32102 but has index 32100 in saved vocabulary.

Files changed (1) hide show
  1. added_tokens.json +1 -1
added_tokens.json CHANGED
@@ -1 +1 @@
1
- {" <": 32101, " <=": 32100}
 
1
+ {" <": 32101, " <=": 32102}