Update added_tokens.json
Browse filesTo resolve this error : AssertionError: Non-consecutive added token ' <=' found. Should have index 32102 but has index 32100 in saved vocabulary.
- added_tokens.json +1 -1
added_tokens.json
CHANGED
@@ -1 +1 @@
|
|
1 |
-
{" <": 32101, " <=":
|
|
|
1 |
+
{" <": 32101, " <=": 32102}
|