add tokenizer
Browse files- added_tokens.json +1 -0
added_tokens.json
ADDED
@@ -0,0 +1 @@
|
|
|
|
|
1 |
+
{"[MASK]": 128000}
|
@@ -0,0 +1 @@
|
|
|
|
|
1 |
+
{"[MASK]": 128000}
|