andro-flock commited on
Commit
00b7088
·
verified ·
1 Parent(s): 40e3a03

Upload tokenizer

Browse files
added_tokens.json ADDED
The diff for this file is too large to render. See raw diff
 
merges.txt CHANGED
The diff for this file is too large to render. See raw diff
 
special_tokens_map.json CHANGED
The diff for this file is too large to render. See raw diff
 
tokenizer.json CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:91ff8f55267180a5c072ca55046440711b7c4371a8cfb5a0ea69047c39a4a594
3
- size 12130273
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:18547c209324b00e6d2d0ce1ed2a9984c4b3fb0cfe0562ad87ae87fb816a1a1f
3
+ size 10154752
tokenizer_config.json CHANGED
The diff for this file is too large to render. See raw diff
 
vocab.json CHANGED
The diff for this file is too large to render. See raw diff