devngho
/

phi4-mini-jamo-tokenizer

Model card Files Files and versions Community

devngho commited on 7 days ago

Commit

1be49a4

·

verified ·

1 Parent(s): 42497fb

Fix bos token

Files changed (1) hide show

tokenizer.json +2 -2

tokenizer.json CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:f530cd965aee4a46314f3f445564372078b53d247ad924e45262682d3a801170
-size 19688964

 version https://git-lfs.github.com/spec/v1
+oid sha256:2e72ec47a4940e1d4c3ba359270eeb50c60ff9791b0d212cdb7802a440fee965
+size 19689842