HIT-TMG
/

KaLM-embedding-multilingual-mini-unsupervised

Model card Files Files and versions

YanshekWoo commited on Mar 12

Commit

997ec06

·

verified ·

1 Parent(s): 1d0d758

Update tokenizer_config.json

Files changed (1) hide show

tokenizer_config.json +2 -2

tokenizer_config.json CHANGED Viewed

@@ -32,8 +32,8 @@
   ],
   "auto_map": {
     "AutoTokenizer": [
-      "tokenization_qwen.Qwen2Tokenizer",
-      "tokenization_qwen.Qwen2TokenizerFast"
     ]
   },
   "bos_token": null,

   ],
   "auto_map": {
     "AutoTokenizer": [
+      "Qwen2Tokenizer",
+      "Qwen2TokenizerFast"
     ]
   },
   "bos_token": null,