wavelet-dev
/

eeg2meg-tokenizer

Model card Files Files and versions

gabrycina commited on Jan 27

Commit

05db8dc

·

verified ·

1 Parent(s): e312124

Upload tokenizer files

Files changed (1) hide show

tokenizer_config.json +2 -2

tokenizer_config.json CHANGED Viewed

@@ -3,8 +3,8 @@
   "tokenizer_class": "WaveletTokenizer",
   "auto_map": {
     "AutoTokenizer": [
-      "transformers",
-      "WaveletTokenizer"
     ]
   },
   "vocab_size": 256,

   "tokenizer_class": "WaveletTokenizer",
   "auto_map": {
     "AutoTokenizer": [
+      "tokenizer.WaveletTokenizer",
+      null
     ]
   },
   "vocab_size": 256,