gngpostalsrvc pokameswaran commited on
Commit
18546b8
·
1 Parent(s): e5785b9

Added tokenizer from wav2vec2 base model (#1)

Browse files

- Added tokenizer from wav2vec2 base model (82fee0caf7340769916963f532efff45a69ecf7a)


Co-authored-by: Ponniah Kameswaran <[email protected]>

Files changed (1) hide show
  1. tokenizer_config.json +1 -0
tokenizer_config.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"unk_token": "<unk>", "bos_token": "<s>", "eos_token": "</s>", "pad_token": "<pad>", "do_lower_case": false, "return_attention_mask": true, "do_normalize": true}