Can't load tokenizer
#259
by
kaushalya
- opened
Failed to load the tokenizer with AutoTokenizer.from_pretrained("ctheodoris/Geneformer"). Did the tokenizer change?
OSError: Can't load tokenizer for 'ctheodoris/Geneformer'. If you were trying to load it from 'https://huggingface.co/models', make sure you don't have a local directory with the same name. Otherwise, make sure 'ctheodoris/Geneformer' is the correct path to a directory containing all relevant files for a BertTokenizerFast tokenizer.
Thank you for your interest in Geneformer! If you are trying to tokenize a scRNAseq dataset, please see the example notebook; you can use the tokenization module in this repository to do that. If you are trying to load the model, you can do so with BertForMaskedLM.from_pretrained for the pretrained model, BertForTokenClassification.from_pretrained for a gene classifier, or BertForSequenceClassification.from_pretrained for a cell classifier.
ctheodoris
changed discussion status to
closed