AttributeError: 'QWenTokenizer' object has no attribute 'mergeable_ranks'

#46

by zlk - opened Nov 14, 2023

zlk

Nov 14, 2023

在Tokenizer的from_pretrained()报错

Qwen org Dec 21, 2023

请检查tokenization_qwen.py文件是否与HF Hub上的文件内容一致。

Jun 24

我也遇到了同样的问题，无解

Qwen org Jul 15

please use qwen2

jklj077 changed discussion status to closed Jul 15

Nov 26

怎么解决的呀？qwen2的模型也没有tokenization_qwen.py 这个文件

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment