tencent

/

Hunyuan-7B-Instruct-0124

like 51

Follow

Tencent 4.78k

In config.json, "AutoModel": "modeling_hunyuan.HunyuanModel" [1].
Here the name is "HunyuanModel" (y in lower case) , doesn't match the class name "HunYuanModel" (Y in upper case) in source code [2].
vLLM error out due this mismatch, it cannot find the class.

[1] https://huggingface.co/tencent/Hunyuan-7B-Instruct-0124/blob/main/config.json#L10
[2] https://huggingface.co/tencent/Hunyuan-7B-Instruct-0124/blob/main/modeling_hunyuan.py#L1933