Error when trying to use vLLM as the backend
#3
by
BiboyQG
- opened
AttributeError: 'MergedColumnParallelLinear' object has no attribute 'weight'. Did you mean: 'qweight'?
I assume this is an vLLM issue, so will close now.
BiboyQG
changed discussion status to
closed