Qwen2-vl quants are missing mmproj.
#504
by
chibop
- opened
Llama-qwen2vl-cli from Llama.cpp needs mmproj model, but quants on
@mradermacher
are missing mmproj models.
Can we have mmproj models for both Qwen2-vl and Qwen2-vl-abliterated?
Thanks!
We don't normally provide mmproj files because they are not quantized. If you need the vision part, you cna use any other mproj file for the model, e.g. the one from bartowski. They should all be identical.
Ah thanks. It would be useful information to have on the model page where to get those. :)
chibop
changed discussion status to
closed