Hugging Face's logo

Qwen
/
Qwen2-VL-7B-Instruct-GPTQ-Int8

Image-Text-to-Text
Safetensors
English
qwen2_vl
multimodal
conversational
8-bit precision
gptq
Model card Files Community
3

Docker Image of Quantized Model

#2
by neovest - opened
Discussion
neovest

Hello ,

Is there a docker image we can use for the Quantized (8/4) model that can run on CPU VM ? If not please help as the Model import is failing although all dependencies are installed. Thanks

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment