README.md

metadata

base_model:
  - Qwen/Qwen2-VL-7B-Instruct

EXL2 Quantizations of Qwen2-VL-7B-Instruct

Using exllamav2 release 0.2.6 for quantization.

Original model: https://huggingface.co/Qwen/Qwen2-VL-7B-Instruct

Bits 8.0, lm_head 8.0