Llava-1.6 34B AWQ

You need to use this forked, https://github.com/WanBenLe/AutoAWQ-with-llava-v1.6

Downloads last month
10
Safetensors
Model size
5.76B params
Tensor type
I32
BF16
FP16
Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.