Anybody quantized it to GPTQ
#10
by
sparsh35
- opened
Not enough system Ram to quantize it if anybody has done that please give the links
Found it for AWQ , can use with VLLM , casperhansen/mistral-large-instruct-2407-awq
sparsh35
changed discussion status to
closed