Hello, I am having issues quantizing 70b models, would you be able to provide the script and list the hardware or service provider you used to quantize the model? I have rented h100s on runpod and still been unable to quantize a 70b with AWQ. Thank you!
