3bit quant?

by llama-anon - opened Aug 15, 2023

Aug 15, 2023

a 3bit gptq quant would allow this model to work on 12gig cards

llama-anon changed discussion title from 3bit quant to 3bit quant? Aug 15, 2023

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Your need to confirm your account before you can post a new comment.

· Sign up or log in to comment