8-bit version
#1
by
ayahareedy
- opened
Please can you upload the 8-bit version
yes, Q8_0 would be great.
yes, Q8_0 would be great.
yup, that is the plan, but at the moment the issues lies with the llama quantize, it's having issues with the sd3 arch. city96 is looking into figuring it out. https://github.com/city96/ComfyUI-GGUF/issues/136 so as soon as a working quantize method works, will get more up.
Please can you upload the 8-bit version
yup, that is the plan, but at the moment the issues lies with the llama quantize, it's having issues with the sd3 arch. city96 is looking into figuring it out. https://github.com/city96/ComfyUI-GGUF/issues/136 so as soon as a working quantize method works, will get more up.
Files are uploaded of various quants
ND911
changed discussion status to
closed