is there another quant type?

by Aryanne - opened Aug 2

Aug 2

idk fp4 or q4, is it possible to convert it? it would be useful for lowvram and low ram devices

Owner Aug 3

it's not possible yet

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment