larger gguf quantized versions

#1
by johnnnna - opened

Hi @Rybens thanks for the great work, I am trying this model and it looks promising.
Are you by any chance going to publish the higher versions in the future as well? (e.g. Q6/Q8)

Owner

Uploading

Owner

Uploaded, cheers

Sign up or log in to comment