GGUF model?
#7
by
bigfish3
- opened
Getting a quantisized version for this model will be great.@TheBloke
It is possible, at least partially:
Qwen is now officially supported by llama.cpp. You can try creating your own GGUF model~
jklj077
changed discussion status to
closed