It is now possible to make GGML !!
#1
by
algorithm
- opened
Check it out: https://github.com/QwenLM/qwen.cpp
Would greatly appreciate it (if you have the time). If not, I understand.
Yea, defo ggml or gguf ver would be very appreciated.
This might be of interest. https://huggingface.co/TheBloke/Qwen-14B-Chat-GPTQ/discussions/2
Saw that link before I read this one. Likely it's on it's way.
Why no ggml ?
ggml, gguf any that would work on CPU thats what i meant :P