GPU Accelaration - Llama.cpp
#9
by
frbackup
- opened
Hi! I am running this on an Intel 16gb Mac 2019 using Llama.cpp, is there any way I could connect to the local GPU and accelarate performance?
Thanks!
do you have a dedicated GPU? should be able to offload to it with -ngl