Spaces:

ggml-org
/

gguf-my-repo

Running on A10G

Update start.sh

#81

by reach-vb HF staff - opened Jun 11, 2024

←

Files changed (1) hide show

start.sh CHANGED Viewed

@@ -1,5 +1,5 @@
 cd llama.cpp
-make -j quantize gguf-split imatrix
 cd ..
 python app.py

 cd llama.cpp
+LLAMA_CUDA=1 make -j quantize gguf-split imatrix
 cd ..
 python app.py