Spaces:

ccm
/

chat-with-SFF

Sleeping

ccm commited on Nov 8, 2024

Commit

d5f3fea

verified ·

1 Parent(s): 0071c6a

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -75,7 +75,6 @@ llm = llama_cpp.Llama.from_pretrained(
     filename="Qwen2.5-7B-Instruct-Q4_K_M.gguf",
     n_gpu_layers=-1,
     n_ctx=2048,
-    n_threads=1,
     verbose=True
 )

     filename="Qwen2.5-7B-Instruct-Q4_K_M.gguf",
     n_gpu_layers=-1,
     n_ctx=2048,
     verbose=True
 )