Spaces:

ericbanzuzi
/

finetuned-llm

Sleeping

ericbanzuzi commited on Dec 3, 2024

Commit

bc20f46

1 Parent(s): ac0618d

update model

Files changed (1) hide show

app.py CHANGED Viewed

@@ -7,7 +7,7 @@ For more information on `huggingface_hub` Inference API support, please check th
 """
 llm = Llama.from_pretrained(
     repo_id="rcarioniporras/model",
-    filename="unsloth.Q4_K_M.gguf",
     verbose=False
 )

 """
 llm = Llama.from_pretrained(
     repo_id="rcarioniporras/model",
+    filename="/home/user/.cache/huggingface/hub/models--rcarioniporras--model/snapshots/e28b97f87f828ecdc56fff0bf947ba9d0b2ed0e9/unsloth.Q4_K_M.gguf",
     verbose=False
 )