Spaces:

sanket09
/

falcon-mini

Runtime error

matthoffner commited on Jul 8, 2023

Commit

ea6202c

1 Parent(s): 9c7ac5f

Update demo.py

Files changed (1) hide show

demo.py CHANGED Viewed

@@ -3,7 +3,7 @@ from ctransformers import AutoModelForCausalLM
 import gradio as gr
-llm = AutoModelForCausalLM.from_pretrained("TheBloke/falcon-7b-instruct-GGML/ggmlv3", model_file="falcon-7b-instruct.ggccv1.q4_0.bin",
                                            model_type="falcon", threads=8)

 import gradio as gr
+llm = AutoModelForCausalLM.from_pretrained("falcon7b-instruct.ggmlv3.q4_0.bin",
                                            model_type="falcon", threads=8)