Spaces:

sanket09
/

falcon-mini

Runtime error

matthoffner commited on Jul 8, 2023

Commit

3b28b9e

1 Parent(s): eac87d5

Update demo.py

Files changed (1) hide show

demo.py CHANGED Viewed

@@ -3,7 +3,7 @@ from ctransformers import AutoModelForCausalLM
 import gradio as gr
-llm = AutoModelForCausalLM.from_pretrained("TheBloke/falcon-7b-instruct-GGML", model_file="falcon7b-instruct.ggmlv3.q4_0.bin",
                                            model_type="falcon", threads=8)

 import gradio as gr
+llm = AutoModelForCausalLM.from_pretrained("TheBloke/falcon-7b-instruct-GGML/ggmlv3", model_file="falcon-7b-instruct.ggccv1.q4_0.bin",
                                            model_type="falcon", threads=8)