Hugging Face's logo

Spaces:
sanket09
/
falcon-mini
Runtime error

App Files Community
matthoffner commited on
Commit
58d7dae
•
1 Parent(s): b979e0d

Update demo.py

Browse files
Files changed (1) hide show
  1. demo.py +1 -1
demo.py CHANGED
@@ -4,7 +4,7 @@ import gradio as gr
4
 
5
 
6
  llm = AutoModelForCausalLM.from_pretrained("TheBloke/falcon-7b-instruct-GGML", model_file="falcon7b-instruct.ggmlv3.q4_0.bin",
7
- model_type="falcon", threads=10)
8
 
9
 
10
  TITLE = """<h2 align="center">🕊️ Falcon-Chat ggml 🕊️"""
 
4
 
5
 
6
  llm = AutoModelForCausalLM.from_pretrained("TheBloke/falcon-7b-instruct-GGML", model_file="falcon7b-instruct.ggmlv3.q4_0.bin",
7
+ model_type="falcon", threads=20)
8
 
9
 
10
  TITLE = """<h2 align="center">🕊️ Falcon-Chat ggml 🕊️"""