Hugging Face's logo

Spaces:
acbdkk
/
aiaa
Runtime error

App Files Community
acbdkk commited on
Commit
c0ac6ac
·
verified ·
1 Parent(s): 4766243

Update main.py

Browse files
Files changed (1) hide show
  1. main.py +1 -1
main.py CHANGED
@@ -4,7 +4,7 @@ from pydantic import BaseModel
4
 
5
 
6
  llm = AutoModelForCausalLM.from_pretrained("qwen2-7b-instruct-q4_k_m.gguf",
7
- model_type='qwen',
8
  max_new_tokens = 1096,
9
  threads = 3,
10
  )
 
4
 
5
 
6
  llm = AutoModelForCausalLM.from_pretrained("qwen2-7b-instruct-q4_k_m.gguf",
7
+ model_type='gguf',
8
  max_new_tokens = 1096,
9
  threads = 3,
10
  )