Hugging Face's logo

Spaces:
hArshi07
/
LLM-deployment-api
Runtime error

App Files Community
hArshi07 commited on
Commit
9322aba
·
verified ·
1 Parent(s): a7be9c7

Update main.py

Browse files
Files changed (1) hide show
  1. main.py +1 -1
main.py CHANGED
@@ -9,7 +9,7 @@ max_new_tokens = 1096,
9
  threads = 3,
10
  )
11
 
12
- llm = AutoModelForCausalLM.from_pretrained("codellama-7b-instruct.q4_K_M.gguf",
13
  model_type="llama",
14
  max_new_tokens = 1096,
15
  threads = 3,
 
9
  threads = 3,
10
  )
11
 
12
+ llm = AutoModelForCausalLM.from_pretrained("codellama-7b-instruct.Q4_K_M.gguf",
13
  model_type="llama",
14
  max_new_tokens = 1096,
15
  threads = 3,