Hugging Face's logo

Spaces:
bpandey23
/
bpandey23_llm
Sleeping

App Files Community
bpandey23 commited on
Commit
2a9023b
·
verified ·
1 Parent(s): 55c91ef

Update main.py

Browse files

changed the model name

Files changed (1) hide show
  1. main.py +1 -1
main.py CHANGED
@@ -3,7 +3,7 @@ from fastapi import FastAPI
3
  from pydantic import BaseModel
4
 
5
 
6
- llm = AutoModelForCausalLM.from_pretrained("zephyr-7b-beta.Q4_K_S.gguf",
7
  model_type='mistral',
8
  max_new_tokens = 1096,
9
  threads = 3,
 
3
  from pydantic import BaseModel
4
 
5
 
6
+ llm = AutoModelForCausalLM.from_pretrained("zephyr-7b-beta.Q8_0.gguf",
7
  model_type='mistral',
8
  max_new_tokens = 1096,
9
  threads = 3,