Hugging Face's logo

Spaces:
huedaya
/
llm-fastapi-1
Runtime error

App Files Community
huedaya commited on
Commit
abd2555
·
verified ·
1 Parent(s): 1a20237

Update main.py

Browse files
Files changed (1) hide show
  1. main.py +1 -1
main.py CHANGED
@@ -26,7 +26,7 @@ class Item(BaseModel):
26
  history: list
27
  system_prompt: str
28
  temperature: float = 0.0
29
- max_new_tokens: int = 15000
30
  top_p: float = 0.15
31
  repetition_penalty: float = 1.0
32
 
 
26
  history: list
27
  system_prompt: str
28
  temperature: float = 0.0
29
+ max_new_tokens: int = 2048
30
  top_p: float = 0.15
31
  repetition_penalty: float = 1.0
32