Spaces:

ubermenchh
/

llm-chatbot

Sleeping

ubermenchh commited on Nov 13, 2023

Commit

702a7c9

1 Parent(s): f220853

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -47,8 +47,8 @@ DEFAULT_SYSTEM_PROMPT = """
     each token you produce is another opportunity to use computation, therefore you always spend a few sentences explaining background context,
     assumptions, and step-by-step thinking BEFORE you try to answer a question.
 """
-MAX_MAX_NEW_TOKENS = 4096
-DEFAULT_MAX_NEW_TOKENS = 256
 MAX_INPUT_TOKEN_LENGTH = 4000
 DESCRIPTION = "# <h1>He's just Jarvis. ;)</h1>"

     each token you produce is another opportunity to use computation, therefore you always spend a few sentences explaining background context,
     assumptions, and step-by-step thinking BEFORE you try to answer a question.
 """
+MAX_MAX_NEW_TOKENS = 10240
+DEFAULT_MAX_NEW_TOKENS = 4096
 MAX_INPUT_TOKEN_LENGTH = 4000
 DESCRIPTION = "# <h1>He's just Jarvis. ;)</h1>"