Spaces:

sanket09
/

falcon-mini

Runtime error

matthoffner commited on Jul 9, 2023

Commit

64a8115

•

1 Parent(s): ab83be1

Update demo.py

Files changed (1) hide show

demo.py CHANGED Viewed

@@ -109,7 +109,7 @@ def chat():
         stream = llm(
             prompt,
             max_new_tokens=1024,
-            stop=[STOP_STR, ""],
             temperature=temperature,
             top_p=top_p,
             stream=True

         stream = llm(
             prompt,
             max_new_tokens=1024,
+            stop=[STOP_STR, "<|endoftext|>"],
             temperature=temperature,
             top_p=top_p,
             stream=True