Spaces:

matthoffner
/

serp-chat

Paused

matthoffner commited on May 23, 2023

Commit

081b510

1 Parent(s): fef1031

Update llm.py

Files changed (1) hide show

llm.py CHANGED Viewed

@@ -88,7 +88,7 @@ def construct_index(
     llm = LlamaCpp(
         model_path=model_path,
-        n_ctx=4096,
         use_mlock=True,
         n_parts=-1,
         temperature=0.7,

     llm = LlamaCpp(
         model_path=model_path,
+        n_ctx=2048,
         use_mlock=True,
         n_parts=-1,
         temperature=0.7,