Spaces:

cedpsam
/

mistral_openorca_lamacpp

Runtime error

cedpsam commited on Oct 23, 2023

Commit

3b13a4c

1 Parent(s): b4905cb

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -20,7 +20,7 @@ hf_hub_download(repo_id=repo_id,
 llm = LlamaCpp(
         model_path=model_name,
         callback_manager=callback_manager,
         verbose=True, # Verbose is required to pass to the callback manager
     )

 llm = LlamaCpp(
         model_path=model_name,
+        n_ctx=4096,
         callback_manager=callback_manager,
         verbose=True, # Verbose is required to pass to the callback manager
     )