Spaces:

Namitg02
/

Test

Runtime error

Namitg02 commited on Jun 24, 2024

Commit

7f59cc7

verified ·

1 Parent(s): 954e69d

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -41,11 +41,11 @@ You are given the extracted parts of documents and a question. Provide a convers
 If you don't know the answer, just say "I do not know." Don't make up an answer. Don't repeat the SYS_PROMPT."""
 # Provides context of how to answer the question
-llm_model = "TheBloke/TinyLlama-1.1B-Chat-v1.0-GGUF"
-# TheBloke/TinyLlama-1.1B-Chat-v1.0-GGUF and tinyllama-1.1b-chat-v1.0.Q4_K_M.gguf not working, TinyLlama/TinyLlama-1.1B-Chat-v0.6, andrijdavid/TinyLlama-1.1B-Chat-v1.0-GGUF"
 model = Llama(
-    model_path="./tinyllama-1.1b-chat-v1.0.Q4_K_M.gguf",
  #   chat_format="llama-2",
     n_gpu_layers = 0,
     temperature=0.75,

 If you don't know the answer, just say "I do not know." Don't make up an answer. Don't repeat the SYS_PROMPT."""
 # Provides context of how to answer the question
+#llm_model = "TheBloke/TinyLlama-1.1B-Chat-v1.0-GGUF"
+# TheBloke/TinyLlama-1.1B-Chat-v1.0-GGUF , TinyLlama/TinyLlama-1.1B-Chat-v0.6, andrijdavid/TinyLlama-1.1B-Chat-v1.0-GGUF"
 model = Llama(
+    model_path="./tinyllama-1.1b-chat-v1.0.Q5_K_M.gguf",
  #   chat_format="llama-2",
     n_gpu_layers = 0,
     temperature=0.75,