Hugging Face's logo

Spaces:
ysharma
/
Explore_llamav2_with_TGI
Runtime error

App Files Community
132

Missing BOS token?

#57
by marclove - opened
base: refs/heads/main
←
from: refs/pr/57
Discussion Files changed
+1
-1
Files changed (1) hide show
  1. app.py +1 -1
app.py CHANGED
@@ -35,7 +35,7 @@ examples=[
35
 
36
  def predict(message, chatbot):
37
 
38
- input_prompt = f"[INST] <<SYS>>\n{system_message}\n<</SYS>>\n\n "
39
  for interaction in chatbot:
40
  input_prompt = input_prompt + str(interaction[0]) + " [/INST] " + str(interaction[1]) + " </s><s> [INST] "
41
 
 
35
 
36
  def predict(message, chatbot):
37
 
38
+ input_prompt = f"<s>[INST] <<SYS>>\n{system_message}\n<</SYS>>\n\n "
39
  for interaction in chatbot:
40
  input_prompt = input_prompt + str(interaction[0]) + " [/INST] " + str(interaction[1]) + " </s><s> [INST] "
41