Spaces:

bkoz
/

bk-sandbox

Sleeping

bkoz commited on May 18, 2024

Commit

9030a60

1 Parent(s): e8b4f94

updated

Files changed (1) hide show

app.py CHANGED Viewed

@@ -15,7 +15,7 @@ pipe = pipeline("text-generation", "meta-llama/Meta-Llama-3-8B-Instruct", torch_
 @spaces.GPU
 def generate(prompt):
-    response = pipe(chat, max_new_tokens=512)
     r = response[0]['generated_text'][-1]['content']
     return r

 @spaces.GPU
 def generate(prompt):
+    response = pipe(prompt, max_new_tokens=512)
     r = response[0]['generated_text'][-1]['content']
     return r