Spaces:

jaydenccc
/

AI-Storyteller-Space

Runtime error

jaydenccc commited on Apr 26, 2023

Commit

a4439c6

1 Parent(s): 5911668

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -22,7 +22,7 @@ def make_inference(synopsis):
     )
     with torch.cuda.amp.autocast():
-        output_tokens = model.generate(**batch, max_new_tokens=50)
     return tokenizer.decode(output_tokens[0], skip_special_tokens=True)

     )
     with torch.cuda.amp.autocast():
+        output_tokens = model.generate(**batch, max_new_tokens=200)
     return tokenizer.decode(output_tokens[0], skip_special_tokens=True)