Spaces:

project-baize
/

chat-with-baize

Runtime error

project-baize commited on Apr 4, 2023

Commit

ed54557

•

1 Parent(s): 85f3d2d

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -41,7 +41,7 @@ def predict(text,
     else:
         prompt,inputs=inputs
         begin_length = len(prompt)
     input_ids = inputs["input_ids"].to(device)
     with torch.no_grad():

     else:
         prompt,inputs=inputs
         begin_length = len(prompt)
+    torch.cuda.empty_cache()
     input_ids = inputs["input_ids"].to(device)
     with torch.no_grad():