Spaces:

jchwenger
/

DMLAP.07_language-models_3_chatbots

Sleeping

jchwenger commited on Nov 16, 2023

Commit

c4ed4fa

1 Parent(s): 41bc014

app | "cuda" → device fix

Files changed (1) hide show

app.py CHANGED Viewed

@@ -72,7 +72,7 @@ def predict(message, history):
     # print("-" * 40)
     # convert the string into tensors & move to GPU
-    model_inputs = tokenizer([messages], return_tensors="pt").to("cuda")
     streamer = TextIteratorStreamer(tokenizer, timeout=30., skip_prompt=True, skip_special_tokens=True)
     generate_kwargs = dict(

     # print("-" * 40)
     # convert the string into tensors & move to GPU
+    model_inputs = tokenizer([messages], return_tensors="pt").to(device)
     streamer = TextIteratorStreamer(tokenizer, timeout=30., skip_prompt=True, skip_special_tokens=True)
     generate_kwargs = dict(