Spaces:

patpizio
/

llm-token-probs

Sleeping

patpizio commited on Jul 9, 2023

Commit

090b788

1 Parent(s): 4dd3f28

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -25,7 +25,7 @@ inputs = tokenizer(
     prompts[0],
     return_tensors="pt",
 )
-# input_ids = inputs["input_ids"].to("cuda")
 if instruction:
     st.write(tokenizer.decode(input_ids[0]))

     prompts[0],
     return_tensors="pt",
 )
+input_ids = inputs["input_ids"]#.to("cuda")
 if instruction:
     st.write(tokenizer.decode(input_ids[0]))