Spaces:

ibm-granite
/

granite-guardian-3.1-8b

Running on Zero

Martín Santillán Cooper commited on 14 days ago

Commit

42e2cdc

•

1 Parent(s): a50a656

fix: chat variable doenst exist

Files changed (1) hide show

model.py CHANGED Viewed

@@ -167,7 +167,7 @@ def generate_text(messages, criteria_name):
         with torch.no_grad():
             # output = model.generate(chat, sampling_params, use_tqdm=False)
             output = model.generate(
-                chat,
                 do_sample=False,
                 max_new_tokens=nlogprobs,
                 return_dict_in_generate=True,

         with torch.no_grad():
             # output = model.generate(chat, sampling_params, use_tqdm=False)
             output = model.generate(
+                input_ids,
                 do_sample=False,
                 max_new_tokens=nlogprobs,
                 return_dict_in_generate=True,