infly
/

OpenCoder-1.5B-Instruct

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Siming Huang commited on 7 days ago

Commit

81c3370

•

1 Parent(s): c46e4b7

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -81,7 +81,7 @@ messages=[
 inputs = tokenizer.apply_chat_template(messages, add_generation_prompt=True, return_tensors="pt")
-outputs = model.generate(inputs, max_new_tokens=512, do_sample=False, num_return_sequences=1)
 result = tokenizer.decode(outputs[0], skip_special_tokens=True)
 print(result)

 inputs = tokenizer.apply_chat_template(messages, add_generation_prompt=True, return_tensors="pt")
+outputs = model.generate(inputs, max_new_tokens=512, do_sample=False)
 result = tokenizer.decode(outputs[0], skip_special_tokens=True)
 print(result)