Hugging Face's logo

Minami-su
/
Qwen1.5-0.5B-Chat_llamafy

Text Generation
Transformers
PyTorch
English
Chinese
llama
qwen
qwen1.5
qwen2
conversational
text-generation-inference
Model card Files Community
2
Minami-su commited on
Commit
25f2c6a
·
verified ·
1 Parent(s): 3c1fc4a

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -32,4 +32,4 @@ messages = [
32
  ]
33
  inputs = tokenizer.apply_chat_template(messages, tokenize=True, add_generation_prompt=True, return_tensors="pt")
34
  inputs = inputs.to("cuda")
35
- generate_ids = model.generate(inputs, streamer=streamer)
 
32
  ]
33
  inputs = tokenizer.apply_chat_template(messages, tokenize=True, add_generation_prompt=True, return_tensors="pt")
34
  inputs = inputs.to("cuda")
35
+ generate_ids = model.generate(inputs,max_length=2048, streamer=streamer)