Text Generation
Transformers
PyTorch
gpt_bigcode
code
Eval Results
text-generation-inference

question about text-generation

#10
by sunzx0810 - opened

We meet an error 'list index out of range' while input question in local model, but it works well both on demo and text-generation webui, which is running the same code. I am very confused about it. I found that the answer will repeat the input question and it will also be counted in the token limits so as to raise error, But why does it work on webui or demo?

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment