Text Generation
Transformers
PyTorch
gpt_bigcode
code
Eval Results
text-generation-inference

RuntimeError: expected scalar type Half but found Char

#26
by RubixCole - opened

I am using this model the same way as I used 13b or vicuna, but with this one I am getting this error. Is there problem with some version of torch, langchain or any other liberary? What is the fix for it?

Thanks for help in advance.

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment