Getting error when trying to infernce using example , or lmdeploy.
#7
by
v3ss0n
- opened
position_ids = position_ids.view(-1, seq_length).long()
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
RuntimeError: shape '[-1, 0]' is invalid for input of size 1827
pip install transformers==4.37.2
I don't know why but it works for me.
yes, transformers 4.37.2 is work.
zwgao
changed discussion status to
closed