RuntimeError: Tensor on device meta is not on the expected device cuda:0!
#6
by
abcdata
- opened
I get this error while running the model. Is there anyone knows about any solution for this situation?
"RuntimeError: Tensor on device meta is not on the expected device cuda:0!"
Hi, I also get this error.
I simply run the example code given to run the model on a gpu, and I run it on a Nvidia 4090 card.
I don't know if it results from the package versions.
Can you give the installing requirements?
Here are some of my installed versions:
accelerate 1.0.1
transformers 4.45.2
torch 2.5.0+cu121
Done.