fix device
#1
by
ariG23498
HF staff
- opened
The device="auto" does not work when we offload a torch tensor.
A better way to use is to map device to auto in the model, and later use model.device for offloading the input tensors!