How do I load the model once the model files have been downloaded locally?
#8
by
abhisheksgumadi
- opened
Hello Team,
Thanks for the great work. I have downloaded all the repo files using git lfs locally onto disk.
How do I initialize the model and processor object using these files?
I tried doing
model = IdeficsForVisionText2Text.from_pretrained(checkpoint, torch_dtype=torch.bfloat16).to(device)
processor = AutoProcessor.from_pretrained(checkpoint)
but it takes a while and says Killed.
I have 32 GB RAM and a 24 GB A10 GPU on the AWS machine.
Thanks
This is now sorted. I was using the code the wrong way
abhisheksgumadi
changed discussion status to
closed