How to use BLIP 2.0
Hi! I am unable to use BLIP 2.0 through the transformers library - I think the library needs to be updates still to have the model. Is there anyway to get around this?
Yes as the model is brand new you need to install Transformers from source for the moment:
pip install git+https://github.com/huggingface/transformers.git
I need it through the library unfortunately, how long does it usually take to get it into the library as well?
A new Transformers version will be released in March (typically a release is done every month).
@nielsr I am having a hard time downloading the model to colab because its so large and consumes all my RAM. Is this expected (and I should a cluster with more RAM) or is there some way around that? I had no problems with the other caption generation models.
I met an error when I run the model on GPU In full precision:
(base) wangson: CUDA_VISIBLE_DEVICES=0 python test.blip.py
Loading checkpoint shards: 100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 2/2 [00:06<00:00, 3.25s/it]
/home/anaconda/lib/python3.10/site-packages/transformers/generation/utils.py:1288: UserWarning: Using max_length's default (20) to control the generation length. This behaviour is deprecated and will be removed from the config in v5 of Transformers -- we recommend using max_new_tokens to control the maximum length of the generation.
How did this happen? Is this due to some packages' version diff?