BLIP_fine_tune / README.md
datnguyentien204's picture
Update README.md
b927a0f verified

Visual Question Answering using BLIP pre-trained model!

This implementation applies the BLIP pre-trained model to solve the icon domain task. The BLIP model for VQA task

enter image description here
How many dots are there? 36

Description

**Note: The test dataset does not have labels. I evaluated the model via Kaggle competition and got 96% in accuracy manner. Obviously, you can use a partition of the training set as a testing set.

Create data folder

Copy all data following the example form You can download data here

Install requirements.txt

pip install -r requirements.txt

Run finetuning code

python finetuning.py

Run prediction

python predicting.py