Update README.md
Browse files
README.md
CHANGED
@@ -53,45 +53,3 @@ rewards = [[0.5811622738838196], [0.2745276093482971], [-1.4131819009780884], [-
|
|
53 |
3.webp: -1.41
|
54 |
4.webp: -2.03
|
55 |
```
|
56 |
-
|
57 |
-
## Test
|
58 |
-
|
59 |
-
### Setup for baselines
|
60 |
-
|
61 |
-
#### Environment
|
62 |
-
|
63 |
-
```bash
|
64 |
-
$ pip install git+https://github.com/openai/CLIP.git
|
65 |
-
```
|
66 |
-
|
67 |
-
#### Checkpoint
|
68 |
-
|
69 |
-
Models | File Paths | Download Links
|
70 |
-
--- | :---: | :---:
|
71 |
-
ImageReward | checkpoint/ | <a href="https://huggingface.co/THUDM/ImageReward/blob/main/ImageReward.pt">Download</a>
|
72 |
-
CLIP Score | checkpoint/clip/ | <a href="https://openaipublic.azureedge.net/clip/models/b8cca3fd41ae0c99ba7e8951adf17d267cdb84cd88be6f7c2e0eca1737a03836/ViT-L-14.pt">Download</a>
|
73 |
-
BLIP Score | checkpoint/blip/ | <a href="https://storage.googleapis.com/sfr-vision-language-research/BLIP/models/model_large.pth">Download</a>
|
74 |
-
Aesthetic | checkpoint/aesthetic/ | <a href="https://github.com/christophschuhmann/improved-aesthetic-predictor/raw/main/sac%2Blogos%2Bava1-l14-linearMSE.pth">Download</a>
|
75 |
-
|
76 |
-
#### Data
|
77 |
-
|
78 |
-
Data | File Paths | Download Links
|
79 |
-
--- | :---: | :---:
|
80 |
-
test_images | data/ | <a href="https://huggingface.co/THUDM/ImageReward/blob/main/test_images.zip">Download</a>
|
81 |
-
|
82 |
-
Download `test_images.zip` and unzip it to `data/test_images/`
|
83 |
-
|
84 |
-
### One step for test
|
85 |
-
|
86 |
-
```bash
|
87 |
-
$ python test.py
|
88 |
-
```
|
89 |
-
|
90 |
-
The test result is:
|
91 |
-
|
92 |
-
Models | Preference Acc.
|
93 |
-
--- | :---:
|
94 |
-
CLIP Score | 54.82
|
95 |
-
Aesthetic Score | 57.35
|
96 |
-
BLIP Score | 57.76
|
97 |
-
ImageReward (Ours) | **65.14**
|
|
|
53 |
3.webp: -1.41
|
54 |
4.webp: -2.03
|
55 |
```
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|