Commit
•
6634350
1
Parent(s):
8e6962c
Update README.md
Browse files
README.md
CHANGED
|
@@ -12,15 +12,13 @@ license: mit
|
|
| 12 |
CVPR 2023
|
| 13 |
|
| 14 |
|
| 15 |
-
<br>
|
| 16 |
|
| 17 |
|
| 18 |
|
| 19 |
-
<br>
|
| 20 |
|
| 21 |
</div>
|
| 22 |
|
| 23 |
-
|
| 24 |
|
| 25 |
We present Painter, a generalist model using an "image"-centric solution for in-context visual learning, that is, to redefine the output of core vision tasks as images, and specify task prompts as also images. With this idea, our training process is extremely simple, which performs standard masked image modeling on the stitch of input and output image pairs. This makes the model capable of performing tasks conditioned on visible image patches. Thus, during inference, we can adopt a pair of input and output images from the same task as the input condition, to indicate which task to perform. Examples of in-context inference are illustrated in the figure above, consisting of seven in-domain examples (seven rows at top) and three out-of-domain examples (three rows at bottom).
|
| 26 |
Without bells and whistles, our generalist Painter can achieve competitive performance compared to well-established task-specific models, on seven representative vision tasks ranging from high-level visual understanding to low-level image processing.
|
|
|
|
| 12 |
CVPR 2023
|
| 13 |
|
| 14 |
|
|
|
|
| 15 |
|
| 16 |
|
| 17 |
|
|
|
|
| 18 |
|
| 19 |
</div>
|
| 20 |
|
| 21 |
+
|
| 22 |
|
| 23 |
We present Painter, a generalist model using an "image"-centric solution for in-context visual learning, that is, to redefine the output of core vision tasks as images, and specify task prompts as also images. With this idea, our training process is extremely simple, which performs standard masked image modeling on the stitch of input and output image pairs. This makes the model capable of performing tasks conditioned on visible image patches. Thus, during inference, we can adopt a pair of input and output images from the same task as the input condition, to indicate which task to perform. Examples of in-context inference are illustrated in the figure above, consisting of seven in-domain examples (seven rows at top) and three out-of-domain examples (three rows at bottom).
|
| 24 |
Without bells and whistles, our generalist Painter can achieve competitive performance compared to well-established task-specific models, on seven representative vision tasks ranging from high-level visual understanding to low-level image processing.
|