Patsorn commited on
Commit
751e6db
·
unverified ·
1 Parent(s): c8d43cf

update readme.md

Browse files
Files changed (1) hide show
  1. README.md +11 -8
README.md CHANGED
@@ -1,7 +1,9 @@
1
  # Image Retrieval with Text and Sketch
2
- This code is for our 2022 ECCV paper [[A Sketch Is Worth a Thousand Words: Image Retrieval with Text and Sketch]](https://patsorn.me/projects/tsbir/)
3
 
4
- <img src="https://patsorn.me/projects/tsbir/img/teaser_web_mini.jpg" width="900px"/>
 
 
5
 
6
  ---------------------
7
  folder structure
@@ -9,24 +11,25 @@ folder structure
9
  |---model/ : Contain the trained model*
10
  |---sketches/ : Contain example query sketch
11
  |---images/ : Contain 100 randomly sampled images from COCO TBIR benchmark
12
- |---notebooks/ : Contain the demo ipynb notebook (can run via Colab)
13
  |---code/
14
  |---training/model_configs/ : Contain model config file for the network
15
  |---clip/ : Contain source code for running the notebook
16
 
17
- *model can be downloaded from https://patsorn.me/projects/tsbir/data/tsbir_model_final.pt
18
-
19
- This repo is based on open_clip implementation from https://github.com/mlfoundations/open_clip
20
 
21
  ## Prerequisites
22
  - Pytorch
23
 
24
  ## Getting Started
25
 
26
- Simply run notebooks/Retrieval_Demo.ipynb, you can use your own set of images and sketches by modifying the images/ and sketches/ folder accordingly.
 
 
 
 
27
 
28
  ## Download Models
29
- Pre-trained models
30
  - <a href='https://patsorn.me/projects/tsbir/data/tsbir_model_final.pt' > Pre-trained models </a>
31
 
32
  ## Citation
 
1
  # Image Retrieval with Text and Sketch
2
+ This code is for our 2022 ECCV paper [A Sketch Is Worth a Thousand Words: Image Retrieval with Text and Sketch](https://patsorn.me/projects/tsbir/)
3
 
4
+ <img src="https://patsorn.me/projects/tsbir/img/teaser_web_mini.jpg" width="800px"/>
5
+
6
+ This repo is based on open_clip implementation from https://github.com/mlfoundations/open_clip
7
 
8
  ---------------------
9
  folder structure
 
11
  |---model/ : Contain the trained model*
12
  |---sketches/ : Contain example query sketch
13
  |---images/ : Contain 100 randomly sampled images from COCO TBIR benchmark
14
+ |---notebooks/ : Contain the demo ipynb notebook
15
  |---code/
16
  |---training/model_configs/ : Contain model config file for the network
17
  |---clip/ : Contain source code for running the notebook
18
 
19
+ *need to be downloaded first
 
 
20
 
21
  ## Prerequisites
22
  - Pytorch
23
 
24
  ## Getting Started
25
 
26
+ - Simply open jupyter notebook in `notebooks/Retrieval_Demo.ipynb` for an example of how to retrieve images using our model,
27
+
28
+ - You can use your own set of images and sketches by modifying the `images/` and `sketches/` folder accordingly.
29
+
30
+ - Colab version of the notebook is available [[here]](https://colab.research.google.com/)
31
 
32
  ## Download Models
 
33
  - <a href='https://patsorn.me/projects/tsbir/data/tsbir_model_final.pt' > Pre-trained models </a>
34
 
35
  ## Citation