Update README.md
Browse files
README.md
CHANGED
@@ -11,6 +11,10 @@ tags:
|
|
11 |
|
12 |
[TokenCompose_SD14_B](https://mlpc-ucsd.github.io/TokenCompose/) is a [latent text-to-image diffusion model](https://arxiv.org/abs/2112.10752) finetuned from the [**Stable-Diffusion-v1-4**](https://huggingface.co/CompVis/stable-diffusion-v1-4) checkpoint at resolution 512x512 on the [VSR](https://github.com/cambridgeltl/visual-spatial-reasoning) split of [COCO image-caption pairs](https://cocodataset.org/#download) for 24,000 steps with a learning rate of 5e-6. The training objective involves token-level grounding terms in addition to denoising loss for enhanced multi-category instance composition and photorealism. The "_A/B" postfix indicates different finetuning runs of the model using the same above configurations.
|
13 |
|
|
|
|
|
|
|
|
|
14 |
# 🧨Example Usage
|
15 |
|
16 |
We strongly recommend using the [🤗Diffuser](https://github.com/huggingface/diffusers) library to run our model.
|
@@ -99,4 +103,13 @@ image.save("cat_and_wine_glass.png")
|
|
99 |
</table>
|
100 |
|
101 |
# 📰 Citation
|
102 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
11 |
|
12 |
[TokenCompose_SD14_B](https://mlpc-ucsd.github.io/TokenCompose/) is a [latent text-to-image diffusion model](https://arxiv.org/abs/2112.10752) finetuned from the [**Stable-Diffusion-v1-4**](https://huggingface.co/CompVis/stable-diffusion-v1-4) checkpoint at resolution 512x512 on the [VSR](https://github.com/cambridgeltl/visual-spatial-reasoning) split of [COCO image-caption pairs](https://cocodataset.org/#download) for 24,000 steps with a learning rate of 5e-6. The training objective involves token-level grounding terms in addition to denoising loss for enhanced multi-category instance composition and photorealism. The "_A/B" postfix indicates different finetuning runs of the model using the same above configurations.
|
13 |
|
14 |
+
# 📄 Paper
|
15 |
+
|
16 |
+
Please follow [this](https://arxiv.org/abs/2312.03626) link.
|
17 |
+
|
18 |
# 🧨Example Usage
|
19 |
|
20 |
We strongly recommend using the [🤗Diffuser](https://github.com/huggingface/diffusers) library to run our model.
|
|
|
103 |
</table>
|
104 |
|
105 |
# 📰 Citation
|
106 |
+
```bibtex
|
107 |
+
@misc{wang2023tokencompose,
|
108 |
+
title={TokenCompose: Grounding Diffusion with Token-level Supervision},
|
109 |
+
author={Zirui Wang and Zhizhou Sha and Zheng Ding and Yilin Wang and Zhuowen Tu},
|
110 |
+
year={2023},
|
111 |
+
eprint={2312.03626},
|
112 |
+
archivePrefix={arXiv},
|
113 |
+
primaryClass={cs.CV}
|
114 |
+
}
|
115 |
+
```
|