pix2gestalt Model Weights

Code, Website, arXiv
pix2gestalt: Amodal Segmentation by Synthesizing Wholes
Ege Ozguroglu¹, Ruoshi Liu¹, Dídac Surís¹, Dian Chen², Achal Dave², Pavel Tokmakov², Carl Vondrick¹
¹Columbia University, ²Toyota Research Institute

pix2gestalt synthesizes whole objects from only partially visible ones, enabling amodal segmentation, recognition, and 3D reconstruction of occluded objects.

Citation

@misc{ozguroglu2024pix2gestalt,
      title={pix2gestalt: Amodal Segmentation by Synthesizing Wholes}, 
      author={Ege Ozguroglu and Ruoshi Liu and Dídac Surís and Dian Chen and Achal Dave and Pavel Tokmakov and Carl Vondrick},
      year={2024},
      eprint={2401.14398},
      archivePrefix={arXiv},
      primaryClass={cs.CV}
}

Acknowledgement

This research is based on work partially supported by the Toyota Research Institute, the DARPA MCS program under Federal Agreement No. N660011924032, the NSF NRI Award #1925157, and the NSF AI Institute for Artificial and Natural Intelligence Award #2229929. DS is supported by the Microsoft PhD Fellowship.