Spaces:
Running
on
Zero
Running
on
Zero
# DensePose in Detectron2 | |
DensePose aims at learning and establishing dense correspondences between image pixels | |
and 3D object geometry for deformable objects, such as humans or animals. | |
In this repository, we provide the code to train and evaluate DensePose R-CNN and | |
various tools to visualize DensePose annotations and results. | |
There are two main paradigms that are used within DensePose project. | |
## [Chart-based Dense Pose Estimation for Humans and Animals](doc/DENSEPOSE_IUV.md) | |
<div align="center"> | |
<img src="https://dl.fbaipublicfiles.com/densepose/web/densepose_teaser_compressed_25.gif" width="700px" /> | |
</div> | |
For chart-based estimation, 3D object mesh is split into charts and | |
for each pixel the model estimates chart index `I` and local chart coordinates `(U, V)`. | |
Please follow the link above to find a [detailed overview](doc/DENSEPOSE_IUV.md#Overview) | |
of the method, links to trained models along with their performance evaluation in the | |
[Model Zoo](doc/DENSEPOSE_IUV.md#ModelZoo) and | |
[references](doc/DENSEPOSE_IUV.md#References) to the corresponding papers. | |
## [Continuous Surface Embeddings for Dense Pose Estimation for Humans and Animals](doc/DENSEPOSE_CSE.md) | |
<div align="center"> | |
<img src="https://dl.fbaipublicfiles.com/densepose/web/densepose_cse_teaser.png" width="700px" /> | |
</div> | |
To establish continuous surface embeddings, the model simultaneously learns | |
descriptors for mesh vertices and for image pixels. | |
The embeddings are put into correspondence, thus the location | |
of each pixel on the 3D model is derived. | |
Please follow the link above to find a [detailed overview](doc/DENSEPOSE_CSE.md#Overview) | |
of the method, links to trained models along with their performance evaluation in the | |
[Model Zoo](doc/DENSEPOSE_CSE.md#ModelZoo) and | |
[references](doc/DENSEPOSE_CSE.md#References) to the corresponding papers. | |
# Quick Start | |
See [ Getting Started ](doc/GETTING_STARTED.md) | |
# Model Zoo | |
Please check the dedicated pages | |
for [chart-based model zoo](doc/DENSEPOSE_IUV.md#ModelZoo) | |
and for [continuous surface embeddings model zoo](doc/DENSEPOSE_CSE.md#ModelZoo). | |
# What's New | |
* June 2021: [DensePose CSE with Cycle Losses](doc/RELEASE_2021_06.md) | |
* March 2021: [DensePose CSE (a framework to extend DensePose to various categories using 3D models) | |
and DensePose Evolution (a framework to bootstrap DensePose on unlabeled data) released](doc/RELEASE_2021_03.md) | |
* April 2020: [DensePose Confidence Estimation and Model Zoo Improvements](doc/RELEASE_2020_04.md) | |
# License | |
Detectron2 is released under the [Apache 2.0 license](../../LICENSE) | |
## <a name="CitingDensePose"></a>Citing DensePose | |
If you use DensePose, please refer to the BibTeX entries | |
for [chart-based models](doc/DENSEPOSE_IUV.md#References) | |
and for [continuous surface embeddings](doc/DENSEPOSE_CSE.md#References). | |