Papers
arxiv:2204.05229
Mixture-of-experts VAEs can disregard variation in surjective multimodal data
Published on Apr 11, 2022
Authors:
Abstract
Machine learning systems are often deployed in domains that entail data from multiple modalities, for example, phenotypic and genotypic characteristics describe patients in healthcare. Previous works have developed multimodal variational autoencoders (VAEs) that generate several modalities. We consider subjective data, where single datapoints from one modality (such as class labels) describe multiple datapoints from another modality (such as images). We theoretically and empirically demonstrate that multimodal VAEs with a mixture of experts posterior can struggle to capture variability in such surjective data.
Models citing this paper 0
No model linking this paper
Cite arxiv.org/abs/2204.05229 in a model README.md to link it from this page.
Datasets citing this paper 0
No dataset linking this paper
Cite arxiv.org/abs/2204.05229 in a dataset README.md to link it from this page.
Spaces citing this paper 0
No Space linking this paper
Cite arxiv.org/abs/2204.05229 in a Space README.md to link it from this page.