Tag: collapse
-
Annealing in variational inference mitigates mode collapse: A theoretical study on Gaussian mixtures
Annealing in variational inference mitigates mode collapse: A theoretical study on Gaussian mixtures arXiv:2602.12923v1 Announce Type: new Abstract: Mode collapse, the failure to capture one or more modes when targetting a multimodal distribution, is a central challenge in modern variational inference. In this work, we provide a mathematical analysis of annealing based strategies for mitigating…
-
Mutual Information Collapse Explains Disentanglement Failure in $beta$-VAEs
Mutual Information Collapse Explains Disentanglement Failure in $beta$-VAEs arXiv:2602.09277v1 Announce Type: new Abstract: The $beta$-VAE is a foundational framework for unsupervised disentanglement, using $beta$ to regulate the trade-off between latent factorization and reconstruction fidelity. Empirically, however, disentanglement performance exhibits a pervasive non-monotonic trend: benchmarks such as MIG and SAP typically peak at intermediate $beta$ and…