Mitigating mode collapse in normalizing flows by annealing with an adaptive schedule: Application to parameter estimation

Yihang Wang, Chris Chi, Aaron R. Dinner · 2025

Read Mitigating mode collapse in normalizing flows by annealing with an adaptive schedule: Application to parameter estimation by Yihang Wang, Chris Chi, Aaron R. Dinner (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-03652.txt.

Introduction

Yihang Wang, Chris Chi, and Aaron Dinner published a computing paper in 2025 on stopping normalizing flows from collapsing onto one peak of a bumpy distribution. Flows draw clean samples for parameter fitting, but they often miss whole modes. The team anneals the target slowly, adjusting the pace by how many samples stay effective. That adaptive schedule steadies the climb.

On a biochemical oscillator fit to time series data, their method reached the model evidence ten times faster than a standard chain sampling rival. The same score prunes weak samples to cut variance. The authors expect the tricks to help flow sampling broadly and sketch further gains.

Catalog record

CREATORYihang Wang, Chris Chi, Aaron R. Dinner
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE45 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-03652

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Mitigating mode collapse in normalizing flows by annealing with an adaptive schedule: Application to parameter estimation Yihang Wang, Chris Chi, Aaron R. Dinner Abstract Normalizing flows (NFs) provide uncorrelated samples from complex distributions, making them an appealing tool for parameter estimation. However, the practical utility of NFs remains limited by their tendency to collapse to a single mode of a multimodal distribution. In this study, we show that annealing with an adaptive schedule based on the effective sample size (ESS) can mitigate mode collapse. We demonstrate that our approach can converge the marginal likelihood for a biochemical oscillator model fit to time-series data in ten-fold less computation time than a widely used ensemble Markov chain Monte Carlo (MCMC) method. We show that the ESS can also be used to reduce variance by pruning the samples. We expect these developments to be of general use for sampling with NFs and discuss potential opportunities for further improvements. 1 Introduction Fitting models to data enables the objective evaluation of the models for interpretation of the data and estimation of parameters; in turn, models can be used for both interpolation of the data and extrapolation for prediction. Because few models are analytically tractable, fitting typically relies on sampling parameters through Markov chain Monte Carlo (MCMC) simulations, in which new values for parameters are proposed and accepted or rejected so as to sample a desired distribution in the limit of many proposals. Unfortunately, MCMC simulations often converge slowly. Proposals are generally incremental changes to the parameter values, and correlations between parameters cause distributions to be strongly anisotropic [ 21 , 47 ] —limiting the sizes of the changes—and multimodal—requiring traversal of low probability regions. In the case that we consider here—fitting time series data with systems of ordinary differential equations (ODEs)—these issues are exacerbated by separations of time scales between the time steps for numerical integration, which are set by the fastest processes described, and the total times of integration, which are set by the slowest processes of interest. Such separations of time scales make evaluating proposals and, when gradients are needed, making proposals computationally costly. This limits the number of proposals that are computationally feasible and, in turn, the use of many methods developed to address the anisotropy and multimodality [ 43 , 18 , 7 , 13 , 31 , 10 , 16 , 6 ] . Given recent rapid advances in machine learning, researchers have sought to use it to accelerate sampling [ 50 , 32 ] . The main idea of the methods that have been proposed is to learn the structure of the target distribution and use this information to guide sampling. One method that is suitable for this purpose is to learn a normalizing flow (NF), which is an invertible map from a tractable (base) distribution to the target distribution [ 39 , 27 ] . If such a map can be learned, uncorrelated samples with high likelihoods of acceptance can be generated rapidly by drawing independently from the base distribution and applying the map. Because NFs offer an exact calculation of the probability density of samples, they can be combined with different statistical estimators to provide unbiased estimates of expectation values, even when they do not match target distributions exactly [ 37 ] . For example, Noé et al. showed that an NF can be used to generate low-energy conformations of condensed phase systems and sample metastable states to estimate their relative free energies [ 38 ] (see [ 8 ] and references therein for commentary and related work). Of special interest for our study, Gabrié et al. investigated the use of NFs to accelerate sampling a Bayesian posterior distribution for parameters of a model similar to one for a star-exoplanet system [ 15 ] ; in that study and a follow-on one [ 16 ] , they showed that combining conventional Metropolis-Hastings MCMC sampling with proposals from NFs enhanced sampling efficiency. Grumitt et al. introduced a deterministic Langevin Monte Carlo algorithm that replaces the stochastic term in the Langevin equation with a deterministic density-gradient term evaluated using NFs and demonstrated that it improved sampling distributions representative of ones encountered in Bayesian parameter estimation, particularly for cases where direct calculation of the likelihood gradient is computationally expensive [ 20 ] . Souveton et al. used flows based on Hamiltonian dynamics to sample the posterior distribution of parameters of a cosmological model [ 46 ] . Despite these successes, a significant challenge in using NFs is their potential for mode collapse, in which the model tends to focus on a single mode of a multimodal target distribution [ 36 , 22 ] . Gabrié et al. assume that the modes are known so that samples can be initialized in each, and in some cases the modes can be anticipated from symmetry [ 22 ] . However, often such information is not available a priori. Various approaches to mitigate mode collapse have been investigated. As we discuss further below, an NF is trained by minimizing a divergence (typically, the Kullback-Leibler divergence) between the distribution produced by the model and a target distribution, and the choice of divergence can promote or suppress mode collapse [ 22 , 36 , 30 ] . Researchers have also investigated tuning the transport from the base to the target distributions [ 30 ] , alternative gradient estimators [ 49 ] , and annealed importance sampling between the model and target distributions [ 34 ] . Ultimately, mitigating mode collapse is likely to require a combination of approaches, and it is important to test the effectiveness of approaches on different classes of problems. In this study, we explore mitigating mode collapse in normalizing flows for parameter estimation in a Bayesian framework by annealing from the prior distribution to the posterior distribution. Specifically, we show how the effective sample size can be used (1) to determine an adaptive annealing schedule to sample a multimodal parameter distribution for a model of a biochemical oscillator robustly without prior knowledge of the modes and (2) to prune the results to reduce the variance. For hyperparameter values tested, we are able to achieve a ten-fold speedup relative to a widely used Markov chain Monte Carlo (MCMC) ensemble sampler. Potential directions for future research are discussed. 2 Normalizing flows Using NFs to generate MC moves presents a fundamental dilemma: the NF must learn the structure of the target distribution from the data, yet the data are only obtained once the parameter space is explored. Below, we describe a training scheme that allows the NF to explore the target space autonomously, followed by a discussion of strategies to enhance the robustness and reliability of this scheme. 2.1 Architecture An NF transforms a sample \mathbf{z} from the base distribution, p_{z}(\mathbf{z}) into a sample \mathbf{x} from an approximation q_{\phi}(\mathbf{x}) to the target distribution p(\mathbf{x}) through a sequence of invertible, differentiable functions \{f_{i}\}_{i=1}^{N} with learnable parameters \phi : \mathbf{x}=f_{\phi}(\mathbf{z})=f_{N}\circ f_{N-1}\circ\ldots\circ f_{1}(\mathbf{z}). (1) By the change of variables theorem, q_{\phi}(\mathbf{x})=p_{z}(f_{\phi}^{-1}(\mathbf{x}))\left|\det\left(\frac{df_{\phi}^{-1}}{d\mathbf{x}}\right)\right|, (2) where f_{\phi}^{-1} is the inverse of the composite function and df_{\phi}^{-1}/d\mathbf{x} is its Jacobian. In practice, it is important to choose a form for f_{i} that facilitates computing the determinant of the Jacobian; we use RealNVP

Read the complete text