Learning stochastic multiscale models through normalizing flows
Anan Saha, Arnab Ganguly · 2026
Read Learning stochastic multiscale models through normalizing flows by Anan Saha, Arnab Ganguly (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-09718.txt.
Introduction
Saha and Ganguly developed a way to learn multiscale random systems from a single observed path of the slow part alone. Many physical, engineering, and living systems pair slow variables with fast, unseen processes that push them around. Standard density methods need dense space-time data or grid solvers, so the authors instead modeled the system with coupled stochastic differential equations and reduced it by stochastic averaging.
The catch is that the reduced model depends on the fast process's steady distribution, which solves a hard, often unknown equation. They represented that distribution with a normalizing flow, a flexible density model, trained end to end on a penalized likelihood. A second flow approximated the uncertainty over model settings through Bayesian variational inference. The result is a scalable route to effective dynamics when only part of the system is watched.
Catalog record
| CREATOR | Anan Saha, Arnab Ganguly |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 60 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.09718
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Learning stochastic multiscale models through normalizing flows Thanks: This research was supported in part by NSF grant DMS-2246815 and by the Simons Foundation through the Travel Support for Mathematicians program. Anan Saha, Arnab Ganguly Abstract Many systems in physics, engineering, and biology exhibit multiscale stochastic dynamics, where low-dimensional slow variables evolve under the influence of high-dimensional fast processes. In practice, observations are often limited to a single trajectory of the slow component, while the fast dynamics remain unobserved, making statistical learning challenging. Approaches based on partial differential equations (PDE), such as Fokker–Planck formulations, aim to characterize the evolution of probability densities, typically requiring dense space–time data or grid-based solvers. In contrast, we adopt a trajectory-based perspective and develop a data-driven framework for learning effective stochastic dynamics from a single observed path. We model the dynamics by coupled multiscale stochastic differential equations (SDEs) and first obtain a principled model reduction through stochastic averaging. Unlike generic model reduction techniques like PCA, this respects the dynamical structure of the original system and explicitly incorporates the interaction between slow and fast scales. A central challenge, however, is that the reduced model depends on the invariant distribution of the fast process which is a solution to an intractable and often unknown PDE. We introduce a novel learning framework that parameterizes the invariant distribution using normalizing flows, enabling expressive density modeling in the latent fast-variable space. The flow is trained end-to-end by optimizing a penalized likelihood objective induced by the reduced stochastic dynamics. Furthermore, we develop a Bayesian variational inference procedure for uncertainty quantification, employing a second normalizing flow to approximate the posterior distribution over model parameters. This yields a scalable approach to capturing epistemic uncertainty in multiscale systems. Our method bridges stochastic model reduction and flow-based latent density modeling, offering a scalable approach to learning effective dynamics in partially observed multiscale stochastic dynamical systems. 1 Introduction Multiscale behavior is a defining feature of many stochastic systems arising in physics, engineering, and biology, where a few slow variables interact with rapidly evolving high-dimensional components 20 . Typical examples include molecular systems on complex energy landscapes, stochastic reaction networks with widely separated reaction rates, and climate systems coupling large-scale atmospheric evolution with rapidly fluctuating turbulence. In practice, one often has access only to a single observed trajectory of the slow variables, while the fast variables remain unobserved. Mathematically, such systems can be described through PDE formulations, such as Fokker–Planck or Kolmogorov equations, which govern the evolution of probability densities on the full state space 9 ; 21 ; 24 . These formulations are theoretically complete and useful in settings where either access to evolving densities or fine discretizations over the state space is available. However, their numerical implementation can become intractable in high-dimensional settings due to the cost solving PDEs. Furthermore, these approaches are not well-suited to data, consisting of a single observed trajectory. A complementary viewpoint is provided by multiscale stochastic differential equations (SDEs) with scale separation. In this regime, a principle model-reduction can be achieved through stochastic averaging. This leads to a reduced-order SDE for the slow variables alone driven by averaged drift and diffusion functions where the effect of the fast variables are averaged out with repect to its invariant distribution. This reduction eliminates explicit dependence on fast variables while retaining the underlying dynamical structure. The resulting reduced model, however, depends critically on the invariant distribution of the fast dynamics, which is typically unknown and only characterized implicitly through a high-dimensional stationary PDE. Consequently, even when the full multiscale system is specified, the effective coefficients governing the slow dynamics are not directly computable. This gives rise to a fundamental inference problem: learning the averaged driving functions, and hence the effective SDE dynamics, from partial trajectory observations in the presence of latent fast-scale equilibrium effects. A natural statistical formulation of this problem is through maximum likelihood estimation (MLE), where the reduced SDE likelihood is optimized over all admissible probability measures on the state space of the fast variables (subject to suitable moment conditions). However, this infinite-dimensional optimization problem is computationally intractable and must be replaced by a tractable surrogate one that admits efficient parameterization and enables efficient optimization. Contributions: The main contributions of this work are: • We formulate inference for multiscale SDEs as a latent-invariant measure learning problem, where the effective drift and diffusion are expressed as conditional expectations with respect to an unknown invariant distribution of the fast process. • We introduce a normalizing-flow parameterization of the latent invariant measure, which facilitates accurate approximation of the averaged functions governing the reduced dynamics. • We develop a Bayesian extension using a second normalizing flow to approximate the posterior distribution over flow parameters, enabling uncertainty quantification for the inferred effective dynamics. • We show that, under suitable conditions, the proposed flow-based estimators converge to MLE as the complexity of the underlying neural network (NN) increases. • We validate the proposed method on synthetic multiscale systems, demonstrating accurate recovery of effective drift, matching of the true and estimated slow trajectories, as well as meaningful uncertainty estimates. Overall, our approach bridges stochastic model reduction and flow-based probabilistic inference, providing a scalable framework for learning effective dynamics in partially observed multiscale stochastic systems. 2 Multiscale systems: Problem Setup We consider multiscale stochastic system, where an observed slow component X^{(n)} is coupled with a rapidly evolving latent process Y^{(n)} . The slow process X^{(n)} satisfies the Itô SDE \displaystyle dX^{(n)}(t)=b\bigl(X^{(n)}(t),Y^{(n)}(t)\bigr)\,dt+\sigma\bigl(X^{(n)}(t),Y^{(n)}(t)\bigr)\,dW(t), (1) where W is an \mathbb{R}^{d} -valued Brownian motion. The latent process Y^{(n)} evolves on the fast time scale O(1/n) . We assume that the state spaces of X^{(n)} and Y^{(n)} are \mathbb{R}^{d} and \mathbb{R}^{d^{\prime}} , respectively. b:\mathbb{R}^{d}\times\mathbb{R}^{d^{\prime}}\to\mathbb{R}^{d} , \sigma:\mathbb{R}^{d}\times\mathbb{R}^{d^{\prime}}\to\mathbb{R}^{d\times d} denote the drift and diffusion coefficients and the parameter n captures the differences in speeds of the components. To formalize the multiscale structure, we assume that Y^{(n)} and the joint process (X^{(n)},Y^{(n)}) are Markov with infinitesimal generator \mathcal{A}_{n} of (X^{(n)},Y^{(n)}) given by \displaystyle\mathcal{A}_{n}f(x,y)=\mathcal{A}^{0}_{y}f(\cdot,y)(x)+n\mathcal{A}^{1}f(x,\cdot)(y), where \displaystyle\mathcal{A}^{0}_{y}\phi(x)=b(x,y)\cdot\nabla_{x}\phi(x)+\mathrm{trace}\left(\sigma\sigma^{\top}(x,y)\nabla_{x}^{2}\phi(x)\right). Here \mathcal{A}^{0}_{y} describes the evolution of the slow variable when the fast component is at state y , whereas n\mathcal{A}^{1} is the generator of Y^{(n)} . If Y^{(n)} is another Itô SDE of the form \displaystyle dY^{(n)}(t)=n\beta\bigl(Y^{(n)}(t)\bigr)\,dt+\sqrt{n}\alpha\bigl(Y^{(n)}(t)\bigr)\,d\tilde{W}(t), (2) then \mathcal{A}^{1} is given by \displaystyle\mathcal{A}^{1}\psi(y)=\beta(y)\cdot\nabla_{y}\psi(y)+\mathrm{trace}(\alpha\alpha^{\top}(y)\nabla^{2}_{y}\psi(y)). (3) If Y^{(n)} is a continuous time Markov chain (CTMC) with state space \mathbb{R}^{d^{\prime}} then \mathcal{A}^{1} has the form \displaystyle\mathcal{A}^{1}\psi(y)=c(y)\int(\psi(y^{\prime})-\psi(y))\nu(y,dy^{\prime}), (4) where c is the jump intensity and \nu is the (post-jump) transition probability kernel. Goal: We consider the scenario when the fast Y -dynamics is unknown or intractable and the goal is to infer the effective dynamics of the system from observations of the slow X -component only. Specifically, we want to find a data-driven effective drift function b_{\mathrm{eff}}:\mathbb{R}^{d}\rightarrow\mathbb{R}^{d} and the diffusion function \sigma_{\mathrm{eff}}:\mathbb{R}^{d}\rightarrow\mathbb{R}^{d\times d} , such that the SDE X_{\mathrm{eff}} driven by them, \displaystyle dX_{\mathrm{eff}}(t)=b_{\mathrm{eff}}(X_{\mathrm{eff}}(t))dt+\sigma_{\mathrm{eff}}(X_{\mathrm{eff}}(t))dW(t) mimics the dynamics of X^{(n)} . This learning problem is intrinsically challenging because the fast Y -component is unobserved and typically has unknown dynamics. If the fast dynamics are known or can be reliably modeled, a naive inference strategy would attempt to reconstruct the latent trajectory of Y^{(n)} jointly with the slow process. But this strategy is impractical and computationally expensive as Y^{(n)} moves rapidly with much shortertime scale O(1/n) . For