Statistical Parameter Calibration with the Generalized Fluctuation Dissipation Theorem and Generative Modeling

Ludovico T. Giorgini, Tobias Bischoff, Andre N. Souza · 2025

Read Statistical Parameter Calibration with the Generalized Fluctuation Dissipation Theorem and Generative Modeling by Ludovico T. Giorgini, Tobias Bischoff, Andre N. Souza (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-19660.txt.

Introduction

Calibrating a noisy model usually means rerunning it for every guess of its settings. Ludovico T. Giorgini, Tobias Bischoff, and Andre N. Souza dodge those reruns with a theorem from statistical physics. The fluctuation-dissipation theorem links natural wiggles in a system to its response to small pushes. They recast setting changes as tiny pushes on the dynamics.

One unperturbed run then yields how any steady measure shifts with each setting, all at once. A learned score function supplies the missing piece for real-world, non-Gaussian cases. Tests range from solvable toy processes to the chaotic Lorenz-96 weather toy. The method could ease tuning of climate and fluid models, where each run is dear. It turns inverse problems into response problems.

Catalog record

CREATORLudovico T. Giorgini, Tobias Bischoff, Andre N. Souza
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE61 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-19660

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Statistical Parameter Calibration with the Generalized Fluctuation Dissipation Theorem and Generative Modeling Preprint: APS/123-QED Ludovico T. Giorgini, Tobias Bischoff, Andre N. Souza Abstract Parameter calibration in complex dynamical systems often relies on costly optimization routines or ad hoc tuning to match statistical properties of observations. In this work, we develop a principled framework for statistical calibration grounded in the Generalized Fluctuation-Dissipation Theorem (GFDT). This approach provides exact linear response formulas that relate infinitesimal changes in internal model parameters to infinitesimal changes in statistics of arbitrary observables. In other words, the GFDT yields parameter Jacobians of system statistics without requiring adjoint models, ensemble perturbations, or repeated simulations. We demonstrate the framework’s utility across a hierarchy of systems, including analytically tractable linear models, nonlinear double-well potentials, and multiscale stochastic models relevant to climate dynamics. We show that these Jacobians can be embedded within classical optimization schemes—such as Newton-type updates or regularized least squares—to guide parameter updates. The method is further extended to handle perturbations in both drift and diffusion terms, enabling unified treatment of deterministic and stochastic calibration. Our results establish the GFDT as a rigorous and interpretable foundation for parameter tuning in non-equilibrium systems. I Introduction Calibrating the parameters of complex dynamical models so that model-implied statistics agree with empirical observations is a central task across the physical, engineering, and life sciences Tarantola 2005 ; Kennedy and O’Hagan 2001a ; Nanda and Kirschner 2023 ; Dunbar et al. 2021 ; Chis et al. 2011 . Formally, this is an inverse problem: given data, infer parameter values that render the model statistically consistent with measured observables (means, variances, spectra, exceedance probabilities, etc. ). These problems are typically ill-posed—multiple parameter sets can explain the data and small perturbations in observations may induce large changes in inferred parameters—and thus require principled regularization and uncertainty quantification Stuart 2010 ; Dashti and Stuart 2017 . A complementary challenge is computational: each evaluation of the forward map often entails integrating high-dimensional, stiff, or chaotic dynamics, making naïve search or repeated finite-difference sensitivity analyses prohibitively expensive Bellman 1961 ; Chakrabarty et al. 2021 ; Dunbar et al. 2022 . A broad repertoire of methodologies has emerged. Likelihood-based estimators (e.g., maximum likelihood and penalized least squares) and Bayesian formulations provide principled estimators and uncertainty quantification but frequently demand many forward solves and careful regularization choices Stuart 2010 ; Dashti and Stuart 2017 . Model-discrepancy formulations enrich calibration by accounting for structural imperfections in the simulator, at the cost of increased inferential complexity Kennedy and O’Hagan 2001b . Gradient-based strategies—adjoint/variational methods, Gauss–Newton, and Levenberg–Marquardt—can be highly efficient when sensitivities are available, but deriving and maintaining adjoints for large codes is onerous and linearized sensitivities may be unreliable in strongly nonlinear regimes Lettermann et al. 2024 . Derivative-free, covariance-informed updates such as Ensemble Kalman Inversion (EKI) avoid adjoints and parallelize naturally, yet they typically return point estimates with limited posterior characterization and can struggle in multimodal or strongly nonlinear settings Iglesias et al. 2013 ; Schillings and Stuart 2017 . Fully probabilistic samplers (MCMC) Hastings 1970 ; Gelman et al. 2013 ; Roberts and Rosenthal 2001 ; Cui et al. 2009 target the posterior distribution and thus deliver gold-standard uncertainty quantification, but their cost scales poorly when each likelihood evaluation requires an expensive time integration; hybrid pipelines that calibrate–emulate–sample alleviate this by combining fast optimization, surrogate modeling, and sampling Cleary et al. 2021 . Variational Bayesian approaches further reduce costs by optimizing tractable posterior approximations in large-scale inverse problems Povala et al. 2022 . When likelihoods are intractable, likelihood-free methods (e.g., ABC and related simulation-based inference) broaden applicability at the price of large simulation budgets Daher 2025 . In this work we adopt a complementary perspective: rather than matching trajectories, we match statistics of observables and compute their parameter sensitivities using linear response theory. The Generalized Fluctuation–Dissipation Theorem (GFDT) provides, under mild assumptions, exact expressions that link infinitesimal perturbations in the dynamics (including parameter changes in drift and diffusion) to infinitesimal changes in statistics via temporal correlation integrals of the unperturbed system Prost et al. 2009 . Concretely, for an observable \mathcal{A} and parameter vector \bm{\theta} , GFDT yields the Jacobian \partial\langle\mathcal{A}\rangle/\partial\bm{\theta} as an equilibrium (or steady-state) response, computable from a single baseline trajectory at a single parameter value. This has a decisive algorithmic consequence for calibration: one can assemble statistical Jacobians from one forward integration and embed them within regularized Newton-type updates, thereby avoiding repeated model re-integrations. The approach is therefore extremely convenient when forward model integration is the dominant computational bottleneck. Historically, the principal limitation of GFDT-based calibration has been the accurate estimation of the response kernel . Classical implementations substituted quasi-Gaussian closures for the invariant measure, which can induce severe biases precisely in regimes of interest—nonlinear, non-Gaussian dynamics with intermittency and heavy tails. Recent breakthroughs resolve this bottleneck Giorgini et al. 2024 ; Giorgini et al. 2025a by learning the score function \nabla\ln\rho of the invariant distribution directly from data and evaluating the GFDT without restrictive Gaussian assumptions. In particular, score-based generative modeling enables non-Gaussian response estimation from a single long trajectory, markedly improving accuracy of statistical sensitivities in nonlinear settings Giorgini et al. 2024 ; Giorgini et al. 2025a . This development renders GFDT-based statistical calibration operational: one baseline simulation, one data-driven score estimate, and thereafter cheap, differentiable access to Jacobians of statistics with respect to drift and diffusion parameters. Building on these ideas, we formulate a GFDT-based, statistics-matching calibration procedure. In the linear-response regime, the GFDT provides mathematically exact expressions for the sensitivities (Jacobians) of stationary statistics with respect to both drift and diffusion parameters as time–correlation integrals that involve the score function. In practice, we estimate these sensitivities non-intrusively from a single unperturbed trajectory by learning the score from data—eschewing quasi-Gaussian closures—and then evaluating the requisite correlation integrals. The resulting Jacobians are plugged into standard regularized Gauss–Newton / Levenberg–Marquardt updates to iteratively adjust parameters. When the dominant cost lies in forward integration (rather than in score estimation or correlation evaluation), this approach markedly reduces re-simulation burden compared with adjoint or finite-difference baselines, while retaining the interpretability of response theory and accommodating non-Gaussian statistics. We also delineate the method’s assumptions and practical considerations, and demonstrate performance on stochastic models ranging from analytically tractable cases to complex multiscale systems. The paper is organized as follows. Section II formulates the parameter calibration problem and introduces the GFDT framework for computing statistical Jacobians. Section III demonstrates the approach with analytical and computational examples, including an Ornstein-Uhlenbeck process and a quartic potential system. Section IV presents optimization results for scalar and multidimensional models relevant to climate dynamics. Section V discusses conclusions and future directions. II Motivation and Problem Formulation Consider the Itô stochastic differential equation (SDE) for a d -dimensional state \bm{x}_{t} driven by an m -dimensional Wiener process \bm{W}_{t} , d\bm{x}_{t}=\bm{F}(\bm{x}_{t};\,\bm{\alpha})\,dt+\bm{\Sigma}(\bm{x}_{t};\,\bm{\beta})\,d\bm{W}_{t}, (1) where \bm{F}:\mathbb{R}^{d}\to\mathbb{R}^{d} is the drift, \bm{\Sigma}:\mathbb{R}^{d}\to\mathbb{R}^{d\times m} is the diffusion factor, and the parameters are partitioned into drift parameters \bm{\alpha} and diffusion parameters \bm{\beta} . When we treat them jointly we write \bm{\theta}=(\bm{\alpha},\bm{\beta}) . For clarity of exposition we assume that ( 1 ) is ergodic with a unique invariant (steady-state) density \rho_{\bm{\theta}}(\bm{x}) . Extensions to non-stationary or cyclo-stationary settings are possible and are used later in

Read the complete text