Adaptive diffusion posterior sampling for data and model fusion of complex nonlinear dynamical systems
Dibyajyoti Chakraborty, Hojin Kim, Romit Maulik · 2026
Read Adaptive diffusion posterior sampling for data and model fusion of complex nonlinear dynamical systems by Dibyajyoti Chakraborty, Hojin Kim, Romit Maulik (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-12635.txt.
Introduction
Dibyajyoti Chakraborty and co-authors use a diffusion model as a stand-in for costly flow simulations. Chaotic flows are hard to forecast, and fixed models miss how outcomes can spread. Their model looks far ahead in time and is trained step by step for stable rollouts. A graph transformer deals with complex shapes in the flow domain. The system also picks good sensor spots from its own error or doubt. New readings are then folded in with no need to retrain.
Catalog record
| CREATOR | Dibyajyoti Chakraborty, Hojin Kim, Romit Maulik |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 62032 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.12635
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Adaptive diffusion posterior sampling for data and model fusion of complex nonlinear dynamical systems Dibyajyoti Chakraborty, Hojin Kim, Romit Maulik Abstract High-fidelity numerical simulations of chaotic, high dimensional nonlinear dynamical systems are computationally expensive, necessitating the development of efficient surrogate models. Most surrogate models for such systems are deterministic, for example when neural operators are involved. However, deterministic models often fail to capture the intrinsic distributional uncertainty of chaotic systems. This work presents a surrogate modeling formulation that leverages generative machine learning, where a deep learning diffusion model is used to probabilistically forecast turbulent flows over long horizons. We introduce a multi-step autoregressive diffusion objective that significantly enhances long-rollout stability compared to standard single-step training. To handle complex, unstructured geometries, we utilize a multi-scale graph transformer architecture incorporating diffusion preconditioning and voxel-grid pooling. More importantly, our modeling framework provides a unified platform that also predicts spatiotemporally important locations for sensor placement, either via uncertainty estimates or through an error-estimation module. Finally, the observations of the ground truth state at these dynamically varying sensor locations are assimilated using diffusion posterior sampling requiring no retraining of the surrogate model. We present our methodology on two-dimensional homogeneous and isotropic turbulence and for a flow over a backwards-facing step, demonstrating its utility in forecasting, adaptive sensor placement, and data assimilation for high dimensional chaotic systems. 1 Introduction High-fidelity simulation of chaotic dynamical systems such as turbulent flows remains prohibitively expensive at practically relevant Reynolds numbers, with DNS requiring \mathcal{O}(Re^{9/4}) degrees of freedom in three dimensions [ 65 ] . While deep learning surrogates have dramatically reduced this cost, deterministic models share a fundamental statistical deficiency: they collapse the full conditional distribution of the true stochastic system to a point prediction. For any chaotic system with intrinsic state variance, this incurs an irreducible per-step Wasserstein error that accumulates exponentially over the forecast horizon. Diffusion models [ 35 , 41 ] resolve this by learning the full conditional distribution, making their per-step mismatch entirely reducible by training (Ref. Section 3.1 for further details). In several practical applications, training data from the dynamical system that may be used by a surrogate, is available on point clouds or meshes that result from numerical discretizations of governing laws. This brings forth the need to design accurate diffusion-based surrogate models that are specialized for forecasting high dimensional chaotic dynamical systems on unstructured meshes. Beyond forecasting, practical deployment requires fusing model predictions with sparse runtime observations from physical sensors. Diffusion posterior sampling [ 20 , 69 ] achieves this by augmenting each denoising step with a likelihood gradient, steering the generative process toward the posterior without retraining. This raises a natural follow-on question: where should sensors be placed to maximally reduce posterior uncertainty? In the context of Bayesian data assimilation, there exist several techniques for optimal sensor placement that are both physics and data-driven [ 34 , 58 , 57 ] . Several approaches rely on information theoretic approaches such as A/D/E optimal design which are optimization-based strategies that rely on assumptions for the shape of the posterior distribution [ 18 ] . Observability-based approaches based on control theory choose (typically fixed) sensor locations to maximize a metric of the observability Gramian [ 9 , 11 ] . When forecasting with projection-based reduced-order models, QR pivoting is a common approach that leverages the identified proper orthogonal decomposition modes from training data [ 58 ] . Discrete empirical interpolation methods also identify sensor placement strategies that identify points which are important for nonlinear term reconstruction [ 42 ] . However, most approaches for sensor placement tend to be fixed or require expensive online computations which reduces their utility for real-time data and model fusion. To address this gap, we propose two approaches for optimal sensor placement using a trained diffusion model. The first approach relies on the fact that a diffusion model can be sampled to generate ensembles of forecasts. A diffusion ensemble is itself a spatially-resolved uncertainty field, making it a direct and principled guide for sensor placement - closing the loop between inference and observation in a unified active inference framework. However, uncertainty guided sensor placement suffers from increased computational costs for ensemble generation via sampling the diffusion model. To complement this, we propose a metamodeling strategy that uses another model to predict the rollout error of the surrogate and to use spatial concentrations of this predicted error to sample new points efficiently. Based on these, our work delivers four contributions : (i) A multi-step autoregressive diffusion training objective over a K -step rollout that significantly improves long-horizon stability over single-step training. (ii) A multi-scale Graph Transformer diffusion architecture combining EDM preconditioning [ 41 ] , AdaLN-Zero conditioning [ 96 ] , and hierarchical voxel-grid pooling to forecast in unstructured meshes. (iii) Two adaptive sensor placement strategies: a learned predictive error network based estimator and a diffusion ensemble-variance-based estimator targeting observations where the generative prior has most uncertainty. (iv) A topology-aware greedy selection algorithm with spatial suppression that enforces minimum sensor separation, preventing redundant clustering in localized high-uncertainty regions. We validate the framework on two-dimensional forced homogeneous isotropic turbulence at Re=1000 and flow over a backwards-facing step at Re=26{,}000 on an unstructured high-dimensional finite-element mesh. The associated codes are available at https://github.com/ISCLPurdue/chaos_gen . 1.1 Related Works Surrogate modeling replaces expensive high-fidelity simulations with computationally efficient approximation that reproduce the input-output behavior of a target system. Classical methods such as Gaussian processes [ 92 ] , radial basis functions [ 13 ] , and polynomial response surfaces [ 71 , 28 ] provide well-calibrated uncertainty estimates for low-dimensional systems, but their scalability rapidly degrades with the dimensionality of the problem [ 68 ] . Deep neural operator architectures have substantially extended the scope of tractable surrogate tasks: the Fourier Neural Operator [ 49 ] learns resolution-invariant solution operators for parametric PDEs, while DeepONet [ 56 ] exploits the universal approximation theorem for operators to generalize across functional inputs. For time-dependent systems, recurrent architectures such as LSTM [ 37 ] and gated recurrent units [ 19 ] capture long-range temporal dependencies and have been applied to data-driven forecasting of high-dimensional chaotic attractors [ 87 , 88 ] . Specialized surrogate models [ 33 , 93 , 80 , 48 ] have further demonstrated competitive performance in reduced-order modeling of chaotic systems such as turbulent flows. Despite these advances, deterministic surrogates produce only point predictions and cannot represent the distributional uncertainty intrinsic to stochastic or chaotic dynamics. Diffusion models [ 79 , 35 , 82 , 41 ] resolve this limitation by learning a reverse-time stochastic differential equation that maps Gaussian noise to complex high-dimensional distributions. Their superior mode coverage over GANs [ 23 ] and natural extension to video and spatiotemporal sequences [ 36 ] make them especially attractive for dynamical system surrogates. Some diffusion-inspired surrogate models, such as PDE-Refiner [ 53 ] , further demonstrate that an iterative refinement process improves long-rollout and spectral accuracy relative to one-step neural solvers. Moreover, experiments in previous work have shown the advantages of applying generative diffusion models over traditional ML surrogate models for a variety of high dimensional dynamical systems [ 32 , 47 , 61 , 55 , 50 , 67 , 31