A Distribution-to-Distribution Neural Probabilistic Forecasting Framework for Dynamical Systems
Tianlin Yang, Hailiang Du, Louis Aslett · 2026
Read A Distribution-to-Distribution Neural Probabilistic Forecasting Framework for Dynamical Systems by Tianlin Yang, Hailiang Du, Louis Aslett (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-25370.txt.
Introduction
Yang, Du, and Aslett forecast whole probability clouds for moving systems, not single paths. Spreading a forecast distribution with physics models is too costly for tangled high-dimensional systems. Their distribution-to-distribution frame wraps a swappable neural core in matching encode and decode stages. Kernel embeddings carry the input cloud, and mixture density nets shape the output. Steps can then recurse in pure distribution form. On the Lorenz63 system, the model tracks real distributional change and rivals a perfect-model ensemble.
Catalog record
| CREATOR | Tianlin Yang, Hailiang Du, Louis Aslett |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 53224 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.25370
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
A Distribution-to-Distribution Neural Probabilistic Forecasting Framework for Dynamical Systems Tianlin Yang, Hailiang Du, Louis Aslett Abstract Probabilistic forecasting provides a principled framework for uncertainty quantification in dynamical systems by representing predictions as probability distributions rather than deterministic trajectories. However, existing forecasting approaches, whether physics-based or neural-network-based, remain fundamentally trajectory-oriented: predictive distributions are usually accessed through ensembles or sampling, rather than evolved directly as dynamical objects. A distribution-to-distribution (D2D) neural probabilistic forecasting framework is developed to operate directly on predictive distributions. The framework introduces a distributional encoding and decoding structure around a replaceable neural forecasting module, using kernel mean embeddings to represent input distributions and mixture density networks to parameterise output predictive distributions. This design enables recursive propagation of predictive uncertainty within a unified end-to-end neural architecture, with model training and evaluation carried out directly in terms of probabilistic forecast skill. The framework is demonstrated on the Lorenz63 chaotic dynamical system. Results show that the D2D model captures nontrivial distributional evolution under nonlinear dynamics, produces skillful probabilistic forecasts without explicit ensemble simulation, and remains competitive with, and in some cases outperforms, a simplified perfect model benchmark. These findings point to a new paradigm for probabilistic forecasting, in which predictive distributions are learned and evolved directly rather than reconstructed indirectly through ensemble-based uncertainty propagation. I Introduction Prediction of complex systems across science and engineering is often formulated in terms of dynamical systems governed by ordinary or partial differential equations, grounded in physical knowledge of the underlying processes. Such physics-based models underpin a wide range of applications, including geophysical flows, climate and weather prediction, engineering control systems, and biological dynamics. Alongside these approaches, data-driven methods have long been explored as alternative or complementary tools for forecasting dynamical systems. Recent advances in machine learning have led to significant progress in data-driven forecasting, particularly neural network based forecasters, which achieve predictive skill comparable to, and in some cases exceeding, that of physics-based models, while offering substantial gains in computational efficiency [ 4 , 27 , 25 , 32 ] . Despite their different formulations, both physics-based and existing neural network based forecasters share a fundamental structural limitation: they evolve single system states forward in time, producing deterministic trajectories rather than explicitly evolving predictive distributions. As is well known, for deterministic models governed by ordinary or partial differential equations, propagating full distributions would require solving the Liouville or Fokker–Planck equation, a task that is computationally intractable for high-dimensional nonlinear systems [ 39 , 31 ] . This structural limitation poses a fundamental challenge for uncertainty quantification. In complex, nonlinear and often chaotic systems, uncertainty arises from multiple sources, including for example observational noise, unresolved processes, and model discrepancy. Quantifying and propagating this uncertainty is essential for both scientific understanding and decision-making, particularly when forecasts are used to assess risk, threshold exceedance, or low-probability high-impact events. A wide range of uncertainty quantification approaches have been developed, with ensemble-based methods forming the backbone of practical uncertainty representation in many forecasting systems. Initial condition ensembles are commonly used to represent uncertainty arising from imperfect observations and data assimilation. Parameter ensembles, often referred to as perturbed-physics ensembles, aim to capture uncertainty associated with model parameterisation. Multi-model ensembles further attempt to address structural model discrepancy by combining forecasts from models with different formulations. In practice, these ensemble strategies are designed to address different sources of uncertainty in a rather independent manner. When combined, their joint use can incur substantial computational cost and may lead to overly dispersed predictive distributions, thereby reducing the practical value of the forecast. Beyond ensemble-based approaches [ 28 , 47 ] , a variety of other uncertainty quantification methods have been developed, including Bayesian inference and filtering techniques [ 15 , 23 ] , stochastic parameterisations [ 11 ] , and post hoc statistical calibration methods [ 17 ] . While these approaches provide valuable tools for characterising uncertainty in specific settings, uncertainty is typically treated as an auxiliary quantity added to an underlying deterministic forecast. Similar uncertainty quantification strategies have also been widely adopted in machine learning based forecasting, particularly for neural network models. Ensemble-based approaches are commonly used to represent predictive uncertainty by training multiple networks with different initialisations, data subsets, or perturbations, mirroring ensemble techniques in physics-based modelling. In addition, a range of methods have been developed specifically for neural networks, including approximate Bayesian techniques such as dropout-based inference [ 16 ] , as well as more recent generative approaches based on diffusion and probabilistic latent variable models [ 26 , 24 , 35 ] . While these models can produce rich probabilistic forecasts for a single forward step, multi-step forecasting typically relies on propagating sampled trajectories rather than explicitly evolving the predictive distribution itself. Taken together, traditional uncertainty quantification approaches for both physics-based models and machine learning models typically treat uncertainty as an auxiliary quantity added to an underlying deterministic forecast, rather than as an intrinsic part of the model evolution. Probabilistic forecasting provides a principled and natural framework for uncertainty quantification by representing predictions as full probability distributions, which offer the most complete description of predictive uncertainty. Crucially, the quality of uncertainty quantification can then be evaluated using proper probabilistic scoring rules, such as the logarithmic score [ 19 ] . In this setting, the skill of a probabilistic forecast directly reflects the quality of the associated uncertainty quantification. From this perspective, uncertainty quantification is no longer an auxiliary diagnostic, but should be treated as a primary modelling objective that is explicitly optimised during training. Achieving this objective in dynamical forecasting requires predictive uncertainty to be propagated coherently through time, so that the evolution of the system is described in terms of predictive distributions rather than individual trajectories. However, existing dynamical forecasting models, whether physics-based or neural-network-based, remain fundamentally trajectory-based. In this work, a neural network architecture is proposed that enables distribution-to-distribution (D2D) learning, allowing predictive distributions themselves to be treated as first-class objects that are propagated through the forecasting model. The framework operates directly on predictive distributions rather than individual system states. Input distributions are encoded using kernel mean embeddings and processed by a neural forecasting module, while the outputs are decoded into parameterised predictive distributions via mixture density networks. By enabling predictive distributions to be propagated dynamically through successive forecast steps, the framework makes uncertainty an intrinsic component of the model evolution and allows model training and optimisation to be driven explicitly by probabilistic performance metrics. The remainder of the paper is organised as follows. Section II describes the proposed D2D framework, including the output distribution parameterisation, the kernel-based encoding of input distributions, the logarithmic-score training objective, and the associated training strategies. Section III presents a proof-of-concept experimental demonstration based on the Lorenz63 system. Section IV concludes the paper with a summary of the main results and a discussion of limitations and future extensions. II D2D Framework The core idea of the proposed distribution-to-distribution (D2D) framework is to treat predictive distributions, rather than point states, as the fundamental objects of dynamical forecasting. In the present work, this idea is realised at the level of marginal predictive distributions for individual state variables, rather than the full joint distribution over the complete state vector. Instead of learning a mapping from \mathbf{x}_{t} to