Stochastic Lifting for Generating Trajectories of Stochastic Physical Systems
Jules Berman, Tobias Blickhan, Benjamin Peherstorfer · 2026
Read Stochastic Lifting for Generating Trajectories of Stochastic Physical Systems by Jules Berman, Tobias Blickhan, Benjamin Peherstorfer (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-29194.txt.
Introduction
Jules Berman and colleagues present a method for generating paths of random physical systems. They attach a fresh, high-dimensional random label to each step in the training data and fit a map from the current state plus label to the next state. The labels act as extra coordinates, so the model can offer several plausible next states instead of collapsing to an average. At run time, new labels are drawn at each step and the map is rolled forward, yielding varied paths with one network pass per step.
Catalog record
| CREATOR | Jules Berman, Tobias Blickhan, Benjamin Peherstorfer |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 73116 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.29194
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Stochastic Lifting for Generating Trajectories of Stochastic Physical Systems Jules Berman, Tobias Blickhan, Benjamin Peherstorfer Abstract Many stochastic physical systems evolve smoothly over time in the sense that the distribution of states changes regularly across time steps. The transition from current state to the next state can often be modeled as the combination of a smooth map and an explicit source of randomness. Stochastic Lifting exploits this structure by attaching an independent, high-dimensional random label to each state transition in the training data and fitting a transition map from the current state and label to the next state using a standard regression loss. The labels act as auxiliary coordinates that let the model represent multiple plausible next states from similar current states, avoiding collapse to a mean prediction in the finite-sample size regime. At inference, fresh labels are sampled at each time step and the learned map is rolled forward autoregressively, generating diverse trajectories with a single network evaluation per time step. 1 Overview Many problems in computational physics require drawing large numbers of trajectories from stochastic time-dependent systems. A common abstraction is that dynamics induce a transition law \bm{X}_{t+1}\sim\rho(\cdot|\bm{X}_{t}=\bm{x}_{t}) conditional on the previous state \bm{x}_{t} . The learning problem that we study is therefore not point prediction but sampling plausible next states given a current state \bm{x}_{t} . A fundamental difficulty is that fitting a map to training data (\bm{x}_{t},\bm{x}_{t+1}) with standard mean-squared-error regression collapses to the conditional expectation \mathbb{E}[\bm{X}_{t+1}|\bm{X}_{t}=\bm{x}_{t}] and therefore suppresses the intrinsic variability of the stochastic trajectories. At the other extreme, general-purpose generative models such as diffusion- and flow-based approaches can represent distributions, but they typically require multi-step sampling at inference: roughly speaking, generating T time steps with an s -step sampler requires T\times s neural-network evaluations ( 12 ; 34 ) . Recent work on one-step samplers aims to reduce this cost by distilling multi-step generation into a single evaluation, but such methods are often more difficult to train reliably and have primarily been demonstrated in stationary settings that differ from the trajectory generation setting that we are interested in ( 60 ; 72 ; 21 ; 10 ) . We defer a detailed discussion to the literature review in the next section. A smoothness premise specific to time-dependent systems and trajectory data Our approach is based on a premise that is natural for physical systems; and more broadly for many time-dependent dynamical systems: for sufficiently small time steps, the conditional transition law \rho(\cdot|\bm{x}_{t}) varies regularly with the state \bm{x}_{t} , and next states can be interpreted as small perturbations of the current state. This regularity suggests that the transition can be (at least approximately) represented by a smooth map that takes the current state together with an explicit source of randomness and outputs a next state. The key point is the smoothness of the map. We therefore use smoothness as a guiding heuristic: when a learned transition map interpolates the training data and is smooth, then evaluating it with fresh randomness is expected to generate plausible next-state samples that are close to the desired conditional law. Stochastic Lifting Stochastic Lifting augments the training-data pairs (\bm{x}_{t},\bm{x}_{t+1}) with an independently drawn auxiliary stochastic label {\bm{\xi}}_{t} . It then trains a map F:(\bm{x}_{t},{\bm{\xi}}_{t})\mapsto\bm{x}_{t+1} by minimizing a standard empirical regression loss over the labeled pairs. The label acts as an auxiliary coordinate that parametrizes stochasticity: by assigning a distinct random label to each realized transition in the training data, the map F can fit multiple possible next states associated with similar or identical current states, rather than being driven by the regression loss to collapse toward the average. Moreover, the dimension of the label provides a handle on regularity to some extent: increasing the label dimension improves the separability of labeled training-data pairs and, as we show, can reduce the minimal Lipschitz constant among interpolants of the training data. In this way, stochastic labeling supports learning maps that interpolate the training data and remain smooth, aligning the learned maps with the smoothness premise outlined above. At inference time, we take the current state, draw a fresh label from the label distribution and then evaluate the learned map to obtain a next-state sample. Repeating this procedure with fresh labels yields multiple plausible next-state samples. Furthermore, auto-regressively rolling out the map with a fresh label at each time step leads to a trajectory, requiring only one neural-network evaluation per time step. Regime and scope An important nuance is that Stochastic Lifting is not aiming to yield a meaningful population-limit solution. Indeed, even with the randomly labeled data, the population minimizer collapses to the conditional expectation and ignores the labels. Stochastic Lifting is instead intended for the finite-sample regime, where the labeled data can be fit closely, often up to interpolation. Accordingly, instead of convergence in the classical population limit, we are interested in how close the samples that are generated with Stochastic Lifting are compared to actual samples. Our theory is intended as qualitative finite-sample guidance for this regime, highlighting the role of Lipschitz regularity and label dimension rather than guaranteeing convergence or giving tight generalization bounds. Empirically, we demonstrate state-of-the-art accuracy for generating trajectories of stochastic time-dependent physical systems compared to, e.g., auto-regressive diffusion models and one-step samplers. At the same time, we stress that our method is not designed for unconditional sample generation from noise (e.g., images from noise), where the corresponding map is often globally complex and generally falls outside the regularity regime we rely on. The transition-learning setting, by contrast, provides the structural regularity that makes Stochastic Lifting effective. Summary of contributions (1) Introduce Stochastic Lifting, which assigns stochastic labels to transitions to learn a next-step generator; sampling fresh labels at inference time enables trajectory generation with a single network evaluation per time step. (2) Provide finite-sample Wasserstein bounds showing how interpolation together with Lipschitz regularity can control sampling error, and show that higher-dimensional labels can improve the finite-sample geometry that makes low-Lipschitz interpolation possible. (3) Demonstrate state-of-the-art trajectory generation for stochastic, time-dependent physical systems. (a) one-to-many issue (b) poorly conditioned (c) Stochastic Lifting Figure 1 : (a) For data from a stochastic process, (almost) identical states can have different next states, which prevents learning a transition map from just trajectories. (b) Labeling data points separates them but low-dimensional labels can still lead to poorly conditioned regression problems. (c) Stochastic Lifting uses high-dimensional labels, which enables fitting a smooth regression function. 2 Setup and Problem Formulation 2.1 Setup Consider a stochastic process \{\bm{X}_{t}\}_{t}\subset\mathcal{X}=[0,1]^{n} with initial condition \bm{X}_{0}\sim\rho_{0} . We denote a state (realization) of \bm{X}_{t} as \bm{x}_{t} and often refer to it as state. The samples evolve via a conditional distribution \bm{X}_{t+1}|\bm{X}_{t}=\bm{x}_{t}\quad\sim\quad\rho(\,\cdot\,|\bm{x}_{t})\,. (1) To ease exposition, we focus on transitions that condition on the previous state \bm{X}_{t}=\bm{x}_{t} only, but all of the following extends to transitions that condition on a history of more than one previous state. By the law of total probability, we define the time marginals as \rho_{t+1}=\int_{\mathcal{X}}\rho(\cdot|\bm{x}_{t})\rho_{t}(\bm{x}_{t})\,\mathrm{d}\bm{x}_{t} with the assumption that we can directly sample from \rho_{0} . Notice that the time marginals \rho_{t} can change with time while the conditional distribution \rho(\cdot|\bm{x}_{t}) is independent of time and only depends on the previous state \bm{x}_{t} . The coupling between \bm{x}_{t},\bm{x}_{t+1} is described by