Posterior-First Neural PDE Simulation: Inferring Hidden Problem State from a Single Field

Wenshuo Wang, Fan Zhang · 2026

Read Posterior-First Neural PDE Simulation: Inferring Hidden Problem State from a Single Field by Wenshuo Wang, Fan Zhang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-03247.txt.

Introduction

Wenshuo Wang and Fan Zhang propose posterior-first simulation for neural solvers of partial differential equations that see only one field at deployment. A single snapshot can hide which underlying problem state produced it, and a direct field-to-future model collapses that ambiguity into one guess, harming rollouts.

Their method first infers a probability distribution over the smallest sufficient hidden state, then predicts from that distribution. Theory ties the target, learning rule, and failure mode together, with scores that make the posterior learnable. On hidden-metadata PDEBench tasks, rollout error fell markedly, closing much of the gap to an oracle.

Catalog record

CREATORWenshuo Wang, Fan Zhang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE105 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.03247

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Posterior-First Neural PDE Simulation: Inferring Hidden Problem State from a Single Field Wenshuo Wang, Fan Zhang Abstract Neural PDE simulators often receive only a single observed field at deployment. In this setting, a field-to-future predictor can collapse distinct latent problem states into the same deterministic interface, losing the ambiguity needed for reliable rollout and downstream decisions. We propose posterior-first neural PDE simulation : first infer a posterior over the minimal task-sufficient problem state, then condition prediction on that posterior. The resulting theory connects the object, the learning target, and the failure mode: Bayes downstream values factor through this posterior, refinement labels make it learnable by proper scoring rules, and deterministic collapse incurs an ambiguity barrier whenever the true posterior is non-Dirac. Synthetic exact-ambiguity experiments show that point-versus-posterior gaps track the predicted barrier. On metadata-hidden PDEBench tasks, posterior recovery reduces pooled rollout nRMSE from 0.175 to 0.132, closing 59.4% of the direct-to-oracle gap. These results suggest that single-observation neural PDE simulation should be posterior-first rather than monolithic field-to-future prediction. 1 Introduction Across science and engineering, many central problems in forecasting, design, and control require fast simulation of systems governed by partial differential equations. Neural PDE simulators have therefore become an important surrogate modeling paradigm, because they can amortize the cost of repeated numerical solves [ 1 , 2 , 3 ] . We focus on the single-observation regime, where the simulator receives one field and must predict what happens next. This regime matters because a single observed field is often the practical input available at deployment, while the simulator is still expected to support long-horizon prediction and other downstream scientific use. But this regime is fundamentally difficult. One field need not uniquely determine the future, because hidden state, coefficients, operators, boundary conditions, or memory may remain unresolved [ 4 , 5 , 15 , 6 ] . Existing neural PDE simulators differ in what they receive at inference time and how they handle hidden problem-state information before prediction. Some treat simulation as direct prediction from the visible field [ 1 , 2 , 3 ] ; others reduce the difficulty with extra problem information or richer context, such as equations, coefficients, boundary conditions, or short trajectories [ 7 , 8 , 9 , 10 , 11 ] ; and a related line explicitly recovers hidden state, parameters, operators, or memory before prediction [ 12 , 13 , 14 , 16 ] . Yet single-observation simulation still lacks a principled reusable intermediate object. The missing problem state is usually left implicit, bypassed with extra information, or only partially recovered. As a result, ambiguity unresolved by one field is not preserved for downstream prediction or decision. We address this gap with posterior-first neural PDE simulation : x_{t}\longmapsto q_{\phi}\left(z_{t}\mid x_{t}\right)\longmapsto p_{\psi}\left(y\mid z_{t}\right). Here x_{t} is the observed field at inference time, q_{\phi}\left(z_{t}\mid x_{t}\right) is a posterior over latent problem states compatible with that field rather than a deterministic point estimate, and p_{\psi}\left(y\mid z_{t}\right) denotes downstream prediction conditioned on such a state. This factorization makes explicit what single-observation simulation must do under ambiguity: first infer which hidden problem states remain plausible from the visible field, then evolve or answer downstream queries conditional on that uncertainty. Concretely, in Section 3 we define the latent problem state and the posterior-first factorization. We then show in Section 4 that the Bayes-optimal reusable intermediate object is a posterior, that this posterior is exactly learnable with proper scoring rules, and that deterministic point latents face an explicit ambiguity barrier. To make this formulation concrete, we instantiate in Section 5 a minimal posterior-first simulator that infers a structured problem-state posterior and conditions evolution on it through a matched rollout backbone and a theorem-facing training objective. Across the two empirical layers in Section 6 , posterior-first models consistently outperform matched direct-rollout baselines, capacity-matched controls, and literature alternatives. Specifically, on the theorem-facing synthetic benchmark, they close most of the direct-to-oracle gap under controlled ambiguity. On the public PDEBench layer, they improve rollout error on every family, reducing the pooled public \mathrm{nRMSE} from 0.175 to 0.132 while closing about 60% of the hidden-metadata oracle gap. These results support our core claim: single-observation neural PDE simulation should be posterior-first rather than a monolithic field-to-future map. In Section 7 we explain why this matters: making pre-rollout problem-state recovery explicit changes not only how neural simulators are built, but also what scientific surrogate models should be optimized and evaluated for. 2 Related Work 2.1 Types of Inputs to Neural Simulators Research on neural PDE simulation can be classified by the inputs available to the simulator at inference time. A first class uses the observed field itself as the input and learns either a solution operator or a rollout map directly from fields or coordinates. FNO and DeepONet are canonical examples of this regime [ 1 , 2 ] . PDE-Refiner is a representative long-horizon rollout model in the same setting [ 3 ] . A second class gives the simulator structured problem information in addition to the field. This information can include symbolic equations, coefficients, boundary conditions, geometry, or multimodal operator descriptions. Unisolver and PROSE exemplify this explicit-condition regime [ 7 , 8 ] . A third class gives the simulator richer context before or during prediction. This context can take the form of short trajectories, contextual examples, or prompts from related dynamics. ICON, DISCO, and Zebra are representative methods in this class [ 9 , 10 , 11 ] . Taken together, these lines of work still leave single-observation simulation without a principled reusable intermediate object: direct-rollout methods leave the missing problem state implicit, whereas methods that avoid this difficulty do so by supplying extra information from outside the observation itself. Conceptually related is amortized simulation-based inference, which learns posteriors for inverse problems rather than reusable simulator interfaces [ 26 , 27 , 25 ] . Our work addresses this missing object directly with a posterior-first formulation of neural PDE simulation. This matters because it replaces an architecture-level modeling habit with a general principle for how scientific simulators should be built, reasoned about, and evaluated. This matters because it turns unresolved problem-state ambiguity into an explicit reusable simulator interface, rather than leaving it hidden inside end-to-end rollout or bypassing it with extra inputs. 2.2 Problem-State Recovery Methods and What They Recover Among methods that recover missing information before prediction, prior work falls into four broad groups: reconstructing hidden field state from partial observations [ 12 , 13 ] , identifying equations, parameters, coefficients, or source terms [ 14 , 15 ] , inferring operator or dynamics representations from richer context [ 9 , 10 , 11 ] , and treating memory as part of the latent state [ 16 ] . Taken together, these methods remain partial: they recover only one slice of the hidden problem state or rely on richer context than a single observed field. As a result, ambiguity that is joint across hidden state, coefficients, operators, boundary conditions, and memory is still not exposed as a reusable object from one field. Our formulation instead targets a posterior over the joint task-sufficient problem state, so that unresolved ambiguity can be carried forward explicitly into downstream evolution and decision-making. 3 Posterior-First Problem-State Formulation The single-observation

Read the complete text