Derived Fields Preserve Fine-Scale Detail in Budgeted Neural Simulators
Wenshuo Wang, Fan Zhang · 2026
Read Derived Fields Preserve Fine-Scale Detail in Budgeted Neural Simulators by Wenshuo Wang, Fan Zhang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-29224.txt.
Introduction
Wang and Zhang ask what training data a neural PDE simulator should keep under a tight budget. Coarsening and quantization can erase fine-scale detail before training starts. Their analysis uses periodic incompressible Navier-Stokes flow. Quantization error hits the finest retained band hardest. Velocity and vorticity also distort in different ways. Their method, DerivOpt, picks which fields to carry and at what precision. On PDEBench, it cut fine-band error and rollout error.
Catalog record
| CREATOR | Wenshuo Wang, Fan Zhang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 139139 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.29224
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Derived Fields Preserve Fine-Scale Detail in Budgeted Neural Simulators Wenshuo Wang, Fan Zhang Abstract Fine-scale-faithful neural simulation under fixed storage budgets remains challenging. Many existing methods reduce high-frequency error by improving architectures, training objectives, or rollout strategies. However, under budgeted coarsen–quantize–decode pipelines, fine detail can already be lost when the carried state is constructed. In the canonical periodic incompressible Navier–Stokes setting, we show that primitive and derived fields undergo systematically different retained-band distortions under the same operator. Motivated by this observation, we formulate Derived-Field Optimization (DerivOpt) , a general state-design framework that chooses which physical fields are carried and how storage budget is allocated across them under a calibrated channel model. Across the full time-dependent forward subset of PDEBench , DerivOpt not only improves pooled mean rollout nRMSE \mathrm{nRMSE} , but also delivers a decisive advantage in fine-scale fidelity over a broad set of strong baselines. More importantly, the gains are already visible at input time, before rollout learning begins. This indicates that the carried state is often the dominant bottleneck under tight storage budgets. These results suggest a broader conclusion: in budgeted neural simulation, carried-state design should be treated as a first-class design axis alongside architecture, loss, and rollout strategy. 1 Introduction A common class of neural simulators for time-dependent PDEs generates rollouts autoregressively from current states or short histories [ 1 , 2 ] . They are trained on expensive but high-fidelity numerical simulation data, yet can produce accurate surrogate rollouts at a fraction of the inference cost of traditional solvers [ 3 , 4 ] . A persistent challenge, however, is that during long rollouts, fine-scale structure is often distorted long before the widely reported full-field error becomes unacceptable [ 2 , 5 ] . Although fine bands usually contribute only a small fraction of the overall error, they often govern the quantities that matter most in practice, such as peak local loads, front sharpness, mixing efficiency, boundary stress, and transport bottlenecks [ 6 , 7 , 8 ] . Errors in these quantities can materially affect design limits, operational reliability, and downstream decision-making [ 9 , 10 , 11 ] . Existing neural simulators typically commit to a pre-fixed state representation: primitive physical variables, manually derived variables, or latent coordinates [ 16 , 17 ] ; see Section 2 . Regardless of the representation, practical memory and compute limits frequently require the carried state to be coarsened and quantized before training and inference. This raises a structural question that is largely orthogonal to backbone choice: under a fixed storage budget, which physical fields should be carried at all, and how should budget be distributed across them? If the carried state is already detail-poor at input time, then stronger predictors, losses, or rollout tricks can only partially compensate for information that has already been discarded during state construction. To test this question both analytically and empirically, we take periodic incompressible Navier–Stokes as the clearest and most tractable testbed, and develop the canonical mechanism in Sections 3 – 5 . Section 3 first shows that under a fixed coarse operator and storage budget, primitive states can already become detail-poor at input time. Section 4 then shows that this is not merely a generic quantization effect: under that same operator, primitive and derived fields can suffer systematically different retained-band distortions, so some carried states preserve fine-scale information much more faithfully than others. Motivated by this observation, we introduce Derived-Field Optimization (DerivOpt) in Section 5 , a budgeted state-design framework that treats the carried physical fields as optimization variables and evaluates every feasible field subset and bit allocation through an explicit closed-form design score, once a family-specific analysis basis, a calibrated channel model, and a task-aligned target quantity are specified. Taken together, these sections establish the canonical conclusion that under storage constraints the decisive question is not only how a predictor propagates a state, but also what state it is allowed to propagate in the first place. The empirical question is broader than the canonical Navier–Stokes derivation. The same state-design problem arises across benchmark partial differential equation families with different boundary conditions, field semantics, and rollout regimes, so Section 6 instantiates DerivOpt across the full time-dependent forward subset of PDEBench —advection, Burgers, diffusion–sorption, diffusion–reaction, radial dam break, incompressible Navier–Stokes, and compressible Navier–Stokes [ 51 ] . Across this benchmark, primitive-only methods typically remain trapped in collapsed or near-collapsed detail regimes once the carried primitive state has become detail-poor, even when paired with strong architecture-, loss-, or rollout-side remedies. By contrast, introducing derived-field freedom is what first makes nontrivial detail-faithful regimes appear, and DerivOpt extends them the farthest, yielding both the strongest detail-sensitive aggregate profile and the best pooled mean rollout \mathrm{nRMSE} . Section 7 returns to this broader perspective and argues that, in tight-budget neural simulation, carried-state design should be treated as a first-class design axis alongside architecture, loss, and rollout strategy rather than as a fixed backdrop to predictor design. 2 Related Work 2.1 Neural simulators across primitive, derived, and latent representations Existing neural simulators for time-dependent PDE forecasting can be organized not only by architecture, but also by the state representation they advance in time. Broadly, current work advances three kinds of representations: primitive physical fields, manually derived physical fields, and constructed reduced coordinates such as learned latent spaces or modal variables [ 16 , 17 ] . One major paradigm advances primitive or directly observable variables. In this setting, neural simulators forecast future velocity-, pressure-, density-, or temperature-carrying states directly on grids or meshes [ 18 , 19 , 20 ] . Another paradigm advances manually derived physical variables. Here the state is reparameterized into fields that expose incompressibility, transport, or rotational structure more explicitly, such as vorticity, potential vorticity, or Helmholtz potentials [ 21 , 22 , 23 , 24 , 25 ] . A third paradigm performs rollout in compressed coordinates. In these models, the high-dimensional flow is first encoded into low-dimensional latent or reduced coordinates, and temporal dynamics are learned in that space before decoding back to the physical domain [ 26 , 27 , 28 , 29 , 30 ] . Taken together, the dominant pattern in the literature is to commit to one fixed representation family before learning begins: a primitive state, a derived state, or a latent coordinate system. Under storage constraints, however, this choice is not merely a modeling convenience; it can determine whether fine-scale information survives state construction at all. What is largely missing is to treat the carried physical fields and their budget allocation as optimization variables under a fixed representation budget. DerivOpt addresses this gap directly by treating the carried state itself as a design variable. In tight-budget regimes, that design choice can determine whether the predictor has access to any nontrivial detail-faithful regime in the first place. 2.2 Long-horizon and fine-scale fidelity in neural simulators Beyond the choice of state representation, another central line of work asks how neural simulators can maintain accurate autoregressive rollouts over long horizons without washing out, destabilizing, or misrepresenting fine-scale structure [ 15 , 16 , 32 ] . Within this line, five broad baseline families are especially representative of how current work tries to preserve fine detail under long autoregressive