Data-Augmented Few-Shot Neural Stencil Emulation for System Identification of Computer Models
Sanket Jantre, Deepak Akhare, Xiaoning Qian, Nathan M. Urban · 2025
Read Data-Augmented Few-Shot Neural Stencil Emulation for System Identification of Computer Models by Sanket Jantre, Deepak Akhare, Xiaoning Qian, Nathan M. Urban (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-19441.txt.
Introduction
Sanket Jantre and co-authors present a 2025 paper on building fast neural stand-ins for computer models of physical systems. Such emulators replace part of a differential equation solver with a neural network, making models easier to differentiate and run. Training them the usual way burns thousands of long simulations.
The team's trick is to train on local snapshots, small patches of the system's state sampled to fill the space evenly, rather than on full trajectories. Ten time steps' worth of patched data taught accurate local operators, and one full run improved them further. On several test systems their emulators beat models trained on thousands of trajectories in long-run accuracy and stability, at a tiny fraction of the data cost.
Catalog record
| CREATOR | Sanket Jantre, Deepak Akhare, Xiaoning Qian, Nathan M. Urban |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 33 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-19441
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Data-Augmented Few-Shot Neural Stencil Emulation for System Identification of Computer Models Sanket Jantre, Deepak Akhare, Xiaoning Qian, Nathan M. Urban Abstract Partial differential equations (PDEs) underpin the modeling of many natural and engineered systems. It can be convenient to express such models as neural PDEs rather than using traditional numerical PDE solvers by replacing part or all of the PDE’s governing equations with a neural network representation. Neural PDEs are often easier to differentiate, linearize, reduce, or use for uncertainty quantification than the original numerical solver. They are usually trained on solution trajectories obtained by long time integration of the PDE solver. Here we propose a more sample-efficient data-augmentation strategy for generating neural PDE training data from a computer model by space-filling sampling of local “stencil” states. This approach removes a large degree of spatiotemporal redundancy present in trajectory data and oversamples states that may be rarely visited but help the neural PDE generalize across the state space. We demonstrate that accurate neural PDE stencil operators can be learned from synthetic training data generated by the computational equivalent of 10 timesteps’ worth of numerical simulation. Accuracy is further improved if we assume access to a single full-trajectory simulation from the computer model, which is typically available in practice. Across several PDE systems, we show that our data-augmented synthetic stencil data yield better trained neural stencil operators, with clear performance gains compared with naïvely sampled stencil data from simulation trajectories. 1 Introduction Mechanistic computer models, often formulated as partial differential equations (PDEs), are pivotal for simulating complex physical systems across fluid dynamics kaushik2015review ; li2023review , climate modeling wang2009review ; mcguffie2001forty , biology cerrolaza2017numerical , and chemistry ( evans2022partial ) . These PDE-based models simulate underlying governing processes to predict complex dynamics, informing decision-making, system design, and intervention strategies. In practice, PDEs often lack analytical solutions and rely on classical numerical methods such as finite difference methods (FDM) ( leveque2007finite ; strikwerda2004finite ) , finite volume methods (FVM) ( moukalled2015finite ; versteeg2007introduction ) , and finite element methods (FEM) ( logg2012automated ; zienkiewicz2005finite ) . These discretization approaches approximate differential operators via handcrafted stencils, balancing simplicity (FDM), local conservation (FVM), and geometric flexibility (FEM). For applications requiring increased accuracy, high-order schemes like discontinuous Galerkin and spectral methods have emerged hesthaven2007nodal ; cockburn2000development , at higher computational cost and complexity. All of these approaches rely on correctly specifying the governing equations, a requirement that breaks down when the underlying physics are only partially known or prohibitively complex ( quarteroni2008numerical ) . Emerging machine learning (ML) approaches seek to learn solution operators or surrogate models directly from data while retaining physical fidelity and improving flexibility and scalability ( raissi2019pinn ; bar2019learning ; brandstetter2022message ) . Physics-informed neural networks (PINNs) ( lagaris1998pinn ; raissi2019pinn ; cai2021physics ; luo2025physics ) embed PDE residuals into the loss, enabling mesh-free, often unsupervised training. Neural operators–e.g. DeepONets ( lu2021DeepONet ) , Fourier Neural Operators (FNOs) ( li2021FNO ) –learn mappings between infinite-dimensional function spaces, generalizing across inputs without discretization. Despite strong promise, both approaches often endure slow or unstable convergence, spectral bias, and sensitivity to loss-weight choices ( krishnapriyan2021PINN_failures ) . Heuristics such as adaptive sampling ( mao2023physics ; tang2024adversarial ) and weight-update rules ( mcclenny2023self-adaptive ; xiang2022self_adapt_bal ; wang2024improved_NS ) mitigate specific failure modes, but broader challenges–especially efficient, few-shot learning of surrogates for forecasting–remain open. An alternative to regression-style ML surrogates is neural differential equations (NDEs), which learn the governing equations or “right-hand-side” (RHS) of an ordinary (ODE) or partial differential equation with a neural network and make predictions by timestepping the learned equations using a numerical solver ( chen2018neural ; AKHARE2025118280 ) . When only part of the RHS is learned, the models are termed universal differential equations (UDEs) rackauckas2020universal or hybrid models melland2021differentiable ; kochkov2021machine ; yu2023climsim . NDEs–including neural ODEs (NODEs) and neural PDEs (NPDEs)–inherit the computational cost of simulation models because they are themselves ODE or PDE solvers, yet they offer advantages over (possibly physics-constrained) regression-type surrogates. Even when governing equations are known, recasting a large, complex simulation as an NPDE can simplify equation-level manipulation–for example, linearizing NPDE for stability analysis ( Brenowitz2019 ) or obtaining gradients via adjoint or automatic differentiation–relative to linearizing or differentiating the original codebase. When the true governing equations are not known but are imperfectly approximated by a simulator, an NDE emulator of that simulator can serve as a “prior” over unknown system dynamics that can be updated with measurements ( DeGennaro2019 ) . Moreover, intrusive model-reduction techniques can be applied directly to the NPDE to accelerate simulation while avoiding the software complexity of modifying a mature codebase ( Chen2012 ; DeGennaro2019 ; prakash2025nonintrusive ) . Some approaches learn resolution-specific local discretizations for stable long-horizon rollouts on coarse grids maddu2023stencil , whereas autoregressive next-step predictors bar2019learning ; hsieh2019learningPDE iteratively apply a neural network to advance the state–an approach akin to discrete flow-map learning under partial observation churchill2022deep . Learning the governing equations of PDE systems in neural representations can be viewed as a special form of system identification, and NPDEs/UDEs are commonly trained on long solution trajectories. When data are generated from a simulation code rather than experiments, we can greatly control the training data. Specifically, in a simulation, we can precisely control the initial and boundary conditions, domain size, grid resolution, timestep, and other numerics, enabling designing more sample-efficient training sets for system identification and neural PDE training. Yet PDE solutions exhibit strong spatiotemporal redundancy–neighboring cells and successive timesteps often contain very similar states–so long integrations expend compute on simulating states that provide little independent information about the system’s governing dynamics. We instead sample from a space-filling design of local stencil states, emphasizing statistically independent configurations and underrepresented regions of state space. To achieve this, we observe that numerical PDE solvers are often implemented in terms of a stencil operator : a spatially discretized RHS of the PDE determining the evolution of a grid cell’s state as a function of the state vector in a local “stencil” neighborhood of that cell caramia2025practical . Due to locality and homogeneity of the PDE’s governing equations, the same stencil operation is applied at every grid cell at every timestep. Rather than collecting an ensemble of costly, high-dimensional solution trajectories, we learn this stencil mapping from large numbers of computationally inexpensive stencil evaluations of the PDE. Conceptually, this corresponds to running the simulator over the neighborhood of a single grid cell for a single timestep across a statistically designed collection of local states. At the core of our proposed approach lies a neural stencil emulator (NSE) that performs system identification in function space: it infers the model structure or functional form of the PDE RHS directly from grid-cell simulation data. NSE training leverages large amounts of grid-cell-level simulation data that are inexpensive to generate and often with no more than a single simulation. This non-intrusive scheme combines the scalability of data-driven models with the interpretability of mechanistic stencils, yielding an efficient, physics-aware surrogate for PDE evolution. Our contributions are as follows: \bullet We introduce the Neural Stencil Emulator ( NSE ), a non-intrusive, data-driven system-identification framework that learns the governing equations of computer models from inexpensive stencil evaluations, enabling stable forecasting;