Data-Efficient Time-Dependent PDE Surrogates: Graph Neural Simulators vs. Neural Operators
Dibyajyoti Nayak, Somdatta Goswami · 2025
Read Data-Efficient Time-Dependent PDE Surrogates: Graph Neural Simulators vs. Neural Operators by Dibyajyoti Nayak, Somdatta Goswami (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-06154.txt.
Introduction
Graph-based simulators beat neural operators when training data are scarce, argue Dibyajyoti Nayak and Somdatta Goswami in a 2025 paper. Surrogate models for time-dependent partial differential equations promise fast stand-ins for expensive solvers, but neural operators hunger for data and generalize weakly without it. The authors trace that weakness to global processing that ignores a system's local, discretized structure.
Graph neural simulators instead pass messages between neighboring points and step time like a traditional solver, learning instantaneous rates of change. On five canonical systems, from Burgers' equations to flow past a cylinder, they reach under one percent error with only three percent of the trajectories. They also accumulate far less error over long rollouts than leading operators. A principal-component clustering trick picks the training trajectories.
Catalog record
| CREATOR | Dibyajyoti Nayak, Somdatta Goswami |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 75 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-06154
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Data-Efficient Time-Dependent PDE Surrogates: Graph Neural Simulators vs. Neural Operators Dibyajyoti Nayak, Somdatta Goswami Abstract Developing accurate, data-efficient surrogate models is central to advancing AI for Science. Neural operators (NOs), which approximate mappings between infinite-dimensional function spaces using conventional neural architectures, have gained popularity as surrogates for systems driven by partial differential equations (PDEs). However, their reliance on large datasets and limited ability to generalize in low-data regimes hinder their practical utility. We argue that these limitations arise from their global processing of data, which fails to exploit the local, discretized structure of physical systems. To address this, we propose Graph Neural Simulators (GNS) as a principled surrogate modeling paradigm for time-dependent PDEs. GNS leverages message-passing combined with numerical time-stepping schemes to learn PDE dynamics by modeling the instantaneous time derivatives. This design mimics traditional numerical solvers, enabling stable long-horizon rollouts and strong inductive biases that enhance generalization. We rigorously evaluate GNS on four canonical PDE systems: (1) 2D scalar Burgers’, (2) 2D coupled Burgers’, (3) 2D Allen–Cahn, and (4) 2D nonlinear shallow-water equations, comparing against state-of-the-art NOs including Deep Operator Network (DeepONet) and Fourier Neural Operator (FNO). Results demonstrate that GNS is markedly more data-efficient, achieving < 1 % <1\% relative L 2 L_{2} error using only 3% of available trajectories, and exhibits dramatically reduced error accumulation over time (82.5% lower autoregressive error than FNO, 99.9% lower than DeepONet). To choose the training data, we introduce a PCA+KMeans trajectory selection strategy. These findings provide compelling evidence that GNS, with its graph-based locality and solver-inspired design, is the most suitable and scalable surrogate modeling framework for AI-driven scientific discovery. Code and data are available at the project repository: https://github.com/Centrum-IntelliPhysics/GNS_vs_NOs.git . 1 Introduction Time-dependent partial differential equations (PDEs) are central to the mathematical modeling of a wide range of physical phenomena, from fluid mechanics and material physics to acoustics and geosciences. Classical numerical solvers such as finite difference, finite volume, and finite element methods remain the workhorse for obtaining accurate solutions. However, their computational cost grows rapidly with problem size and complexity. Large-scale simulations can demand millions of core-hours on supercomputers, making them prohibitive in tasks such as design optimization, uncertainty quantification, inverse modeling, or real-time control, which require repeated evaluations under varying conditions. In such scenarios, relying solely on traditional solvers is infeasible. To address this issue, surrogate modeling has emerged as a powerful alternative. By approximating the behavior of high-fidelity simulations, surrogates can deliver rapid and reasonably accurate solutions at a fraction of the computational cost. Early approaches to surrogate modeling were primarily physics-based reduced-order methods, which achieved success in simpler problem settings but struggled with nonlinear, high-dimensional, or complex systems [ 1 , 2 , 3 , 4 , 5 , 6 ] . More recently, machine learning approaches, in particular, neural operators (NOs) [ 7 , 8 , 9 , 10 , 11 , 12 , 13 , 14 ] have gained traction for learning mappings between infinite-dimensional input–output function spaces. Popular architectures among NOs such as the deep operator network (DeepONet) [ 7 ] and Fourier neural operator (FNO) [ 15 ] offer mesh-independent PDE solvers that are scalable to high-dimensional systems, representing a paradigm shift away from traditional numerical pipelines. While NOs can provide rapid inference across a parametric sweep of input conditions, they often require large amounts of training data and can therefore exhibit poor generalization in data-scarce or limited data regimes. One approach to mitigate this limitation is to incorporate physics-informed strategies [ 16 , 17 , 8 , 18 , 19 ] which explicitly enforce that the network’s predictions satisfy the underlying PDE structure, along with initial and boundary conditions. Such physics-informed neural operators have shown promise, but they come with their own set of challenges. In particular, they require explicit knowledge of the governing PDE and accurate specification of initial and boundary conditions – information that may not always be available in realistic or complex systems. Moreover, the optimization of physics-informed loss terms often demands careful hyperparameter tuning, making training a non-trivial task [ 20 , 21 ] . Furthermore, architectures like FNNs [ 22 ] or CNNs [ 23 ] , which NOs often build upon, exacerbate these issues: fully connected networks treat the domain as flattened vectors, discarding spatial structure, while CNNs assume uniform discretizations and rely on kernels that aggregate information in ways that do not reflect physical locality (see Fig. 1 ). As a result, such models can fail to capture the inherently local interactions e.g. , flux exchanges between neighboring elements that drive PDE-governed dynamics. This mismatch limits their utility in real-world physical applications like fluid flow around complex geometries, deformable materials, phase boundaries, or environmental modeling. Figure 1: Comparison of neural network architectures for neural operators in scientific applications. Fully connected neural networks (FNNs) flatten mesh data, discarding spatial structure and compressing high-dimensional inputs into narrow hidden layers, which limits expressivity. Convolutional neural networks (CNNs) require interpolation to uniform grids at both input and output, sacrificing fidelity on unstructured (adaptive) meshes and introducing errors tied to interpolation order. Graph neural networks (GNNs), by contrast, natively represent mesh nodes and edges as graphs, preserving geometry, topology, and physical interactions. Their intrinsic alignment with mesh discretizations, ability to exploit locality, and data efficiency make GNNs the natural choice for Scientific Machine Learning, where irregular geometries and fine discretizations are the norm. Graph-based learning offers a compelling solution for leveraging local interactions by discretizing computational domains as graphs, where nodes correspond to spatial locations and edges encode local connectivity. This representation naturally handles non-uniform meshes and irregular geometries while aligning with the local interactions inherent in physical systems (see Fig. 1 ). Such non-uniform structures are ubiquitous in scientific computing, appearing in mesh-based simulations (finite element and adaptive meshes), particle-based methods (molecular dynamics and smoothed particle hydrodynamics), and point cloud data from geophysical or astronomical observations. In these applications, simulation domains are often defined on unstructured or dynamically deforming meshes, making traditional convolutional architectures poorly suited for direct data processing. Graph Neural Networks (GNNs) have emerged as a powerful framework for learning on graph-structured data through iterative message-passing mechanisms that aggregate information from neighboring nodes, effectively capturing both local dependencies and global structural patterns [ 24 , 25 , 26 , 27 ] . This inherent flexibility enables GNNs to model physical systems with adaptive meshes or spatially heterogeneous properties by learning dynamics directly from data, without requiring structured grids or explicit knowledge of governing PDEs. Unlike CNNs or FNNs, which rely on regular data structures, GNNs propagate information through explicit connectivity patterns, allowing them to capture fine-grained local gradients while maintaining sensitivity to long-range dependencies. This natural alignment with PDE physics makes GNN-based surrogates remarkably data-efficient, capable of learning solution operators from relatively small datasets while generalizing across varying resolutions and scaling effectively to high-dimensional systems. Figure 2: A schematic of the Graph Neural Simulator (GNS) architecture (adapted from [ 28 ] ). Building on the flexibility of GNNs, Graph Neural Simulators (GNS) have been proposed as powerful data-driven surrogates for time-dependent physical systems [ 28 , 29 ] . For completeness, a schematic of the GNS architecture, adapted from [ 28 ] , is presented in