Graph-Based Operator Learning from Limited Data on Irregular Domains
Yile Li, Shandian Zhe · 2025
Read Graph-Based Operator Learning from Limited Data on Irregular Domains by Yile Li, Shandian Zhe (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-18923.txt.
Introduction
Yile Li and Shandian Zhe present a study from twenty twenty-five on learning operators that map one function to the answer of an equation. Past stars in this field need a neat grid of points. Real domains are often bent, with points spread in a wild way. Their frame, GOLA, builds a graph from the loose points and learns on that graph.
Attention in the graph net lets far points share facts. A wave based encoder with learnable tones lifts the input function into a rich code, even from sparse points. Tests span four kinds of two dimensional equations. Gains show most when data is scarce. The frame held up across densities of points.
Catalog record
| CREATOR | Yile Li, Shandian Zhe |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 52 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-18923
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Graph-Based Operator Learning from Limited Data on Irregular Domains Yile Li, Shandian Zhe Abstract Operator learning seeks to approximate mappings from input functions to output solutions, particularly in the context of partial differential equations (PDEs). While recent advances such as DeepONet and Fourier Neural Operator (FNO) have demonstrated strong performance, they often rely on regular grid discretizations, limiting their applicability to complex or irregular domains. In this work, we propose a G raph-based O perator L earning with A ttention (GOLA) framework that addresses this limitation by constructing graphs from irregularly sampled spatial points and leveraging attention-enhanced Graph Neural Netwoks (GNNs) to model spatial dependencies with global information. To improve the expressive capacity, we introduce a Fourier-based encoder that projects input functions into a frequency space using learnable complex coefficients, allowing for flexible embeddings even with sparse or nonuniform samples. We evaluated our approach across a range of 2D PDEs, including Darcy Flow, Advection, Eikonal, and Nonlinear Diffusion, under varying sampling densities. Our method consistently outperforms baselines, particularly in data-scarce regimes, demonstrating strong generalization and efficiency on irregular domains. 1 Introduction Learning mappings between function spaces is a fundamental task in computational physics and scientific machine learning, especially for approximating solution operators of partial differential equations (PDEs). Operator learning offers a paradigm shift by learning the solution operator directly from data, enabling fast, mesh-free predictions across varying input conditions. Despite their success, existing operator learning models such as DeepONet ( Lu et al.,, 2019 ) and Fourier Neural Operator (FNO) ( Li et al.,, 2020 ) exhibit notable limitations that restrict their applicability in more general settings. A key shortcoming lies in their reliance on regular, uniform grid discretizations. FNO, for instance, requires inputs to be defined on fixed Cartesian grids to leverage fast Fourier transforms efficiently. This assumption limits their flexibility and generalization ability when applied to problems defined on complex geometries, irregular meshes, or unstructured domains, which are common in real-world physical systems. Furthermore, these models often struggle with sparse or non-uniformly sampled data, leading to degraded performance and increased computational cost when adapting to more realistic, heterogeneous scenarios. To address these limitations, we propose a G raph-based O perator L earning with A ttention (GOLA) framework that leverages Graph Neural Networks (GNNs) to learn PDE solution operators over irregular spatial domains. By constructing graphs from sampled spatial coordinates and encoding local geometric and functional dependencies through message passing, the model naturally adapts to non-Euclidean geometries. To enhance global expressivity, we further incorporate attention-based mechanisms that can capture long-range dependencies more effectively and a Fourier-based encoder that projects input functions into a frequency domain using learnable complex-valued bases. Our model exhibits superior data efficiency and generalization, achieving smaller prediction errors with fewer training samples and demonstrating robustness under domain shifts. The main contributions of this work are as follows: • We introduce GOLA, a unified architecture combining spectral encoding and attention-enhanced GNNs for operator learning on irregular domains. • We propose a learnable Fourier encoder that projects input functions into a frequency domain tailored for spatial graphs. • Through extensive experiments, we demonstrate that GOLA generalizes across PDE types, sample densities, and resolution shifts, achieving state-of-the-art performance in challenging data-scarce regimes. 2 Related Work There are many latest research about graph and attention methods in scientific machine learning ( Xiao et al.,, 2024 ) , Kissas et al., (2022) , Boullé and Townsend, (2024) , Xu et al., (2024) , Jin and Gu, (2023) , Cuomo et al., (2022) Kovachki et al., (2024) , Nelsen and Stuart, (2024) , Batlle et al., (2023) . Graph neural networks for scientific machine learning. Battaglia et al., (2018) applies shared functions over nodes and edges, captures relational inductive biases and generalizes across different physical scenarios. Bar-Sinai et al., (2019) learns data-driven discretization schemes for solving PDEs by training a neural network to predict spatial derivatives directly from local stencils. By replacing hand-crafted finite difference rules with learned operators, it adapts discretizations to the underlying data for improved accuracy and generalization. Sanchez-Gonzalez et al., (2020) predicts future physical states by performing message passing over the mesh graph, capturing both local and global dynamics without relying on explicit numerical solvers. Graph Kernel Networks (GKNs) ( Li et al.,, 2020 ) directly approximates continuous mappings between infinite-dimensional function spaces by utilizing graph kernel convolution layers. PDE-GCN ( Wang et al.,, 2022 ) represents partial differential equations on arbitrary graphs by combining spectral graph convolution with PDE-specific inductive biases. It learns to predict physical dynamics directly on graph-structured domains, enabling generalization across varying geometries and discretizations. The Message Passing Neural PDE Solver ( Brandstetter et al.,, 2022 ) formulates spatiotemporal PDE dynamics by applying learned message passing updates on graph representations of the solution domain. Physics-Informed Transformer (PIT) ( Zhang et al.,, 2024 ) embeds physical priors into the Transformer architecture to model PDE surrogate solutions. It leverages self-attention to capture long-range dependencies and integrates PDE residuals as soft constraints during training to improve generalization. GraphCast ( Lam et al.,, 2024 ) learns the Earth’s atmosphere as a spatiotemporal graph and uses a graph neural network to iteratively forecast future weather states based on past observations. It performs message passing over the graph to capture spatial correlations and temporal dynamics, enabling accurate medium-range forecasts. Attention-based methods for scientific machine learning. U-Netformer ( Liu et al.,, 2022 ) proposes a hybrid neural architecture that combines the U-Net’s hierarchical encoder-decoder structure with transformer-based attention modules to capture both local and global dependencies in PDE solution spaces. Tokenformer ( Zhou et al.,, 2023 ) reformulates PDE solving as a token mixing problem by representing input fields as tokens and applying self-attention across them to model spatial correlations. Tokenized Neural Operators (TNO) ( Jiang et al.,, 2023 ) framework reformulates operator learning as a token-wise attention problem, where spatial inputs are encoded into tokens and processed using Transformer-style architectures. It employs a combination of axial attention and cross-attention to efficiently capture both local and global dependencies across irregular or structured domains. Attention-Based Fourier Neural Operator (AFNO) ( Zhang et al.,, 2024 ) enhances the standard FNO by integrating self-attention layers after each Fourier convolution block to better capture local dependencies and long-range interactions. This hybrid architecture improves the model’s ability to approximate complex solution operators for parametric PDEs by combining spectral global context with spatial attention mechanisms. Our proposed GOLA combines the local relational strengths of attention-enhanced GNNs and the global spectral capabilities of Fourier-based encoding. This hybrid approach has shown notable improvements in generalization and data efficiency, particularly under challenging data-scarce conditions on irregular domains. 3 Methodology 3.1 Problem Formulation Consider the general form of a PDE \mathcal{N}[u](\mathbf{x})=f(\mathbf{x}),\quad\mathbf{x}\in\Omega\times[0,\infty) (1) where \mathbf{x} denotes a compact representation of the spatial and temporal coordinates, \Omega is the spatial domain, and [0,\infty) is the temporal domain. \mathcal{N} is a differential operator, u(\mathbf{x}) is the unknown solution, and f(\mathbf{x}) is a given source term. The objective is to learn the solution operator \mathcal{G}:\mathcal{F}\to\mathcal{U} , where \mathcal{F} and \mathcal{U} are Banach spaces. We assume access to a training dataset \mathcal{D}=\{(f_{n},u_{n})\}_{n=1}^{N} , consisting of multiple input-output function pairs, where each f_{n}(\cdot) and u_{n}(\cdot) is represented by discrete samples over a finite set of points. While