PGOT: A Physics-Geometry Operator Transformer for Complex PDEs
Zhuo Zhang, Xi Yang, Yuan Zhao, Canqun Yang · 2025
Read PGOT: A Physics-Geometry Operator Transformer for Complex PDEs by Zhuo Zhang, Xi Yang, Yuan Zhao, Canqun Yang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-23192.txt.
Introduction
Zhuo Zhang and co-authors present PGOT, a transformer designed to solve partial differential equations on large, irregular meshes with complex geometry. Transformers hold promise as equation solvers, but shrinking feature dimensions to save computation smears out boundary detail, a failure the authors call geometric aliasing. PGOT is built to keep that physical and geometric information explicit while staying efficient.
Its attention module, SpecGeo-Attention, injects multi-scale geometric encodings through a physics slicing mechanism and preserves spectral detail at linear computational cost. The network also routes work adaptively: smooth regions of a flow take cheap low-order linear paths, while shocks and discontinuities are sent down high-order nonlinear paths, chosen by spatial location. Across four standard benchmarks PGOT reached state-of-the-art accuracy, and it performed strongly on large industrial tasks including airfoil and automobile design, where geometry is exactly what cannot be blurred away.
Catalog record
| CREATOR | Zhuo Zhang, Xi Yang, Yuan Zhao, Canqun Yang |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 52 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2512-23192
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
PGOT: A Physics-Geometry Operator Transformer for Complex PDEs Zhuo Zhang, Xi Yang, Yuan Zhao, Canqun Yang Abstract While Transformers have demonstrated remarkable potential in modeling Partial Differential Equations (PDEs), modeling large-scale unstructured meshes with complex geometries remains a significant challenge. Existing efficient architectures often employ feature dimensionality reduction strategies, which inadvertently induces Geometric Aliasing, resulting in the loss of critical physical boundary information. To address this, we propose the Physics-Geometry Operator Transformer (PGOT), designed to reconstruct physical feature learning through explicit geometry awareness. Specifically, we propose Spectrum-Preserving Geometric Attention (SpecGeo-Attention). Utilizing a “physics slicing-geometry injection” mechanism, this module incorporates multi-scale geometric encodings to explicitly preserve multi-scale geometric features while maintaining linear computational complexity O ( N ) O(N) . Furthermore, PGOT dynamically routes computations to low-order linear paths for smooth regions and high-order non-linear paths for shock waves and discontinuities based on spatial coordinates, enabling spatially adaptive and high-precision physical field modeling. PGOT achieves consistent state-of-the-art performance across four standard benchmarks and excels in large-scale industrial tasks including airfoil and car designs. 1 Introduction Partial Differential Equations (PDEs), derived from fundamental principles such as conservation of mass and energy, are ubiquitous in modeling complex phenomena across science and engineering, including fluid dynamics, structural mechanics, and climate modeling ( Cao et al. 2025 ) . Traditional numerical methods, such as the Finite Element Method (FEM) ( Zienkiewicz & Taylor 2005 ) and Finite Volume Method (FVM) ( Eymard et al. 2000 ) , approximate solutions by discretizing PDEs onto meshes ( Chen et al. 2025 ) . However, their reliance on dense mesh discretization imposes a heavy computational burden, often requiring days or even months for multi-physics problems necessitating fine spatiotemporal resolution. Recently, Neural PDE Solvers have emerged as a promising paradigm, capable of learning resolution-invariant solution mappings between infinite-dimensional function spaces ( Wang et al. 2025a ; Li et al. 2025 ) . By training on offline data, these operators can predict families of solutions under varying parameters orders of magnitude faster than traditional solvers, offering a promising direction for real-time scientific computing. Figure 1 : Efficiency and accuracy comparison on standard benchmarks. (a) Inference speed vs. Memory usage. Bubble size indicates model size. (b) Multi-dimensional performance metrics on PDE and industrial datasets. Early spectral-based neural operators, such as the Fourier Neural Operator (FNO) ( Li et al. 2021 ) , rely on the fast fourier transform. While they possess the remarkable ability to learn resolution-independent operators, they are inherently limited to regular grids, restricting their applicability to complex geometries and unstructured meshes. To address this, graph-based neural operators ( Hao et al. 2023 ; Li et al. 2023b ) treat input and output functions as graphs, employing message-passing mechanisms to generalize across different domain geometries. However, graph methods are often constrained by local receptive fields, making it difficult to effectively capture global long-range dependencies and suffering from low efficiency on large-scale nodes. This necessitates the adoption of Transformers. The self-attention mechanism in Transformers is mathematically analogous to learning a global Green’s function ( Cao 2021 ) , making it ideally suited for modeling non-local physical interactions ( Alkin et al. 2024 ; Koshizuka et al. 2024 ) . However, a fundamental scalability barrier remains: the standard self-attention mechanism exhibits quadratic computational complexity \mathcal{O}(N^{2}) with respect to the number of mesh points N . Given that scientific simulations typically involve 10^{5} to 10^{7} grid points, standard Transformers are computationally intractable for high-resolution physics. Consequently, the research frontier has shifted towards efficient linear transformers ( Li et al. 2023c ; Luo et al. 2025 ; Wu et al. 2024 ) . Recent state-of-the-art methods employ strategies such as low-rank approximations or token clustering to reduce the effective sequence length, achieving linear complexity \mathcal{O}(N) ( Rao et al. 2021 ; Xiao et al. 2024 ) . While these architectures successfully improve throughput, they often do so at the cost of geometric and physical fidelity, as follows: L1): Aggregating local mesh points into latent tokens implicitly acts as a spatial low-pass filter, causing geometric aliasing where high-frequency boundary details are erased. L2): Allocating a uniform computational budget across the domain neglects physical heterogeneity, resulting in over-smoothed shocks in discontinuity regions and redundant computations in smooth flows. To bridge the gap between computational efficiency and high-fidelity physical modeling, we present the Physics-Geometry Operator Transformer (PGOT). Unlike prior methods that treat geometry merely as a supplementary input, PGOT intertwines physical state aggregation with explicit geometric reconstruction. Specifically, PGOT first projects physical fields into compact latent slices, while explicitly injecting multi-scale geometric embeddings during the reconstruction phase. This eliminates geometric aliasing caused by conventional dimensionality reduction while maintaining \mathcal{O}(N) linear complexity (Solving L1) . Subsequently, the model dynamically routes computational paths based on local flow complexity. This design ensures the model is both spectrum-preserving to avoid aliasing and spatially adaptive to handle physical heterogeneity (Solving L2) . Extensive experiments demonstrate that PGOT achieves state-of-the-art performance on standard benchmarks and industrial applications, as illustrated by the efficiency-accuracy trade-off in Figure 1 . Our main contributions are as follows: • Our proposed PGOT framework addresses the geometric aliasing bottleneck inherent in complex mesh modeling, thereby reconciling computational efficiency with physical fidelity. • We propose the SpecGeo-Attention mechanism to decouple global physical aggregation from local geometric reconstruction via a “physics slicing-geometry injection” paradigm, thereby preserving complex boundary features with high fidelity. • By dynamically routing computations to linear or non-linear paths based on flow heterogeneity, the Taylor-decomposed Feed-Forward Network efficiently captures multi-scale physical features while enhancing model interpretability. 2 Related Work 2.1 Physics-Informed Neural Networks Physics-Informed Neural Networks (PINNs) ( Raissi et al. 2019 ) represent a foundational paradigm for solving PDEs by embedding governing equations directly into the loss function. PINNs parameterize the solution as a neural network and minimize the PDE residual at collocation points, enabling mesh-free training without labeled simulation data. However, PINNs face fundamental limitations for the problems we target. First, PINNs solve individual PDE instances, requiring complete retraining for each new parameter configuration or boundary condition—a prohibitive cost for design optimization requiring thousands of evaluations. Second, for complex geometries and multi-physics coupling, PINNs frequently encounter ill-conditioning issues ( Zhang et al. 2025 ) , often leading to convergence failures or accuracy degradation. Although recent research has alleviated these problems through parameterization ( Cho et al. 2024 ) , meta-learning ( Cheng & Alkhalifah 2025 ) , and transfer learning ( Wang et al. 2025b ) strategies, PINNs still struggle to maintain accuracy and efficiency when the configuration space becomes sufficiently large. These limitations motivate the development of the neural operator paradigm. 2.2 Neural Operators for PDEs Neural operators have emerged as a powerful paradigm for learning resolution-invariant mappings between infinite-dimensional function spaces ( Kovachki et al. 2023 ) . DeepONet ( Lu et al. 2021 ) pioneered this field by approximating operators through a Branch-Trunk architecture. Subsequently, the Fourier Neural Operator (FNO) ( Li et al. 2021 ) established new benchmarks by parameterizing the integral kernel directly in the frequency domain using FFT. To address the limitations of standard FNO, numerous variants have been proposed: U-NO ( Rahman et al. 2023 ) and U-FNO ( Wen et al. 2022 ) integrate U-Net structures