Physics-Aligned Canonical Equivariant Fourier Neural Operator under Symmetry-Induced Shifts
Jiaxiao Xu, Changhong Mou, Yeyu Zhang, Fengxiang He · 2026
Read Physics-Aligned Canonical Equivariant Fourier Neural Operator under Symmetry-Induced Shifts by Jiaxiao Xu, Changhong Mou, Yeyu Zhang, Fengxiang He (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-18606.txt.
Introduction
Jiaxiao Xu and three co-authors present PACE-FNO, a 2026 physics-aligned canonical-frame method for Fourier neural operators under coordinate shifts. It gauges the frame, predicts after pulling the field to a canonical sample, and restores the requested end frame. On shifted Burgers and shallow-water systems it cuts out-of-sample relative error by up to 12-fold. The rival is a data-augmented FNO. A matched control credits the gain to canonical-frame prediction, and regional WeatherBench2 tests show near-identical results to FNO.
Catalog record
| CREATOR | Jiaxiao Xu, Changhong Mou, Yeyu Zhang, Fengxiang He |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 82966 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.18606
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Physics-Aligned Canonical Equivariant Fourier Neural Operator under Symmetry-Induced Shifts Jiaxiao Xu, Changhong Mou, Yeyu Zhang, Fengxiang He Abstract Neural operators approximate PDE solution maps, but they need not respect the symmetries of the governing equation. In out-of-distribution (OOD) regimes, a standard neural operator must often learn coordinate alignment and physical evolution within a single map, which can hurt generalization. We use known continuous symmetries of evolution equations on periodic domains to separate these two roles. We propose the Physics-Aligned Canonical Equivariant Fourier Neural Operator (PACE-FNO), which estimates the input frame with a Lie-algebra coordinate estimator, maps the field to a reference frame, applies a standard Fourier Neural Operator (FNO), and restores the prediction to the target frame. We train alignment and operator prediction jointly using bounded symmetry perturbations, with an optional low-dimensional refinement step that updates the estimated frame at inference. Equivariance is enforced by the input and output transformations, while the FNO architecture remains unchanged. Across 1-D and 2-D Burgers, shallow-water, and Navier-Stokes equations on periodic domains, PACE-FNO matches the in-distribution (ID) accuracy of standard neural operators and reduces out-of-distribution (OOD) relative error by up to 12 × 12\times over FNO with symmetry augmentation (FNO+Aug) under translations and Galilean shifts, with smaller gains for coupled rotation-translation shifts. Ablations show that aligning the input and restoring the output frame account for most OOD gains; inference-time refinement provides a smaller correction. 1 Introduction Neural operators learn maps between function spaces and approximate PDE solution operators [ 19 , 25 , 29 , 22 , 3 ] . We study maps \mathcal{G}^{\dagger}:\mathcal{A}\to\mathcal{U} from input to output fields for parametric PDEs, fluid simulation, and weather modeling [ 50 , 33 , 6 , 28 ] . Once trained, these models generalize across parameters and discretizations without rerunning a solver, but out-of-distribution (OOD) generalization remains a central challenge. The difficulty comes from a geometric mismatch. Many PDE solution operators are equivariant under continuous symmetry groups: translated, rotated, or co-moving inputs induce outputs transformed by the same group action [ 31 , 7 , 14 ] . If training data lie near a canonical slice of the orbit [a]=\{\mathcal{C}_{g}(a)\mid g\in G\} , physically equivalent inputs can fall outside the sampled coordinate range even though the equation is unchanged. Spectral truncation can amplify this mismatch when transformed fields move energy outside retained modes [ 53 ] . Thus small in-distribution (ID) error on canonical samples need not imply small error along the group orbit. We address OOD generalization by exploiting continuous PDE symmetries, including translation, rotation, and Galilean boost. These transformations preserve the solution operator up to induced input and output actions, yet move observations along group orbits not covered by the canonical training measure. For this regime we propose the Physics-Aligned Canonical Equivariant Fourier Neural Operator (PACE-FNO), which decouples symmetry alignment from dynamics prediction. PACE-FNO trains a Lie-algebra coordinate estimator jointly with a standard Fourier Neural Operator (FNO), so the canonicalizer adapts to the target dynamics. Its default inference path is one-shot; per-sample group optimization is only an optional frozen-weight refinement. In practice, PACE-FNO maps each OOD input to a canonical frame, applies the FNO there, and pushes the prediction back to the target frame. We study equations on tori, i.e. periodic domains \mathbb{T}^{d} , where OOD samples come from bounded group actions that preserve the equation and boundary conditions. The method targets symmetry-induced shifts [ 7 , 38 , 36 , 17 , 30 , 12 ] , not arbitrary distribution shift. Solution Space \mathcal{M} Out-of-distribution orbit Canonical slice (ID) \tilde{a}_{c} a_{\mathrm{aug}} \mathcal{C}_{g}\tilde{a}_{c} \mathcal{C}_{g}^{-1}a_{\mathrm{aug}} canonical slice \tilde{a}_{c} FNO \tilde{u}_{c} \hat{u}_{\mathrm{pred}} \mathcal{C}_{\hat{g}} (a) Orbit on \mathcal{M} x g_{1}\!\cdot\!x g_{2}\!\cdot\!x [x]=\{g\!\cdot\!x\mid g\in G\} \tilde{x} canonicalization Equivalence-class mapping orbit / class [x] canonicalization \tilde{x} orbit-class view [\tilde{x}]\in\mathcal{M}/G (b) Figure 1: Geometric view of PACE-FNO. (a) The input is pulled from its observed orbit to a canonical slice, evolved there, and pushed forward to the target frame. (b) Points connected by the group action share an orbit [x]=\{g\cdot x\mid g\in G\} ; canonicalization chooses one representative \tilde{x} from each equivalence class. Contributions. • A Lie-algebra canonicalization layer for solution operators on fields over tori. It uses spectral group actions and terminal-frame correction, and wraps a standard FNO predictor without changing its architecture. • An error decomposition for symmetry-induced OOD shifts that separates canonical operator approximation from input and output alignment errors, showing when canonicalization helps (Theorem 3.1 ). • Empirical evaluations on 1-D and 2-D Burgers, shallow-water, and Navier-Stokes equations on tori. One-shot canonicalization reduces OOD error by up to 12\times on shifts dominated by translation and by 3 – 9\% on coupled rotation-translation shifts, while TTA gives an optional accuracy-latency trade-off. Related works. Existing approaches address symmetry-induced OOD generalization in three main ways, but each leaves part of the frame alignment to the predictor or to inference-time optimization: (1) Data augmentation. [ 48 , 5 , 1 ] exposes the model to transformed samples, but the learned operator still represents frame alignment and PDE evolution in one map, tying performance to the sampled range. PACE-FNO instead removes the estimated group action before prediction and restores the terminal frame afterward, so the FNO operates mainly on the canonical slice. (2) Equivariant architectures. [ 11 , 14 , 40 , 34 ] enforce commutation by design and give strong inductive bias when the representation and discretization are fixed. They can also restrict architectural choices or require problem-specific group representations. PACE-FNO keeps the standard FNO architecture and imposes equivariance through input/output group actions, separating symmetry handling from the spectral predictor. (3) Canonicalization methods. [ 36 , 17 , 30 , 12 ] estimate a frame correction, predict in a standard frame, and restore the output frame. The closest prior work, LieLAC [ 38 ] , adds an energy-based Lie-group canonicalizer to a pretrained model and solves a group optimization problem at inference, with optional fine-tuning. PACE-FNO learns the Lie-algebra coordinate estimator jointly with the operator, using PDE-specific terminal-frame correction. 2 Preliminaries Operator learning. Let \mathcal{A} and \mathcal{U} be Banach spaces of input and output fields [ 22 , 25 , 26 , 9 , 45 , 8 ] . The physical solution operator is \mathcal{G}^{\dagger}:\mathcal{A}\to\mathcal{U} , and \mathcal{G}_{\theta} is its learned finite-dimensional approximation. Empirical training minimizes \|\mathcal{G}^{\dagger}-\mathcal{G}_{\theta}\|^{2}_{L^{2}_{\mu}(\mathcal{A};\mathcal{U})}=\mathbb{E}_{a\sim\mu}\|\mathcal{G}^{\dagger}(a)-\mathcal{G}_{\theta}(a)\|^{2}_{\mathcal{U}}, while approximation theory uses the compact-set metric \sup_{a\in K}\|\mathcal{G}^{\dagger}(a)-\mathcal{G}_{\theta}(a)\|_{\mathcal{U}} . Out-of-distribution (OOD) construction. The training measure is supported near a canonical slice, not the full orbit of symmetry-equivalent states. Let \mu_{c} be the canonical data distribution and P_{G} a distribution over bounded group elements. The induced OOD measure is a_{\mathrm{OOD}}=\mathcal{C}_{g}(a_{c}),\qquad a_{c}\sim\mu_{c},\quad g\sim P_{G}. The target operator is unchanged up to the induced group action; only the input-output frame moves. Thus the OOD split tests frame generalization, not viscosity, forcing, solver, or boundary-condition variation. Lie groups and induced actions. Let G act smoothly on the spatial domain \Omega [ 20 ] , inducing [\mathcal{C}_{g}a](x)=a(g^{-1}\cdot x) on fields. Since G is generally nonlinear [ 23 ] , we use Lie-algebra coordinates \xi\in\mathfrak{g}=T_{e}G and recover g=\exp(\xi). For a basis \{v_{1},\ldots,v_{k}\} of \mathfrak{g} , a generator expands as \xi=\sum_{j=1}^{k}\alpha_{j}v_{j} , so the estimator regresses the local coordinates \alpha_{j} before applying the exponential map. PACE-FNO uses this representation for translations, rotations, and problem-specific kinematic components. Symmetries of PDEs