Frequency Bias and OOD Generalization in Neural Operators under a Variable-Coefficient Wave Equation

Runlong Xie, An Luo · 2026

Read Frequency Bias and OOD Generalization in Neural Operators under a Variable-Coefficient Wave Equation by Runlong Xie, An Luo (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-12997.txt.

Introduction

Xie and Luo test how neural operators that solve wave equations cope with shifts in their inputs. They compare the Fourier Neural Operator and DeepONet on a one-dimensional variable-coefficient wave equation, varying input frequency and coefficient smoothness separately. Smoothness shifts leave both models stable, with the Fourier model more accurate. Frequency shifts hurt the Fourier model sharply on unseen high frequencies, while DeepONet degrades more gently despite higher overall error.

Catalog record

CREATORRunlong Xie, An Luo
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE45550
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.12997

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Frequency Bias and OOD Generalization in Neural Operators under a Variable-Coefficient Wave Equation Runlong Xie, An Luo Abstract Neural operators learn to map initial conditions to the terminal solution of partial differential equations (PDEs), providing a surrogate for the full operator mapping. This enables rapid prediction across different input configurations. While recent neural operator architectures have demonstrated strong performance on diverse PDE tasks, their behavior under structured distribution shifts remains insufficiently understood. To investigate this, we study operator learning in a wave propagation setting governed by a one-dimensional variable-coefficient wave equation, using two representative architectures, the Fourier Neural Operator (FNO) and the Deep Operator Network (DeepONet). To examine their generalization under distribution shifts, we consider structured out-of-distribution (OOD) settings that independently vary input frequency and coefficient smoothness. The results show that under smoothness shifts, both models maintain stable performance, with FNO achieving lower error. In contrast, under frequency shifts, FNO exhibits a sharp increase in error under unseen high-frequency inputs, whereas DeepONet shows milder degradation despite higher overall error. Our analysis reveals that these differences arise from how each architecture represents and responds to variations in frequency structure. Together, these findings highlight a fundamental gap between strong in-distribution performance and generalization under distribution shifts in operator learning, underscoring the role of architectural representation bias in developing more reliable neural operators for physics-based PDE simulations beyond the training distribution. 1 Introduction Neural operators learn mappings between input functions and PDE solutions, providing a surrogate for repeated numerical simulation ( 21 ; 16 ; 11 ) . Once trained, these models can rapidly predict solutions under different input configurations, making them attractive for scientific simulation, surrogate modeling, and computational physics ( 10 ; 25 ) . Recent neural-operator architectures have demonstrated strong empirical performance across a variety of PDE tasks, including fluid dynamics, transport problems, and wave propagation ( 21 ; 16 ; 11 ) . Among existing neural operator architectures, the Fourier Neural Operator (FNO) and Deep Operator Network (DeepONet) are two representative approaches with substantially different operator representations. FNO constructs global representations through spectral convolution in Fourier space, allowing the model to efficiently learn couplings among frequency components ( 15 ; 16 ) . DeepONet instead adopts a branch–trunk decomposition that combines representations of input functions and spatial coordinates to approximate function-to-function mappings ( 21 ; 33 ) . These models therefore provide two distinct perspectives on how neural operators represent PDE solution structure. Recent work has further extended neural operators toward larger-scale and more flexible PDE solvers, including physics-informed operator learning, graph-based operators, transformer-based PDE models, and pretrained foundation-style operator architectures ( 19 ; 4 ; 26 ; 35 ; 8 ; 2 ; 22 ) . Despite these advances, the behavior of neural operators under structured distribution shifts remains insufficiently understood ( 6 ; 27 ) . Existing studies have primarily focused on improving predictive accuracy, scalability, or geometric flexibility ( 11 ; 17 ) , while comparatively less attention has been paid to how different operator representations respond to systematic changes in input structure ( 27 ; 20 ) . In particular, it remains unclear whether strong in-distribution performance necessarily leads to stable extrapolation when the input frequency content or medium structure differs from the training distribution ( 20 ; 36 ) . This question is important in real-world scientific applications, where models are often applied to physical systems that differ systematically from the data used for training. Meanwhile, increasingly complex neural operator models introduce additional interacting factors ( 34 ; 11 ) , making it harder to isolate how the underlying operator representation itself influences generalization behavior. We therefore focus on FNO and DeepONet as two canonical and structurally transparent neural operators that provide a controlled setting for studying how different operator representations affect PDE solution behavior. To investigate this problem, we study a terminal-state operator learning task governed by a one-dimensional variable-coefficient wave equation, which captures a basic form of wave propagation in media with spatially varying material properties ( 1 ; 14 ) . Given an initial displacement field and a spatially varying wave-speed coefficient, the objective is to predict the wave solution at a fixed future time. To examine model generalization under distribution shift, we construct structured out-of-distribution (OOD) settings that independently vary input frequency and coefficient smoothness. Rather than focusing only on predictive accuracy, our goal is to understand why different neural-operator architectures exhibit distinct degradation behavior under structured changes in the input distribution ( 3 ; 18 ) . We therefore combine standard error metrics with spectral analysis and structured OOD evaluation to study how operator representations interact with frequency structure. The contributions of this work are threefold. First, we formulate a terminal-state operator learning task based on a conservative variable-coefficient wave equation and construct both in-distribution (ID) and structured OOD evaluation settings. Second, we provide a controlled empirical comparison between FNO and DeepONet under a unified experimental framework, enabling direct assessment of architectural effects. Third, we combine spectral-error analysis with structured OOD testing to study degradation behavior across frequency regimes, providing empirical insight into how neural-operator architectures generalize in physically structured PDE settings. 1.1 Related Work Wave Equations and Wave Propagation Modeling. Wave equations are fundamental models for describing the propagation of energy and signals in space and time, with broad applications in acoustics, electromagnetics, structural vibration, and seismic imaging ( 23 ; 1 ; 7 ) . In many practical systems, the propagation speed varies spatially rather than remaining constant. For instance, seismic waves traveling through layered media depend strongly on local material properties ( 32 ; 30 ) . Such phenomena are commonly modeled using variable-coefficient wave equations, where spatially varying coefficients govern reflection, scattering, and local propagation behavior ( 1 ; 14 ) . Many applications involving wave-type PDEs, including seismic inversion, uncertainty quantification, and design optimization, require repeated simulations under varying initial conditions or material parameters ( 31 ; 24 ) . Traditional numerical methods, such as finite-difference and finite-element solvers, typically recompute the solution for each new configuration, leading to rapidly increasing computational cost as physical complexity and parameter dimensionality grow ( 13 ; 29 ) . This computational burden motivates the development of operator learning methods that directly approximate mappings between input functions and solution fields. Neural Operator Architectures. Among existing neural operator architectures, FNO ( 16 ) and DeepONet ( 21 ) are two representative architectures with substantially different inductive structures. Building on these canonical models, several extensions have been proposed to improve physical consistency, geometric flexibility, and scalability. Physics-Informed Neural Operator (PINO) incorporates PDE residual constraints into the training process ( 19 ) . Graph Neural Operator extends operator learning to irregular geometries using graph-based representations ( 26 ) , while Galerkin Transformer employs attention mechanisms to improve long-range interaction modeling ( 4 ) . More recent work has further explored large-scale PDE foundation models, including Transolver, POSEIDON, and UPT ( 35 ; 8 ; 2 ) . These developments have substantially improved model scalability and empirical performance. However, they also introduce additional interacting factors, including attention mechanisms, pretraining strategies, and latent-space compression, which makes it more difficult to isolate how the underlying operator representation itself influences generalization behavior. Therefore, in this

Read the complete text