PAS-Net: P hysics-informed A daptive S cale Deep Operator Net work
Changhong Mou, Yeyu Zhang, Xuewen Zhu, Qiao Zhuang · 2025
Read PAS-Net: P hysics-informed A daptive S cale Deep Operator Net work by Changhong Mou, Yeyu Zhang, Xuewen Zhu, Qiao Zhuang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-14925.txt.
Introduction
Changhong Mou, Yeyu Zhang, and two co-authors present PAS-Net, a neural operator that learns solution patterns for hard partial differential equations. The target equations are nonlinear, evolve over time, and have tiny parameters that create sharp, localized features. Standard physics-informed operator networks blur exactly those features.
PAS-Net rescales the input coordinates locally around chosen reference points, feeding the network a built-in sense of multiple scales. That rescaling acts like a preconditioner and can be fixed in advance or learned. From the training side, the change reshapes the loss landscape in the network's favor. The design aims at stiff, multiscale problems in fluids and materials where fine detail decides the answer.
Catalog record
| CREATOR | Changhong Mou, Yeyu Zhang, Xuewen Zhu, Qiao Zhuang |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 48 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-14925
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
PAS-Net: P hysics-informed A daptive S cale Deep Operator Net work Changhong Mou, Yeyu Zhang, Xuewen Zhu, Qiao Zhuang Abstract Nonlinear physical phenomena often show complex multiscale interactions; motivated by the principles of multiscale modeling in scientific computing, we propose PAS-Net , a physics-informed Adaptive-Scale Deep Operator Network for learning solution operators of nonlinear and singularly perturbed evolution PDEs with small parameters and localized features. Specifically, PAS-Net augments the trunk input in the physics informed Deep Operator Network (PI-DeepONet) with a prescribed (or learnable) locally rescaled coordinate transformation centered at reference points. This addition introduces a multiscale feature embedding that acts as an architecture-independent preconditioner which improves the representation of localized, stiff, and multiscale dynamics. From an optimization perspective, the adaptive-scale embedding in PAS-Net modifies the geometry of the Neural Tangent Kernel (NTK) associated with the neural network by increasing its smallest eigenvalue, which in turn improves spectral conditioning and accelerates gradient-based convergence. We further show that this adaptive-scale mechanism explicitly accelerates neural network training in approximating functions with steep transitions and strong asymptotic behavior, and we provide a rigorous proof of this function-approximation result within the finite-dimensional NTK matrix framework. We test the proposed PAS-Net on three different problems: (i) the one-dimensional viscous Burgers equation, (ii) a nonlinear diffusion–reaction system with sharp spatial gradients, and (iii) a two-dimensional eikonal equation. The numerical results show that PAS-Net consistently achieves higher accuracy and faster convergence than the standard DeepONet and PI-DeepONet models under a similar training cost. August 24, 2026 1 Introduction The rapid development of scientific machine learning (SciML) has opened new directions for data-driven modeling, analysis, and prediction of complex physical systems governed by partial differential equations (PDEs) [ 10 , 27 , 11 , 38 , 7 ] . In recent years, two major directions have become popular within SciML for solving PDEs: Physics-Informed Neural Networks [ 36 , 5 , 33 ] (PINNs) and operator learning [ 34 , 30 , 40 ] . The first category incorporates the governing PDE constraints directly into the loss function by penalizing the residuals of the differential operators at a set of collocation points. This residual-based formulation, often referred to as the PDE residual loss , enforces the underlying physical laws during training and enables the network to infer continuous solutions even from sparse or noisy observations. Such a physics-informed regularization is particularly advantageous in inverse problems , where unknown physical parameters or boundary conditions are estimated simultaneously with the PDE solution, without the need for large labeled datasets. In contrast, operator learning aims to approximate mappings between infinite-dimensional function spaces, enabling fast surrogate modeling and real-time simulation of parameterized PDEs. Representative frameworks include the Deep Operator Network (DeepONet) [ 34 ] and the Fourier Neural Operator (FNO) [ 30 ] . DeepONet decomposes a nonlinear operator into two subnetworks: a branch network that encodes the input function via its pointwise sensor evaluations, and a trunk network that represents the coordinates of the output field. The outputs of these subnetworks are combined through an inner product to approximate the target solution operator, achieving universal approximation in Banach spaces [ 6 ] . The FNO, on the other hand, works in the frequency domain by applying spectral convolution in Fourier space, which allows efficient capture of long-range dependencies and fast inference on unseen spatial resolutions through the inverse fast Fourier transform (IFFT). Building upon these two approaches, the physics-Informed Deep Operator Network (PI-DeepONet) [ 40 ] incorporate PDE residual losses into the operator-learning framework, which enables simultaneous data-driven and physics-constrained learning of nonlinear PDE solution operators. Despite these advances, operator learning still faces fundamental challenges in handling singularly perturbed and multiscale PDEs, which involve strong scale interactions and stiffness that may hinder accurate and efficient learning. Such equations often involve small parameters that induce multiple spatial or temporal scales, sharp gradients, or boundary and internal layers [ 15 , 24 ] . Traditional numerical methods, such as finite element or finite difference schemes, must employ adaptive meshes, solution space enrichment, or homogenization strategies to resolve these localized structures [ 13 , 20 ] . Analogously, neural operator models trained on uniformly sampled data may suffer from loss of resolution or biased approximation in regions where the solution varies rapidly [ 3 , 37 ] . Another important challenge lies in the optimization and convergence of neural networks when learning solutions of PDEs with limited regularity or strongly varying scales. For problems that exhibit steep transitions, sharp layers, or stiff dynamics, standard neural architectures often suffer from slow or unstable convergence [ 39 , 16 ] , largely due to ill-conditioned loss landscapes and unfavorable spectral properties of the Neural Tangent Kernel (NTK) [ 22 , 26 ] . These difficulties highlight the need for architectural mechanisms that can adapt to local scales and geometric features in the solution space, thereby improving both representational efficiency and optimization stability. Inspired by multiscale modeling principles in scientific computing [ 23 , 19 , 41 , 20 ] , we propose the Physics-Informed Adaptive-Scale Deep Operator Network (PAS-Net) which is a new framework for learning nonlinear operator mappings in partial differential equations (PDEs) that exhibit small-scale parameters, localized structures, or singular perturbations. Our approach also aligns with with the recent progress in multiscale deep neural network (DNN) i.e., including scaling in input features or hidden layers [ 46 , 28 , 29 ] . Unlike conventional neural operator architectures, PAS-Net embeds an adaptive scale feature directly into the trunk network of the Physics-Informed Deep Operator Network (PI-DeepONet). Specifically, the adaptive-scale feature augments the input coordinates with locally rescaled transformations centered around reference points, where both the scaling factors and reference locations can be either prescribed or learned. This embedding enables the network to resolve localized structures across varying spatial scales. Consequently, the adaptive-scale formulation provides an intrinsic multiscale feature representation that acts as a model-independent preconditioner, enhancing both expressivity and training stability when addressing stiff or highly localized dynamics. On the theoretical side, we analyze how the adaptive-scale embedding influences the Neural Tangent Kernel (NTK) [ 21 , 4 ] and show that it increases the smallest eigenvalue, thereby improving spectral conditioning and accelerating convergence. This theoretical insight is consistent with both empirical and analytical evidence, including function-approximation experiments and a rigorous proof within the finite-dimensional NTK matrix framework that adaptive scaling leads to faster and more stable training for functions with steep gradients and strong asymptotic behavior. The main contributions of this work are summarized as follows: • We introduce a new adaptive-scale embedding within the Physics-Informed Deep Operator Network (PI-DeepONet) framework which enables localized rescaling of spatial coordinates around reference points. This design provides an intrinsic multiscale representation that enhances the network’s ability to capture sharp gradients, boundary layers, and stiff dynamics in singularly perturbed PDEs. • We establish a theoretical link between adaptive-scale embeddings and the Neural Tangent Kernel (NTK), showing that the proposed mechanism increases the smallest eigenvalue of the NTK, thereby improving spectral conditioning and accelerating gradient-based convergence. • Through extensive experiments on benchmark test problems including the Burgers, advection, and diffusion–reaction equations, we show that PAS-Net consistently achieves higher accuracy and faster convergence than standard DeepONet and PI-DeepONet models,