Scaled-cPIKANs: Domain Scaling in Chebyshev-based Physics-informed Kolmogorov-Arnold Networks
Farinaz Mostajeran, Salah A Faroughi · 2025
Read Scaled-cPIKANs: Domain Scaling in Chebyshev-based Physics-informed Kolmogorov-Arnold Networks by Farinaz Mostajeran, Salah A Faroughi (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-02762.txt.
Introduction
Farinaz Mostajeran and Salah A Faroughi present a new neural network method for solving physics equations, in a paper from twenty twenty-five. Such networks learn by building the rules of an equation into their training. They often fail, though, when the solution waves up and down fast across a wide region.
Their method pairs a network built from special curve-fitting polynomials with a rescaling step. The rescaling maps any wide region onto the fixed range those polynomials need. Tests covered four classic equations, in both forward and reverse forms, even with noisy data. The new method reached far higher accuracy and faster convergence than the methods it was compared with.
Catalog record
| CREATOR | Farinaz Mostajeran, Salah A Faroughi |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 76 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-02762
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Scaled-cPIKANs: Domain Scaling in Chebyshev-based Physics-informed Kolmogorov-Arnold Networks Farinaz Mostajeran, Salah A Faroughi Abstract Partial Differential Equations (PDEs) are integral to modeling many scientific and engineering problems. Physics-informed Neural Networks (PINNs) have emerged as promising tools for solving PDEs by embedding governing equations into the neural network loss function. However, when dealing with PDEs characterized by strong oscillatory dynamics over large computational domains, PINNs based on Multilayer Perceptrons (MLPs) often exhibit poor convergence and reduced accuracy. To address these challenges, this paper introduces Scaled-cPIKAN, a physics-informed architecture rooted in Kolmogorov-Arnold Networks (KANs). Scaled-cPIKAN integrates Chebyshev polynomial representations with a domain scaling approach that transforms spatial variables in PDEs into the standardized domain [ − 1 , 1 ] d [-1,1]^{d} , as intrinsically required by Chebyshev polynomials. By combining the flexibility of Chebyshev-based KANs (cKANs) with the physics-driven principles of PINNs, and the spatial domain transformation, Scaled-cPIKAN enables efficient representation of oscillatory dynamics across extended spatial domains while improving computational performance. We demonstrate Scaled-cPIKAN efficacy using four benchmark problems: the diffusion equation, the Helmholtz equation, the Allen-Cahn equation, as well as both forward and inverse formulations of the reaction-diffusion equation (with and without noisy data). Our results show that Scaled-cPIKAN significantly outperforms existing methods in all test cases. In particular, it achieves several orders of magnitude higher accuracy and faster convergence rate, making it a highly efficient tool for approximating PDE solutions that feature oscillatory behavior over large spatial domains. \geometry textwidth=0.8textheight=0.9 1 Introduction Physics-informed neural networks (PINNs) are a class of deep learning frameworks that directly integrate physical laws, often expressed by partial differential equations (PDEs), directly into the neural network training process [ 1 ] . PINNs use the universal approximation capabilities of Multilayer Perceptrons (MLPs) to resolve forward and inverse problems across a wide range of domains, such as fluid mechanics [ 2 , 3 ] , solid mechanics [ 4 , 5 ] , biomedical engineering [ 6 , 7 ] , materials sciences and engineering [ 7 , 8 ] , and many more [ 9 ] . Their strengths lie in flexibility, simplicity, and the embedding of physical knowledge into the data-driven model, making them very popular for various applications [ 10 ] . However, due to the use of MLPs in their architectures, they also face several challenges such as high computational costs for multi-dimensional PDEs, large-scale spatiotemporal domain, sensitivity to hyperparameter tuning, and training difficulties such as vanishing gradients [ 11 , 12 , 13 , 14 ] . In addition, resolving sharp transitions in highly dynamical systems often requires a lot of hand-tuning, which restricts their scalability [ 15 , 16 ] . To address the limitations of traditional PINNs based on MLPs, the scientific machine learning community has begun to explore replacements for MLPs, such as a prominent one known as the Kolmogorov-Arnold Network (KAN) [ 17 , 18 , 19 ] . KANs are inspired by the Kolmogorov-Arnold representation theorem that expresses multivariate functions as sums and compositions of univariate functions [ 20 , 21 ] . Unlike MLPs, KANs replace fixed activation functions with learnable univariate functions, offering a more flexible and adaptive architecture. Physics-informed Kolmogorov-Arnold Networks (PIKANs) [ 19 ] combine the strengths of KANs and PINNs, offering a major advance in scientific machine learning. PIKANs combine the interpretability of KANs with the physics-guided learning capabilities of PINNs, making them highly effective in capturing the dynamics of systems governed by complex PDEs and boundary conditions [ 22 , 23 , 24 ] . Recent studies [ 19 ] have demonstrated that while vanilla KANs with B-splines struggle with robustness and efficiency, variants employing low-order orthogonal polynomials, such as radial basis functions (RBF) [ 25 , 26 ] , wavelets [ 27 , 28 ] , or Chebyshev polynomials [ 29 ] achieve competitive or superior performance than PINNs. This flexibility has led to the development of different implementations [ 30 , 31 , 32 , 33 ] . Despite these strengths, KANs are found to be computationally intensive for high-dimensional problems, and hence, they are slower compared to MLPs [ 19 ] . Moreover, they are sensitive to the choice of basis functions and optimization strategies, which should be designed with care to achieve robust and efficient performance [ 33 ] . These challenges point to the necessity for further advances in KAN-based approaches to make the most of their potential in scientific computing. Therefore, improving the performance and scalability of PIKANs is an active area of research to overcome their limitations and increase their applicability. In this regard, [ 32 ] introduced ChebPIKANs, a model that includes Chebyshev polynomials as basis functions in their construction for enhanced approximation capabilities, stability, and extrapolation in the fluid dynamics problem, avoiding possible overfitting. Constructed upon KANs, ChebPIKAN retains all the benefits of locally learned representations based on the spline and overcomes generalization challenges in conventional neural networks. Moreover, the inclusion of physical information not only enhances the performance, but also provides interpretability to the model to some extent, giving it a more physically meaningful setting than the vanilla MLP architectures. Although ChebPIKANs attain better adaptability and robustness, the mathematical interpretation of their architecture remains a challenge due to the several algorithmic optimizations involved in the process. [ 34 ] also tried to solve different forms of PDEs such as strong form, energy form, and inverse form with Kolmogorov–Arnold-informed neural network (KINN) which essentially involved replacing the MLP with KAN. Although KINN significantly outperforms MLP in terms of accuracy and convergence speed for numerous PDEs in computational solid mechanics, the authors discovered that because of the conflict between grid size and geometric complexity, KAN did not perform as well on complex geometric PDE problems. More recently, [ 35 ] introduced Separable PIKANs (SPIKANs), which apply the principle of variable separation to reduce the computational complexity of KANs. By dedicating each dimension to an independent KAN, SPIKANs achieve remarkable training efficiency for high-dimensional problems without sacrificing accuracy. This decomposition distributes O(N) points to each KAN, reducing memory usage and computation time. However, SPIKANs require a factorizable grid of collocation points rather than the unstructured point clouds typically used in PINNs, which can limit their applicability in some scenarios. These investigations highlight the increasing initiatives to enhance PIKAN frameworks, tackling computational obstacles and broadening their applicability in various scientific domains. Chebyshev polynomials are defined over [-1,1] , which requires input normalization in cKAN layers to ensure stability. [ 29 ] proposed a forward-pass normalization strategy for this purpose. Studies such as [ 32 , 13 , 29 ] emphasize that the absence of normalization often leads to training instability, including divergence and NaN loss after several iterations [ 19 , 29 ] . For example, [ 19 ] observed loss instability when solving high-frequency Helmholtz equations using the cPIKAN model. In this work, we introduce Scaled-cPIKAN, a physics-informed neural network framework that synergizes Chebyshev polynomial-based representations with a scaling approach for spatial variables in governing equations. By combining the adaptive mathematical properties of KANs with the physics-driven principles of PINNs, Scaled-cPIKAN effectively captures high-frequency oscillations and intricate dynamics critical to multi-scale PDE modeling. This architecture works great for complex PDE problems over