Energy-Dissipative Evolutionary Kolmogorov–Arnold Networks for Complex PDE Systems Journal: arXiv
Guang Lin, Changhong Mou, Jiahao Zhang · 2025
Read Energy-Dissipative Evolutionary Kolmogorov–Arnold Networks for Complex PDE Systems Journal: arXiv by Guang Lin, Changhong Mou, Jiahao Zhang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-01618.txt.
Introduction
Guang Lin and co-authors present EvoKAN, a network that solves partial differential equations by letting its own settings flow with the equation, in a 2025 paper. The base design uses trainable spline curves on each link, which bend locally at many scales. Retraining at every time step would waste that design.
Training happens once, on the starting state alone. After that, the settings evolve under the equation itself, with no further optimization. A helper variable scheme keeps energy stable and each step cheap, solving only simple linear systems. Tests on phase change equations and on fluid flow matched reference solutions over long horizons.
Catalog record
| CREATOR | Guang Lin, Changhong Mou, Jiahao Zhang |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 41 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-01618
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Energy-Dissipative Evolutionary Kolmogorov–Arnold Networks for Complex PDE Systems Journal: arXiv Guang Lin, Changhong Mou, Jiahao Zhang Abstract We introduce evolutionary Kolmogorov–Arnold Networks (EvoKAN), a novel framework for solving complex partial differential equations (PDEs). EvoKAN builds on Kolmogorov–Arnold Networks (KANs), where activation functions are spline-based and trainable on each edge, offering localized flexibility across multiple scales. Rather than retraining the network repeatedly, EvoKAN encodes only the PDE’s initial state during an initial learning phase. The network parameters then evolve numerically, governed by the same PDE, without any additional optimization. By treating these parameters as continuous functions in the relevant coordinates and updating them through time steps, EvoKAN can predict system trajectories over arbitrarily long horizons, a notable challenge for many conventional neural-network-based methods. In addition, EvoKAN integrates the scalar auxiliary variable (SAV) method to guarantee unconditional energy stability and computational efficiency. At individual time step, SAV only needs to solve decoupled linear systems with constant coefficients, the implementation is significantly simplified. We test the proposed framework in several complex PDEs, including one dimensional and two dimensional Allen–Cahn equations and two dimensional Navier-Stokes equations. Numerical results show that EvoKAN solutions closely match analytical references and established numerical benchmarks, effectively capturing both phase-field phenomena (Allen–Cahn) and turbulent flows (Navier–Stokes). 1 Introduction Recently proposed Kolmogorov-Arnold Networks (KANs) [ 42 , 41 ] , originating from the Kolmogorov-Arnold Theorem [ 30 , 31 , 10 ] , have become a promising alternative to traditional multilayer perceptrons (MLPs) in the field of scientific machine learning. Although MLPs have recently received significant attention due to advances in their theory, they are based on trainable weights and biases with predetermined activation functions [ 5 , 62 ] . KANs, on the other hand, use trainable activation functions based on splines, allowing local adjustments and adaptability to different resolutions [ 42 , 41 ] . This shift not only enhances the interpretability of KANs over MLPs but also makes them particularly suitable for applications involving continual learning and handling noisy data. The applications of KANs have also been explored in the context of solving differential equations. For instance, Liu et al. [ 42 ] combined KANs with physics-informed neural networks (PINNs) [ 53 ] to solve a two-dimensional Poisson equation. Likewise, Abueida et al. introduced DeepOKAN [ 1 ] , a KAN operator network based on radial basis functions (RBF), to solve a two-dimensional orthotropic elasticity problem. Both studies imply that KANs significantly outperformed traditional MLP architectures. However, these works did not explore the potential of KANs in more complex systems. However, the use of neural networks to approximate solutions to partial differential equations (PDE) has attracted significant interest over the past decade [ 44 , 38 , 12 , 25 , 29 , 9 , 33 , 69 ] . There are two main approaches: The first learns the PDE operator, mapping initial/boundary conditions to solutions using methods such as DeepONet [ 24 , 44 , 68 ] . Although computationally expensive to train with the available data, these models provide efficient evaluations. The second approach uses neural networks as basis functions to represent a single solution, minimizing residuals and boundary condition mismatches. Among them, physics-informed neural networks (PINNs) [ 11 , 17 , 61 ] have been developed for both forward and inverse problems by enforcing physical laws or information in neural networks. In particular, time-dependent PDEs are solved by minimizing the chosen residuals at pre-selected points across the entire spatio-temporal domain. Although Physics-Informed Neural Networks (PINNs) efficiently compute gradients within PDEs using automatic differentiation, they encounter computational challenges when making long-term predictions of dynamics for time-dependent PDEs due to their lack of temporal causality [ 6 ] . Du et al. [ 19 ] introduced Evolution Deep Neural Networks (EDNN), where the network parameters are dynamically updated to predict the PDE’s evolution over any time span. The parameters in the EDNN are trained solely to capture the initial condition of the system and are subsequently updated recurrently without the need for further training. These updates are performed numerically and are discretized from the governing equations. By advancing the weights in the parameter space, the temporal evolution of the PDE system can be accurately predicted. The EDNN demonstrates significant potential for approximating complex PDE systems through neural networks. In this work, we utilize this evolutionary deep operator neural network framework [ 66 ] and KANs to design evolutionary KANs [ 42 , 41 ] for complex PDE systems. Specifically, we integrate the adaptability and local learning capabilities of KANs with EDNN to create a more robust framework suited for tackling high-dimensional and dynamic problems in physical systems. This approach aims to address limitations found in both standard deep neural network models and conventional KAN architectures by replacing the conventional Multi-Layer Perceptrons (MLPs) with KANs that are parametrized as splines. By combining the accuracy and interpretability of KANs with the long-term dynamical predictability of EDNN, our proposed model not only achieves improved accuracy, but also enhances generalization to more complex scenarios. This combination ensures that the learned models remain consistent with the underlying physical laws in the original governing systems. In addition, we assess the performance of this framework on various challenging benchmarks, demonstrating its effectiveness in capturing the intricate dynamics of real-world physical phenomena. In addition, EvoKAN incorporates the scalar auxiliary variable (SAV) methodology [ 56 , 57 ] , which yields numerical schemes that are unconditionally energy stable and computationally efficient. In particular, these schemes only require solving decoupled linear systems with constant coefficients at each time step, greatly simplifying the implementation. In brief summary, our primary contribution includes the following: 1. We propose a novel evolutionary Kolmogorov–Arnold Networks (EvoKAN) for solving complex PDEs. 2. EvoKAN models Kolmogorov–Arnold network weights as time-dependent functions and updates them through the evolution of the governing PDEs. 3. In addition, we incorporate the scalar auxiliary variable (SAV) method for unconditional energy stability and computational efficiency. 4. Through numerical experiments, we show that our algorithm achieves both high accuracy and rapid convergence. The remainder of this draft is organized as follows. In Section 2 , we introduce the energy-dissipative evolutionary KAN framework. Section 3 presents numerical tests to evaluate the performance of the proposed framework, utilizing benchmark problems: the one-dimensional and two-dimensional Allen-Cahn equations and the two-dimensional incompressible Navier-Stokes equations. Finally, conclusions and potential future research directions are summarized in Section 4 . 2 Evolutionary Kolmogorov–Arnold Networks 2.1 Kolmogorov–Arnold Network The Kolmogorov–Arnold Network starts from the Kolmogorov–Arnold theorem, which asserts that any multivariate continuous function on a bounded domain can be decomposed into a finite composition of continuous univariate functions and addition operations [ 58 , 32 , 40 , 35 , 37 , 20 , 46 , 27 ] . Specifically, for a smooth function f:[0,1]^{n}\to\mathbb{R} , the following representation holds: f(\mathbf{x})=f(x_{1},\dots,x_{n})=\sum_{q=1}^{2n+1}\Phi_{q}\left(\sum_{p=1}^{n}\phi_{q,p}(x_{p})\right), (1) where \phi_{q,p}:[0,1]\to\mathbb{R} and \Phi_{q}:\mathbb{R}\to\mathbb{R} . This result suggests that only the addition is performed truly on multivariate function, as all others can be expressed using univariate functions and sums. Although this finding seems promising for machine learning, it reduces the problem of learning high-dimensional functions to that of learning a set of one-dimensional functions, which can be non-smooth and thus difficult to learn in practice [ 51