KAN-SR: A Kolmogorov-Arnold Network Guided Symbolic Regression Framework

Marco A. Bühler, Gonzalo Guillén-Gosálbez · 2025

Read KAN-SR: A Kolmogorov-Arnold Network Guided Symbolic Regression Framework by Marco A. Bühler, Gonzalo Guillén-Gosálbez (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-10089.txt.

Introduction

Marco Andrea Bühler and Gonzalo Guillén-Gosálbez introduce KAN-SR in a 2025 paper, a tool that hunts for the equation behind a data set. Symbolic regression usually relies on genetic programming to evolve formulas. Their framework instead builds on Kolmogorov-Arnold Networks and a divide-and-conquer plan, then simplifies what it finds by using symmetries and by splitting problems into separable parts.

The method recovered the true equations behind the Feynman benchmark data set, a standard test drawn from physics formulas. Paired with neural differential equations, it also modeled the behavior of a simulated bioprocess system with high precision. The authors suggest the same pairing could model other engineering systems where the governing equation is unknown but the data are rich.

Catalog record

CREATORMarco A. Bühler, Gonzalo Guillén-Gosálbez
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE42 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-10089

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

KAN-SR: A Kolmogorov-Arnold Network Guided Symbolic Regression Framework Marco A. Bühler, Gonzalo Guillén-Gosálbez Abstract We introduce a novel symbolic regression framework, namely KAN-SR, built on Kolmogorov Arnold Networks (KANs) which follows a divide-and-conquer approach. Symbolic regression searches for mathematical equations that best fit a given dataset and is commonly solved with genetic programming approaches. We show that by using deep learning techniques, more specific KANs, and combining them with simplification strategies such as translational symmetries and separabilities, we are able to recover ground-truth equations of the Feynman Symbolic Regression for Scientific Discovery (SRSD) dataset. Additionally, we show that by combining the proposed framework with neural controlled differential equations, we are able to model the dynamics of an in-silico bioprocess system precisely, opening the door for the dynamic modeling of other engineering systems. A Preprint Keywords: Symbolic Regression \cdot Kolmogorov-Arnold Networks \cdot Feynman-SRSD Dataset 1 Introduction Symbolic regression (SR) aims to recover closed-form mathematical expressions that accurately model a given dataset. Unlike traditional regression approaches, which assume a fixed model structure, SR jointly infers both the functional form (equation) and its parameters (constants) from the data, producing models that are not only predictive, but also (to some extent) interpretable. This flexibility makes SR especially appealing in scientific domains, where understanding the underlying mechanisms can be more important than raw predictive performance [ 1 , 2 ] . Because of this, SR emphasizes simplicity and interpretability alongside predictive performance. The goal is to find concise mathematical relationships, ideally those that offer insight into the system being modeled [ 3 ] . This contrasts with black-box machine learning models, which may perform well but often lack transparency and might extrapolate poorly. Classical SR methods, such as genetic programming (GP) [ 4 , 5 , 6 , 7 ] , explore the space of symbolic expressions using evolutionary algorithms applied to expression trees [ 8 ] . Although flexible, GP-based methods tend to be sample-inefficient, computationally expensive, and often face difficulties with scalability. More recent approaches have tried to overcome these limitations using pre-trained language models [ 9 , 10 , 11 ] , reinforcement-learning [ 12 ] , hybrid frameworks that integrate deep learning with GP-style symbolic search [ 13 , 14 ] and physics-inspired heuristics [ 15 ] . Despite this progress, challenges remain. Many neural-symbolic systems still rely on discrete symbolic representations that are difficult to train end-to-end, limiting their ability to learn efficiently or produce more interpretable results. Furthermore, there is no universally adopted benchmark, which makes comparing SR methods inconsistent. A step toward covering this gap was the Symbolic Regression for Scientific Discovery (SRSD) benchmark by Matsubara et al. [ 16 ] , which introduced 240 datasets inspired by the Feynman lectures, with sampling which corresponds to the real measured phenomena and the inclusion of irrelevant variables to test model robustness. In engineering sciences such as chemical engineering and bioengineering, the insights created by the SR algorithm can lead to faster and more robust process development or a deeper understanding of phenomena. Applications range from finding kinetic models to reactions [ 2 , 17 , 18 , 19 ] , designing new catalysts [ 20 ] and describing different transport phenomena [ 21 ] . Additionally, dynamic systems are at the core of many of these applications, and identifying these governing equations in a dynamic environment is an open problem. An algorithm that is tailored to identify differential equations is SINDy [ 1 ] which leverages sparse regression to find the best fitting combination of hand-made equation blocks. In this paper, we introduce KAN-SR , a symbolic regression framework based on Kolmogorov-Arnold Networks (KANs) [ 22 , 23 ] . KANs are a recent neural network architecture inspired by the Kolmogorov-Arnold representation theorem. Instead of traditional neurons with fixed activation functions and linear weights, KANs use learnable univariate functions, allowing more expressive and often more interpretable function approximations. To adapt KANs for symbolic regression, we develop a hybrid extraction pipeline that combines differentiable KAN training with symbolic simplification strategies inspired by AI Feynman [ 15 ] . By applying these symbolic simplifications, e.g. symmetries and separabilities, the initial complex problem can be decomposed into simpler subproblems, which can often be directly fitted by a single-layer KAN. After fitting a KAN to the data, we decompose the network into modular algebraic components which are then matched to a symbolic library via non-linear least squares. This enables the extraction of compact, interpretable expressions without relying on brute-force search or discrete enumeration. We evaluate KAN-SR on the SRSD dataset, comparing it against state-of-the-art symbolic regression models evaluated in Matsubara et al. [ 16 ] . Our results show that KAN-SR achieves competitive or superior performance in symbolic recovery, particularly in scenarios involving compositional structure, extrapolation, and noisy inputs with irrelevant variables. Furthermore, we extend KAN-SR to an in-silico dynamic biological system, demonstrating its application to a bioprocess modeling case study, where it recovers interpretable kinetic rate equations [ 2 ] . Overall, our work opens up new avenues for the application of KANs to SR problems in a range of engineering problems, including the modeling of dyamic systems. Contributions • We propose a symbolic regression framework based on Kolmogorov-Arnold Networks and symbolic modeling, unifying compositional deep learning and symbolic extraction. • We introduce a symbolic extraction and simplification pipeline inspired by AI Feynman [ 15 ] , using a comprehensive and extendable univariate function library in combination with KANs. • We evaluate our approach on the SRSD benchmark [ 16 ] , showing improvements in symbolic recovery. • We demonstrate the extension of our method to dynamic systems through a bioprocess modeling case study, leveraging neural-controlled differential equations. 2 Methods SR searches for an equation y(x)=\Theta(x,\theta) in the space of expressions \Theta and constants \theta , to find the best fit combination that minimizes an objective function, which often is a combination of the fitting error and a complexity measure of the equation, such as the Bayesian Information Criterion (BIC). SR assumes that there is an analytical ground truth of the form y(x)=\Theta^{*}(x,\theta^{*})+\epsilon that created the training data x\in\mathbb{R}^{d} with the target y\in\mathbb{R} in the presence of Gaussian noise \epsilon . Implementation details: KAN-SR was implemented in Python using Jax [ 24 ] as the base for all calculations, Equinox [ 25 ] for the KANs, Optimistix [ 26 ] for the non-linear least squares regression and optimizers, Optax [ 27 ] for first-order optimizers and Diffrax [ 28 ] for the neural differential equations [ 29 ] . 2.1 Workflow The proposed symbolic regression framework is highly flexible and involves several hyperparameters and algorithmic components. This flexible design is motivated by the fact that there is no universal KAN architecture that can accommodate all target functions, even when strong regularization is applied. Consequently, the workflow consists of a sequence of optional and configurable steps, some of which can be enabled or skipped, depending on the problem characteristics and performance criteria. The general workflow is as follows, see Figures 2 for a more detailed illustration: 1. Preprocessing: Normalize or scale the input variables to improve the numerical stability and convergence. 2. Brute-force search: Optionally perform an exhaustive search over simple expressions. 3.

Read the complete text