LTBs-KAN: Linear-Time B-splines Kolmogorov-Arnold Networks

Eduardo Said Merin-Martinez, Andres Mendez-Vazquez, Eduardo Rodriguez-Tello · 2026

Read LTBs-KAN: Linear-Time B-splines Kolmogorov-Arnold Networks by Eduardo Said Merin-Martinez, Andres Mendez-Vazquez, Eduardo Rodriguez-Tello (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-22034.txt.

Introduction

Merin-Martinez, Mendez-Vazquez, and Rodriguez-Tello propose LTBs-KAN, a B-spline Kolmogorov-Arnold net, as a faster alternative to standard KANs. KANs explain themselves better than Multilayer Perceptrons, but run much slower than MLPs since B-spline math repeats itself. The authors cut model parameters with product-sum matrix math in the forward pass, keeping performance. Tests on MNIST, Fashion-MNIST and CIFAR-10 show LTBs-KAN runs faster with fewer weights than other KANs.

Catalog record

CREATOREduardo Said Merin-Martinez, Andres Mendez-Vazquez, Eduardo Rodriguez-Tello
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE63584
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.22034

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

LTBs-KAN: Linear-Time B-splines Kolmogorov-Arnold Networks Eduardo Said Merin-Martinez, Andres Mendez-Vazquez, Eduardo Rodriguez-Tello Abstract Kolmogorov-Arnold Networks (KANs) are a recent neural network architecture offering an alternative to Multilayer Perceptrons (MLPs) with improved explainability and expressibility. However, KANs are significantly slower than MLPs due to the recursive nature of B-spline function computations, limiting their application. This work addresses these issues by proposing a novel base-spline Linear-Time B-splines Kolmogorov-Arnold Network (LTBs-KAN) with linear complexity. Unlike previous methods that rely on the Boor-Mansfield-Cox spline algorithm or other computationally intensive mathematical functions, our approach significantly reduces the computational burden. Additionally, we further reduce model’s parameter through product-of-sums matrix factorization in the forward pass without sacrificing performance. Experiments on MNIST, Fashion-MNIST and CIFAR-10 demonstrate that LTBs-KAN achieves good time complexity and parameter reduction, when used as building architectural blocks, compared to other KAN implementations. K eywords Kolmogorov Arnold Networks \cdot B-splines \cdot Multi-Layer Perceptron \cdot Convolutional Neural Network. 1 Introduction The recent novel proposal of KANs [ 1 ] introduces an innovative modification to traditional neural networks by employing learnable functions on the edges of the graph rather than using fixed activation functions at the nodes by Sigmoid Linear Units (SiLU) and spline functions [ 1 , 2 ] . This flexibility enables interpretability and adaptability given the locality of the basic spline. Thus, this locality incorporates adaptability into the new KAN based architecture, improving both accuracy and computational efficiency [ 1 ] . However, one of the main problems of the KANs lie in its slow processing of the data because of the splines, making it 10 x slower than MLPs, given the same number of parameters [ 1 ] . Nevertheless, there have been attempts to reduce computational complexity in the KAN architecture [ 3 , 4 , 5 ] . One of the first attempts to improve KAN performance is the Efficient KAN [ 6 ] , a PyTorch implementation of Kolmogorov-Arnold Network (KAN). Here, the authors propose approximations of the B-spline using a switch activation function that approximates 3^{rd} -order B-splines used in the original KAN. In addition, it replaces the incompatible L1 regularization applied to input samples with the L1 penalty on the model weights. Finally, it introduces learnable scaling factors for activation functions and adopting Kaiming uniform initialization [ 7 ] for both the base weight and spline scaling matrices. Following this initial attempt, a combination of B-splines and Radial Basis Functions (BSRBF-KAN) is proposed [ 3 ] to fit input vectors during data training. For this, an RBF network with N centers is used to group samples to a specific basis. Thus, by applying linear transformations, it is possible to align a series of 3^{rd} -order B-spline bases to Gaussian radial basis. Obtaining a training time two an half that of the classic MLP on the MNIST dataset [ 8 ] , Table 1 . Furthermore, using the previous ideas, FastKAN [ 9 ] has significantly accelerated model computation to a speed comparable to MLPs, but at the cost of performance [ 10 ] , Table 1 and Table 2 . This is achieved by approximating the 3^{rd} -order B-spline basis using Radial Basis Functions (RBFs) with Gaussian kernels. Also, layer normalization are used to prevent the inputs shifting away from the domain of the RBFs [ 10 ] . Following this, the Gottlieb-KAN [ 11 ] uses Gottlieb polynomials [ 5 ] which are a special family of polynomials that arises in the study of Bernoulli numbers [ 5 , 11 ] . And although Gottlieb-KAN achieves the best performance across other substitutes for splines, it degrades compared to the MLP architecture, Table 1 and 2 . Finally, we have FasterKAN [ 4 ] where FastKAN is used together with Reflective Switch Activation Functions (RSWAF). These functions can accurately approximate a 3^{rd} -order B-spline basis with linear scaling [ 3 ] with a modification for reflectional symmetry. Despite these advances, substantial challenges remain in optimizing Kolmogorov-Arnold Networks (KANs) for practical applications. This gap highlights a significant opportunity to develop algorithms that further enhance the efficiency of KANs. Our work addresses these issues by proposing the Linear-Time B-splines Kolmogorov-Arnold Network (LTBs-KAN) model, which efficiently computes the Bernstein–Bézier coefficients of B-spline basis functions. It achieves optimal complexity O(Ld^{2}(m+n)) for coincident knots for the forward pass, where m is the order of the spline, n is the number of nodes in the grid, L is the number of layers, and d is the input dimension. For typical configurations using cubic splines and fixed layer counts, the complexity is effectively linear in n , i.e., O(n) . Further parameter reduction is achieved via product-of-sums matrix factorization in the forward pass, Fig. 1 . Thus, the main contributions of this work are summarized as follows: • A novel parallel linear algorithm LTBs for the B-spline. • The use of Blocks for the implementation of the LTBs-KAN model. • A matrix factorization for parameter reduction in the model. • A novel KAN convolutional architecture. The effectiveness of LTBs-KAN is experimentally assessed using MNIST, Fashion-MNIST and CIFAR-10 [ 8 , 12 , 13 ] datasets. Thus, LTBs-KAN shows good expressibility, time complexity, and reduction in parameter requirements compared to other KAN architectures. In the case of CIFAR-10, LTBs-KAN units deliver good performance against classic convolution units. Figure 1: The proposed LTBs-KAN linear layer using the new LTBs Algorithm, see gridUpdate procedure 2 for details. As part of the general architecture we use dropout and layer normalization for stability and regularization purposes. The remaining sections of this article are organized as follows. Section 2 presents the background concepts used to define the KAN architecture and B-splines. Then, in Section 3 , our novel LBTs algorithm is introduced to efficiently compute the coefficients of the B-spline basis functions in linear time. Section 4 provides the implementation details of LTBs-KAN in CNNs using the proposed LTBs Algorithm. Section 5 is dedicated to the experimental evaluation of LTBs-KAN across the MNIST and Fashion-MNIST datasets. This is complemented with experiments using a convolutional architecture for LTBs-KAN on the CIFAR-10 dataset, called KAN-ConvNet. Finally, Section 6 summarizes the key contributions and future research. 2 Theoretical background The MLP architecture is one of the basic Neural Network structures widely adopted in a range of applications [ 14 , 15 ] . The MLP is characterized by a feedforward architecture comprising input, hidden, and output layers, each containing one or more neurons. Consequently, they serve as standard models in Machine Learning to approximate nonlinear functions [ 16 ] . Deep Learning uses automatic differentiation [ 17 ] for training deep architectures, resulting in "optimal" solutions that are often not easily interpretable. This underscores the need for new fundamental units of representation in Deep Learning. The Kolmogorov-Arnold representation theorem [ 18 , 19 ] addresses this need by stating that every continuous multivariate function f\colon[0,1]^{n}\to\mathbb{R} , can be represented as a superposition of single variable continuous functions \phi_{q,p} and \Phi_{q} : f(\textbf{x})=\sum_{q=1}^{2n+1}\Phi_{q}\left(\sum_{p=1}^{n}\phi_{q,p}(x_{p})\right). (1) This means that the (2n+1)(n+1) univariate functions \phi_{q,p} and \Phi_{q} are enough to accurately represent a n variable function, where x_{p} denotes the p -th component of the input vector \bm{x}\in\mathbb{R}^{n} . An example of how to define a possible constructive

Read the complete text