Hardware-Oriented Inference Complexity of Kolmogorov–Arnold Networks Bilal Khalid, Pedro Freire, Sergei K. Turitsyn, and Jaroslaw E. Prilepsky Abstract Kolmogorov-Arnold Networks (KANs) have recently emerged as a powerful architecture for various machine learning applications. However, their unique structure raises significant concerns regarding their computational overhead. Existing studies primarily evaluate KAN complexity in terms of Floating-Point Operations (FLOPs) required for GPU-based training and inference. However, in many latency-sensitive and power-constrained deployment scenarios, such as neural network-driven non-linearity mitigation in optical communications or channel state estimation in wireless communications, training is performed offline and dedicated hardware accelerators are preferred over GPUs for inference. Recent hardware implementation studies report KAN complexity using platform-specific resource consumption metrics, such as Look-Up Tables, Flip-Flops, and Block RAMs. However, these metrics require a full hardware design and synthesis stage that limits their utility for early-stage architectural decisions and cross-platform comparisons. To address this, we derive generalized, platform-independent formulae for evaluating the hardware inference complexity of KANs in terms of Real Multiplications (RM), Bit Operations (BOP), and Number of Additions and Bit-Shifts (NABS). We extend our analysis across multiple KAN variants, including B-spline, Gaussian Radial Basis Function (GRBF), Chebyshev, and Fourier KANs. The proposed metrics can be computed directly from the network structure and enable a fair and straightforward inference complexity comparison between KAN and other neural network architectures. I Introduction Multi-Layer Perceptrons (MLPs) are the foundational blocks of modern deep learning models and have long served as the universal approximators for non-linear functions [ 12 ] . Recently, Kolmogorov-Arnold Networks (KANs) [ 25 ] have been proposed as a viable alternative to MLPs. Instead of using fixed activation functions on the network nodes, they incorporate learnable activation functions on the edges. In the classic KAN architecture, these learnable functions are parameterized as B-splines. This deviation from the conventional neural network (NN) architecture allows for more flexible and precise function approximation and offers a higher degree of interpretability [ 36 ] . KANs have rapidly gained traction across various domains, including computer vision [ 21 , 1 , 8 ] , time-series forecasting [ 42 , 16 ] , graph learning [ 47 , 17 ] , physics-informed modeling [ 43 , 34 ] , and biomedicine [ 18 ] . Moreover, their unique architecture naturally aligns with optical computing principles that also makes them a promising candidate for photonic neuromorphic computing [ 30 , 37 ] . Despite these advantages, significant concerns exist regarding the high computational complexity of KANs, which can pose real-world implementation challenges as compared to conventional architectures such as MLPs. Studies have shown that while KANs can achieve superior performance than MLPs on certain tasks, they require more parameters to do so [ 41 , 39 , 46 ] . Furthermore, some studies highlight that KANs do not consistently outperform MLPs when the total Floating Point Operations (FLOPs) are controlled [ 45 , 13 ] . In addition, several other works also perform FLOPS-based complexity evaluations of their KAN implementations [ 4 , 33 , 40 ] . However, these studies adopt a GPU-centric perspective optimized for maximum Single-Instruction-Multiple-Data (SIMD) throughput and dense tensor multiplications. While appropriate for characterizing GPU-based training and inference, this approach fails to accurately represent complexity for specialized hardware deployments. For many latency-sensitive and power-constrained applications, such as neural-network-driven non-linearity mitigation in optical communication systems or channel state estimation in wireless communication, Field-Programmable Gate Arrays (FPGAs) or Application-Specific Integrated Circuits (ASICs) are used for inference rather than GPUs. The efficiency is directly linked to the actual number of multipliers and adders instantiated in hardware. In such scenarios, training complexity is largely irrelevant since models are trained once offline on powerful servers, and inference complexity is the critical bottleneck that must be carefully considered. Furthermore, the hardware complexity of KANs can be fundamentally different from the GPU-oriented FLOPs calculations reported in literature [ 45 , 13 ] . B-splines possess the local support property, i.e., for a spline order k and grid size G , only (k+1) basis functions are non-zero for any given input [ 25 ] . Properly designed hardware implementations can exploit this sparsity by identifying the active interval and computing only the necessary basis functions. This eliminates the dependence on G that dominates reported FLOPs calculations. Early hardware complexity evaluation studies [ 20 ] implemented symbolic approximations of trained KAN models in hardware rather than exploiting local support. Recent optimized hardware implementations of KANs [ 14 , 10 , 15 , 27 ] achieve a substantial reduction in resource consumption as compared to traditional deep neural network (DNN) hardware through careful sparsity-aware design choices. However, these studies report complexity using hardware-specific resource consumption metrics such as Block Random Access Memory (BRAM), Flip-Flops (FF), and Look-Up Tables (LUT). To evaluate these metrics, a complete hardware design and synthesis cycle is required, which makes them unsuitable for early-stage research where many architectural variations have to be tested. Furthermore, these metrics do not reflect the underlying algorithmic costs and depend on the target hardware platform and physical implementation strategy, which prevents meaningful cross-platform comparisons. This paper addresses these challenges by establishing a comprehensive platform-independent hardware inference complexity evaluation framework for KANs. We derive closed-form expressions for three analytical hardware complexity metrics, i.e., Real Multiplications (RM), Bit Operations (BOP), and Number of Additions and Bit Shifts (NABS). In previous work [ 11 ] , some of the present authors evaluated these metrics for other DNN architectures. The calculations are now extended to encompass four major KAN variants, namely B-spline, Gaussian Radial Basis Function (GRBF), Chebyshev polynomial, and Fourier basis KANs. Unlike platform-specific resource metrics, these analytical metrics can be computed directly from the network architecture. This enables rapid design-space exploration and fair comparison between KANs and other DNN architectures. The main contributions of this paper can be summarized as follows: • To the best of our knowledge, this is the first study that reports the complexity of four different KAN variants in terms of RM, BOP and NABS. We derive generalized formulae for evaluating the per-edge and per-layer complexity in terms of these metrics. • We highlight that existing FLOPs calculations for KANs are appropriate for GPU-based training and inference but overestimate complexity for sparsity-aware optimized hardware implementations. • We perform a thorough iso-complexity analysis to demonstrate the specific network size reductions required for KAN variants to offset their high per-edge hardware costs when compared to standard MLPs. • We provide platform-independent analytical complexity metrics that facilitate the research community to make robust and fair hardware inference complexity comparison of different KAN variants with other DNNs. The remainder of this paper is organized as follows. Section II provides background on KAN architecture and basis function variants. An overview of commonly used metrics for complexity evaluation of KANs is presented in Section III . A description of the proposed analytical complexity metrics is presented in Section IV followed by their comprehensive mathematical derivation in Section V . A demonstrative comparative analysis of KANs with MLPs in terms of these metrics is performed in Section VI , followed by conclusion in Section VII . II Background II-A Kolmogorov-Arnold Network (KAN) Architecture KANs represent a fundamental departure from the conventional MLP architecture. This distinction is rooted in the Kolmogorov-Arnold representation theorem [ 19 ] , which establishes that any multivariate continuous function can be represented as a finite composition of univariate continuous functions and additions. Figure 1 illustrates the fundamental architecture of a KAN layer, where learnable activation functions are placed on the edges. Extending this structure to a generalized layer with n_{i} input and n_{n} output dimensions, the value at each output neuron y_{j} is computed as y_{j}=\sum_{i=1}^{n_{i}}\phi_{i,j}(x_{i}),\quad j=1,\,2,\,\ldots,\,n_{n}\,, (1) where \phi_{i,j}(\cdot) represents the learnable activation function connecting input x_{i} to output y_{j} . Unlike a standard MLP neuron that performs simple linear weighting, a KAN edge learns \phi(x) that is composed of a residual base path and a parameterized basis function representation. This can be expressed as \phi(x)=w_{b}\,\sigma(x)+\sum_{i=1}^{N}w_{i}\,f_{i}(x), (2) where \sigma(x) is typically the base activation function 1 1 1 SiLU is commonly used, but theoretically, any standard activation function can be used. The base activation path w_{b}\sigma(x) facilitates training by providing a globally defined component , w_{b} is the learnable base weight, w_{i} denote the basis control coefficients, f_{i}(x) represent the basis functions, and N denotes the number of basis functions. Recently, numerous architectural variations of KANs have emerged that incorporate different basis functions [ 29 ] . These include the originally proposed B-splines [ 25 , 24 ] , Gaussian radial basis functions (GRBF) [ 41 , 2 , 23 ] , Chebyshev polynomials [ 38 , 5 ] , Fourier series [ 44 ] and several others [ 3 , 6 , 35 ] . The choice of basis function fundamentally determines the expressiveness, approximation properties, and computational characteristics of the KAN architecture. In this paper, we restrict our complexity analysis to four representative types, namely B-splines, GRBFs, Chebyshev polynomials, and Fourier series. Figure 2 illustrates the characteristic shapes of these basis functions. The mathematical formulation of each type and its implications for hardware complexity are discussed next. Fig. 1: A KAN layer with two input and three output nodes. Unlike MLPs where activations reside at nodes, each KAN edge contains a learnable activation function. II-B B-spline Basis Functions B-splines are piecewise polynomial functions widely used in numerical analysis and approximation theory [ 9 ] . In the context of KANs, B-splines serve as the parametric representation for learnable activation functions. A B-spline of order k is defined over a knot vector, which partitions the input domain into intervals. Let \mathcal{T}=\{t_{0},t_{1},\ldots,t_{G}\} denote a non-decreasing sequence of (G+1) knots that divides the input range [a,b] into G intervals. To maintain continuity at the boundaries, \mathcal{T} is extended by adding k additional knots at each end such that \mathcal{T}=\{t_{-k},\dots,t_{-1},t_{0},t_{1},\dots,t_{G},t_{G+1},\dots,t_{G+k}\} resulting in a total of (G+2k+1) knots. A B-spline basis function B_{i,k}(x) is defined recursively using the Cox-de Boor formula [ 9 ] : B_{i,k}(x)=\frac{x-t_{i}}{t_{i+k}-t_{i}}B_{i,k-1}(x)+\frac{t_{i+k+1}-x}{t_{i+k+1}-t_{i+1}}B_{i+1,k-1}(x), (3) B_{i,0}(x)=\begin{cases}1&\text{if }t_{i}\leq x