Figure 1

: · 2026

Read Figure 1 by : (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-28288.txt.

Introduction

N'guessan upgrades Kolmogorov-Arnold Networks by swapping their spline bases for fractal interpolation functions. Fixed spline grids give KANs no built-in sense of scale, which hurts on rough functions. His FI-KAN learns each edge's fractal dimension as it trains, matching the target's roughness. A hybrid version keeps the spline path and adds a fractal fix on top. On rough targets the gains ran from 1.3 to 79 times better than plain KAN. Learned dimensions matched the true ones.

Catalog record

CREATOR:
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE102961
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.28288

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Figure 1 : Abstract Kolmogorov–Arnold Networks (KAN) employ B-spline bases on a fixed grid, providing no intrinsic multi-scale decomposition for non-smooth function approximation. We introduce Fractal Interpolation KAN (FI-KAN), which incorporates learnable fractal interpolation function (FIF) bases from iterated function system (IFS) theory into KAN. Two variants are presented: Pure FI-KAN (Barnsley, 1986) replaces B-splines entirely with FIF bases; Hybrid FI-KAN (Navascués, 2005) retains the B-spline path and adds a learnable fractal correction. The IFS contraction parameters give each edge a differentiable fractal dimension that adapts to target regularity during training. On a Hölder regularity benchmark ( α ∈ [ 0.2 , 2.0 ] \alpha\in[0.2,2.0] ), Hybrid FI-KAN outperforms KAN at every regularity level ( 1.3 × 1.3\times to 𝟑𝟑 × \mathbf{33\times} ). On fractal targets, FI-KAN achieves up to 6.3 × \mathbf{6.3\times} MSE reduction over KAN, maintaining 4.7 × 4.7\times advantage at 5 5 dB SNR. On non-smooth PDE solutions ( scikit-fem ), Hybrid FI-KAN achieves up to 𝟕𝟗 × \mathbf{79\times} improvement on rough-coefficient diffusion and 3.5 × 3.5\times on L-shaped domain corner singularities. Pure FI-KAN’s complementary behavior, dominating on rough targets while underperforming on smooth ones, provides controlled evidence that basis geometry must match target regularity. A fractal dimension regularizer provides interpretable complexity control whose learned values recover the true fractal dimension of each target. These results establish regularity-matched basis design as a principled strategy for neural function approximation. Keywords: Kolmogorov–Arnold Networks, fractal interpolation, iterated function systems, Hölder regularity, function approximation, neural architecture design. 1 Introduction Neural function approximation architectures embed implicit assumptions about the regularity of their targets through their choice of basis functions. Multi-layer perceptrons (MLPs) with smooth activation functions (ReLU, SiLU, GELU) construct approximants in spaces of piecewise smooth or analytic functions [ 11 , 20 ] . Kolmogorov–Arnold Networks (KAN) [ 27 ] , motivated by the Kolmogorov–Arnold representation theorem [ 24 , 3 ] , replace fixed activations with learnable univariate functions parameterized as B-spline expansions [ 13 ] . B-splines of order k reproduce polynomials of degree at most k-1 and provide near-optimal approximation rates for targets in Sobolev and Besov spaces with integer or high fractional smoothness. However, many functions of scientific and engineering interest are not smooth. Turbulence velocity fields, financial time series, fracture surfaces, natural terrain profiles, and biomedical signals with multi-scale oscillations all exhibit non-trivial Hölder regularity, fractal self-similarity, or nowhere-differentiable character. For such targets the smooth basis functions used by both MLPs and KANs are fundamentally mismatched: approximating a function with box-counting dimension \dim_{\mathrm{B}}>1 using a smooth basis at resolution h requires O(h^{-1/\alpha}) basis elements (where \alpha is the Hölder exponent), with no gain from the polynomial reproduction properties that make splines efficient for smooth targets. This paper introduces Fractal Interpolation KAN (FI-KAN), which augments or replaces the B-spline bases in KAN with fractal interpolation function (FIF) bases derived from iterated function system (IFS) theory [ 5 , 21 ] . The key innovation is that the vertical contraction parameters \{d_{i}\} of the IFS are treated as trainable parameters, giving each edge activation a differentiable fractal dimension that adapts to the regularity structure of the target function during training. Contributions. 1. Two architectures grounded in fractal approximation theory. Pure FI-KAN (Barnsley framework) replaces B-splines entirely with FIF bases. Hybrid FI-KAN (Navascués framework) retains B-splines and adds a fractal correction path. Both architectures are derived from classical mathematical frameworks, not ad hoc modifications. 2. Learnable fractal dimension. The contraction parameters provide a continuous, differentiable knob from smooth (piecewise linear, \dim_{\mathrm{B}}=1 ) to rough (fractal, \dim_{\mathrm{B}}>1 ) basis functions, learned from data. 3. Fractal dimension regularization. A differentiable regularizer penalizes unnecessary fractal complexity, implementing Occam’s razor at the level of function geometry rather than parameter count. 4. Comprehensive experimental validation. Across functions spanning the Hölder regularity spectrum, FI-KAN demonstrates that matching basis regularity to target regularity yields substantial approximation gains on non-smooth targets, with additional advantages in noise robustness and continual learning. 5. Empirical validation of the regularity-matching hypothesis. The contrast between Pure and Hybrid FI-KAN provides controlled evidence that the geometric structure of the basis functions, not merely their number, is a critical design variable. 6. Validation on non-smooth PDE solutions. On reference solutions computed via scikit-fem [ 18 ] for elliptic PDEs with corner singularities (Hölder 2/3 ) and rough coefficients generated by fractional Brownian motion ( fbm package [ 16 ] ), Hybrid FI-KAN achieves 65 – 79\times improvement over KAN, demonstrating that the regularity-matching advantage extends to structured roughness inherited from PDE operators. Scope. We do not claim FI-KAN as a general-purpose replacement for KAN. We claim it as a principled extension for function classes with non-trivial geometric regularity, supported by both theory and experiment. On smooth targets where B-splines are near-optimal, the Hybrid variant remains competitive (because the spline path carries the load), while the Pure variant underperforms (because its fractal bases cannot efficiently represent smooth curvature). This asymmetry is not a weakness but a confirmation of the regularity-matching principle. The advantage is most pronounced on targets with structured roughness: PDE solutions inheriting non-smooth character from corner singularities, rough coefficients, or stochastic forcing, where Hybrid FI-KAN achieves up to 79\times improvement over KAN. Organization. Section 2 reviews the mathematical background on KAN, fractal interpolation functions, and \alpha -fractal approximation. Section 3 presents the FI-KAN architecture in both Pure and Hybrid variants. Section 4 develops the approximation-theoretic analysis. Section 5 provides comprehensive experimental results. Section 6 discusses related work. Section 7 addresses limitations and future directions. Section 8 concludes. Figure 2 : FI-KAN: learning basis geometry across the smooth-to-rough spectrum. Top row: FI-KAN combines smooth basis functions (B-spline/hat-type), fractal interpolation with learnable contraction parameters \mathbf{d} , and the KAN edge-function graph to produce regularity-matched edge geometry. Middle row: Smooth-to-fractal basis morphing as d_{i} increases from 0 to 0.9 . At d_{i}=0 the basis is a smooth hat function ( \dim_{B}=1 ); as d_{i} increases, the basis acquires progressively finer self-affine structure with \dim_{B}>1 . Bottom row: The two FI-KAN variants. Pure FI-KAN (Barnsley framework) uses all-fractal bases, strongest on rough targets. Hybrid FI-KAN (Navascués framework) retains a spline backbone and adds a fractal correction, providing robustness across both smooth and rough regimes. 2 Preliminaries 2.1 Kolmogorov–Arnold Networks The Kolmogorov–Arnold representation theorem [ 24 , 3 ] states that every continuous function f\colon[0,1]^{n}\to\mathbb{R} admits a representation f(x_{1},\ldots,x_{n})=\sum_{q=0}^{2n}\Phi_{q}\!\left(\sum_{p=1}^{n}\psi_{q,p}(x_{p})\right), (1) where \Phi_{q}\colon\mathbb{R}\to\mathbb{R} and \psi_{q,p}\colon[0,1]\to\mathbb{R} are continuous univariate functions. KAN [ 27 ] generalizes this by constructing neural networks whose edges carry learnable univariate functions rather than scalar weights. Specifically, a KAN layer maps \mathbb{R}^{n_{\mathrm{in}}}\to\mathbb{R}^{n_{\mathrm{out}}} via \mathbf{y}=\begin{pmatrix}\phi_{1,1}(\cdot)&\cdots&\phi_{1,n_{\mathrm{in}}}(\cdot)\\ \vdots&\ddots&\vdots\\ \phi_{n_{\mathrm{out}},1}(\cdot)&\cdots&\phi_{n_{\mathrm{out}},n_{\mathrm{in}}}(\cdot)\end{pmatrix}\mathbf{x}, (2) where each \phi_{j,i}\colon\mathbb{R}\to\mathbb{R} is parameterized as a B-spline expansion plus a residual base activation. In the efficient-KAN implementation [ 7 ] , each edge function takes the form \phi_{j,i}(x)=w^{(\mathrm{base})}_{j,i}\,\sigma(x)+w^{(\mathrm{scale})}_{j,i}\sum_{m=0}^{G+k-1}w^{(\mathrm{spline})}_{j,i,m}B_{m}^{(k)}(x), (3) where \sigma is SiLU, \{B_{m}^{(k)}\} are B-spline basis functions of order k on a grid of size G , and w^{(\mathrm{base})} , w^{(\mathrm{scale})} , w^{(\mathrm{spline})} are learnable parameters. B-spline basis properties. B-splines of order k form a partition of unity, are C^{k-2} smooth, and reproduce polynomials of degree at most k-1 [ 13 ] . For a target f\in C^{s}([a,b]) with s\leq k , the best B -spline approximation error on a uniform grid of spacing h satisfies \lVert

Read the complete text