Nonlinear Factor Decomposition via Kolmogorov-Arnold Networks: A Spectral Approach to Asset Return Analysis
David Breazu · 2026
Read Nonlinear Factor Decomposition via Kolmogorov-Arnold Networks: A Spectral Approach to Asset Return Analysis by David Breazu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-28257.txt.
Introduction
Breazu builds KAN-PCA, a nonlinear twist on principal component analysis for asset returns. Each edge of his autoencoder uses a learned spline from a Kolmogorov-Arnold network, while the decoder stays linear. He proves that forcing the splines linear returns plain PCA exactly. On 20 S&P 500 stocks over a decade, three factors rebuilt returns with an R-squared of 66.57%, against 62.99% for PCA. Out-of-sample results matched after a leakage fix.
Catalog record
| CREATOR | David Breazu |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 16561 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.28257
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Nonlinear Factor Decomposition via Kolmogorov-Arnold Networks: A Spectral Approach to Asset Return Analysis David Breazu Abstract KAN-PCA is an autoencoder that uses a KAN as encoder and a linear map as decoder. In essence, it generalizes classical PCA by replacing linear projections with learned B-spline functions on each edge. The motivation is to capture more variance than classical PCA. Classical PCA becomes inefficient during market crises, when the linear assumption breaks down and correlations between assets change dramatically. We prove that if the spline activations are forced to be linear, KAN-PCA yields exactly the same results as classical PCA, which establishes the theoretical correctness of the model and positions PCA as a special case. Experiments on 20 S&P 500 stocks show that KAN-PCA achieves a reconstruction R 2 R^{2} of 66.57 % 66.57\% , compared to 62.99 % 62.99\% for classical PCA with the same 3 factors, while matching PCA out-of-sample after correcting for data leakage in the training procedure. Introduction A factor model is a useful tool for understanding a portfolio of assets. Instead of analyzing every stock individually, a factor model identifies a small number of common forces that drive all assets simultaneously. These forces are called factors ( Fama and French 1993 ) . For a hedge fund, this means that instead of tracking hundreds of individual positions, one can understand the entire portfolio through a handful of underlying risk sources, making risk management far more tractable. Classical PCA is the standard method for extracting these factors from return data. However, PCA cannot capture the nonlinearities present in financial markets. During a crisis such as the COVID-19 pandemic, PCA would report near-unity correlations between certain assets, which is empirically misleading. It treats the crisis as a linear amplification of normal market dynamics rather than a qualitatively different regime. We therefore propose KAN-PCA: an autoencoder that uses a KAN encoder ( Liu et al. 2024a ) combined with a linear decoder. The KAN encoder replaces linear projections with learned spline functions, while the linear decoder preserves direct interpretability of the factors. When spline activations are forced to be linear, KAN-PCA recovers exactly classical PCA. In cases of genuine nonlinearity, it captures substantially more structure from the data. Our main contributions are: 1. A formal proof that forcing the spline activations to be linear yields exactly the same results as classical PCA, establishing PCA as a special case of our framework. 2. Experimental evidence that KAN-PCA captures more in-sample variance than classical PCA with the same number of factors ( 66.57\% vs 62.99\% ). 3. An ablation study identifying and correcting a data leakage issue in the original training procedure, showing that corrected KAN-PCA matches PCA out-of-sample ( 56.56\% vs 57.33\% ). 4. Visualization of the learned edge functions, providing direct evidence of nonlinear factor structure in S&P 500 returns. Mathematical Framework Classical PCA Let \{x_{t}\}_{t=1}^{T}\subset\mathbb{R}^{N} be a sequence of N -dimensional standardized return vectors with zero mean. The empirical covariance matrix is: \Sigma:=\frac{1}{T}\sum_{t=1}^{T}x_{t}x_{t}^{\top}\;\in\;\mathbb{R}^{N\times N},\qquad(\Sigma_{ij}=\text{empirical covariance between asset }i\text{ and asset }j) By the spectral theorem, since \Sigma is symmetric positive semidefinite, it admits the decomposition: \Sigma=U\Lambda U^{\top},\qquad\Lambda=\mathrm{diag}(\lambda_{1},\ldots,\lambda_{N}),\quad\lambda_{1}\geq\cdots\geq\lambda_{N}\geq 0 where U=[u_{1}\mid\cdots\mid u_{N}] satisfies U^{\top}U=I (columns are orthonormal: each eigenvector has unit length and is perpendicular to all others). The k -factor PCA projection uses the top- k eigenvectors U_{k}:=[u_{1}\mid\cdots\mid u_{k}] : z_{t}=U_{k}^{\top}x_{t}\;\in\;\mathbb{R}^{k},\qquad\hat{x}_{t}=U_{k}z_{t}\;\in\;\mathbb{R}^{N} The reconstruction loss equals \sum_{i=k+1}^{N}\lambda_{i} , the minimum achievable among all rank- k linear approximations. In our experiment with N=20 stocks and k=3 , PCA achieves R^{2}=62.99\% , with: \lambda_{1}\text{ explains }48.00\%,\quad\lambda_{2}\text{ explains }8.96\%,\quad\lambda_{3}\text{ explains }6.03\% B-Spline Functions Definition 1 (B-Spline Space) . Let G=\{t_{0}<t_{1}<\cdots<t_{m}\}\subset\mathbb{R} be a knot vector and k\geq 1 . The B-spline space of order k over G is: \mathcal{S}_{k}(G):=\left\{\varphi\in C^{k-1}(\mathbb{R})\;\middle|\;\varphi\big|_{[t_{i},t_{i+1}]}\in\mathcal{P}_{k},\;\forall i\right\} where \mathcal{P}_{k} denotes the space of polynomials of degree at most k ( de Boor 2001 ) . B-splines are piecewise polynomials that are smooth at their knots. A cubic B-spline ( k=3 ) is C^{2} -continuous, meaning it has two continuous derivatives everywhere, which is sufficient smoothness for financial applications. The basis functions \{B_{i,k}\} are computed via the Cox-de Boor recursion and satisfy the partition of unity property \sum_{i}B_{i,k}(x)=1 . Kolmogorov-Arnold Networks The Kolmogorov-Arnold representation theorem ( Kolmogorov 1957 ) states that any continuous function f:[0,1]^{n}\to\mathbb{R} can be written as: f(x_{1},\ldots,x_{n})=\sum_{q=1}^{2n+1}\Phi_{q}\!\left(\sum_{p=1}^{n}\varphi_{q,p}(x_{p})\right) where \Phi_{q},\varphi_{q,p}:\mathbb{R}\to\mathbb{R} are continuous univariate functions. Definition 2 (KAN Layer) . A KAN layer \Phi:\mathbb{R}^{n}\to\mathbb{R}^{m} is defined componentwise by: \left(\Phi(x)\right)_{j}:=\sum_{i=1}^{n}\varphi_{ji}(x_{i}),\qquad j=1,\ldots,m where each \varphi_{ji}\in\mathcal{S}_{k}(G) is a learnable univariate B-spline function ( Liu et al. 2024a ) . The full activation is: \varphi_{ji}(x)=w_{b}\cdot\mathrm{SiLU}(x)+w_{s}\cdot\sum_{l}c_{l}B_{l,k}(x) with learnable parameters w_{b},w_{s}\in\mathbb{R} and spline coefficients c_{l}\in\mathbb{R} . The key distinction from MLPs is that activations reside on edges. Each edge carries its own learned function rather than a scalar weight, and nodes merely sum their inputs. KAN-PCA Definition 3 (KAN-PCA) . KAN-PCA is a KAN autoencoder consisting of: • A KAN encoder \mathcal{E}:\mathbb{R}^{N}\to\mathbb{R}^{k} , a composition of KAN layers • A linear decoder \mathcal{D}:\mathbb{R}^{k}\to\mathbb{R}^{N} , defined by \mathcal{D}(z)=Wz where W\in\mathbb{R}^{N\times k} is the decoding matrix: row i of W specifies how asset i is reconstructed from the k factors trained to minimize the reconstruction loss: \mathcal{L}(\mathcal{E},\mathcal{D}):=\frac{1}{T}\sum_{t=1}^{T}\left\|x_{t}-\mathcal{D}\!\left(\mathcal{E}(x_{t})\right)\right\|^{2} The k -dimensional representations z_{t}=\mathcal{E}(x_{t})\in\mathbb{R}^{k} are the nonlinear factors: the compressed description of the market on day t . Unlike classical PCA, each asset’s contribution to each factor is mediated by a learned spline function \varphi_{ji} rather than a fixed scalar weight. This allows the model to capture asymmetric and regime-dependent relationships between assets and factors. Theoretical Result Lemma 1 (Linear Splines are Linear Maps) . A spline function \varphi\in\mathcal{S}_{k}(G) whose second derivative vanishes identically must be of the form \varphi(x)=wx for some w\in\mathbb{R} . Proof. A straight line is an order-1 polynomial, so it is automatically an element of any spline space \mathcal{S}_{k}(G) with order k\geq 1 . If the second derivative is zero at every point, the function does not curve anywhere, so it must be linear. ∎ Lemma 2 (Linear KAN Layer is Matrix Multiplication) . If all spline functions \varphi_{ji}\in\mathcal{S}_{k}(G) satisfy \varphi_{ji}^{\prime\prime}\equiv 0 for all i,j , then the KAN layer \Phi:\mathbb{R}^{n}\to\mathbb{R}^{m} reduces to: \Phi(x)=Wx,\qquad W_{ji}:=w_{ji}\in\mathbb{R} Proof. By Lemma 1 , \varphi_{ji}(x_{i})=w_{ji}x_{i} for each edge (j,i) . Therefore: \left(\Phi(x)\right)_{j}=\sum_{i=1}^{n}\varphi_{ji}(x_{i})=\sum_{i=1}^{n}w_{ji}x_{i}=(Wx)_{j} where W=(w_{ji})\in\mathbb{R}^{m\times n} . The full layer computes x\mapsto Wx . Concrete example (3 stocks, 3 nodes): \begin{pmatrix}\mathrm{node}_{1}\\ \mathrm{node}_{2}\\ \mathrm{node}_{3}\end{pmatrix}=\begin{pmatrix}w_{11}&w_{12}&w_{13}\\ w_{21}&w_{22}&w_{23}\\ w_{31}&w_{32}&w_{33}\end{pmatrix}\begin{pmatrix}x_{\mathrm{AAPL}}\\ x_{\mathrm{MSFT}}\\ x_{\mathrm{GOOG}}\end{pmatrix}=Wx ∎ Lemma 3 (Optimal Linear Autoencoder = PCA, Baldi and Hornik 1989 ) . Let \Sigma=U\Lambda U^{\top} be the spectral decomposition of the empirical covariance matrix. The linear autoencoder: \min_{A\in\mathbb{R}^{k\times N},\;W\in\mathbb{R}^{N\times k}}\frac{1}{T}\sum_{t=1}^{T}\|x_{t}-WAx_{t}\|^{2} achieves its global minimum at A=U_{k}^{\top} , W=U_{k} , where U_{k} are the top- k eigenvectors of \Sigma . The minimum value is \sum_{i=k+1}^{N}\lambda_{i} . Proof. Expanding the loss using \Sigma=\frac{1}{T}\sum_{t}x_{t}x_{t}^{\top} : \mathcal{L}(A,W)=\mathrm{tr}\!\left(\Sigma-\Sigma A^{\top}W^{\top}-WA\Sigma+WA\Sigma A^{\top}W^{\top}\right) Setting \frac{\partial\mathcal{L}}{\partial W}=0 gives W=\Sigma A^{\top}(A\Sigma A^{\top})^{-1} . Substituting back: \mathcal{L}(A)=\mathrm{tr}(\Sigma)-\mathrm{tr}\!\left(A\Sigma A^{\top}(AA^{\top})^{-1}\right) By the Ky Fan principle, the maximum of \mathrm{tr}(A\Sigma A^{\top}(AA^{\top})^{-1}) is attained when the rows of A span the top- k eigenspace of \Sigma , giving A=U_{k}^{\top} and W=U_{k} . Minimum loss: \mathcal{L}^{*}=\sum_{i=k+1}^{N}\lambda_{i} . ∎ Theorem 4 (KAN-PCA Reduces to PCA in the Linear Limit) . Let KAN-PCA be a KAN autoencoder \mathcal{E} with linear decoder \mathcal{D} , trained to minimize reconstruction loss. If all spline activations \varphi_{ji} are constrained to satisfy \varphi_{ji}^{\prime\prime}\equiv 0