Financial Information Theory
Miquel Noguer i Alonso · 2025
Read Financial Information Theory by Miquel Noguer i Alonso (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-16339.txt.
Introduction
Miquel Noguer i Alonso lays out a framework he calls Financial Information Theory, applying entropy, divergence, mutual information, and transfer entropy to financial time series. The goal is a set of principled tools for spotting regime changes, testing market efficiency, and building portfolios.
Each measure is derived with full proofs and paired with a practical estimation algorithm. Tests on S&P 500 data from 2000 to 2025 show normalized mutual information flagging structural breaks such as the 2008 crisis and the COVID shock more clearly than autocorrelation or volatility tools. The paper also gives an entropy-adjusted Value at Risk, an information-based diversification rule, and a market efficiency test built on the same measure.
Catalog record
| CREATOR | Miquel Noguer i Alonso |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 53 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-16339
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Financial Information Theory Miquel Noguer i Alonso Abstract This paper introduces a comprehensive framework for Financial Information Theory by applying information-theoretic concepts—such as entropy, Kullback–Leibler divergence, mutual information, normalized mutual information, and transfer entropy—to financial time series. We systematically derive these measures with complete mathematical proofs, establish their theoretical properties, and propose practical algorithms for estimation. Using S&P 500 data from 2000–2025, we demonstrate empirical usefulness for regime detection, market efficiency testing, and portfolio construction. We show that normalized mutual information (NMI) behaves as a powerful, bounded, and interpretable measure of temporal dependence, highlighting periods of structural change such as the 2008 financial crisis and COVID-19 shock. Our entropy-adjusted Value at Risk, information-theoretic diversification criterion, and NMI-based market efficiency test provide actionable tools for risk management and asset allocation. We interpret NMI as a quantitative diagnostic of the Efficient Market Hypothesis and demonstrate that information-theoretic methods offer superior regime detection compared to traditional autocorrelation or volatility-based approaches. All theoretical results include rigorous proofs, and empirical findings are validated across multiple market regimes spanning 25 years of daily returns. 1 Introduction Financial markets are characterized by complex dynamics, non-stationarity, and heavy-tailed return distributions. Traditional statistical tools often rely on second-order moments or linear correlation, which can fail to capture nonlinear dependencies, structural breaks, and higher-order interactions. In contrast, information theory provides a model-free and robust framework to quantify uncertainty, dependence, and structural change, without assuming linearity or Gaussianity ( 1 ; 11 ) . Entropy and mutual information are central concepts in information theory, quantifying the uncertainty of a random variable and the amount of information shared between variables, respectively ( 15 ) . In the context of financial markets, entropy can be interpreted as a measure of market uncertainty, while mutual information captures the dependence between past and future returns, or across assets, instruments, and time scales. Transfer entropy extends this framework by providing a directional measure of information flow between time series, closely related to Granger causality but formulated in purely information-theoretic terms. However, raw mutual information is unbounded and depends on the scale of the variables, complicating comparisons across assets and time. To address this, we focus on Normalized Mutual Information (NMI), which rescales mutual information into a dimensionless quantity bounded in [0,1] . This boundedness and relative robustness to scale make NMI particularly well-suited as a diagnostic for market efficiency and temporal dependence ( 12 ) . The contributions of this paper are fourfold: 1. Rigorous Theoretical Framework : We review and formalize core information-theoretic quantities (entropy, KL divergence, mutual information, transfer entropy, and NMI) with complete proofs of all fundamental properties. 2. Estimation and Algorithms : We present practical algorithms for estimating entropy, NMI, and transfer entropy for financial time series using k -nearest neighbor (k-NN) methods, with detailed implementation guidelines. 3. Comprehensive Empirical Evidence : Using S&P 500 data (2000–2025), we show how entropy, KL divergence, and NMI capture major market regimes with detailed distributional analysis and statistical validation. 4. Practical Applications : We propose entropy-adjusted VaR, information-theoretic diversification, NMI-based market efficiency testing, and trading signal algorithms with rigorous mathematical justification. The remainder of this paper is organized as follows. Section 2 establishes core information-theoretic concepts with complete proofs. Section 3 introduces Normalized Mutual Information and proves its properties. Section 4 presents comprehensive empirical results on S&P 500 data. Section 5 develops practical applications with detailed algorithms. Section 6 connects NMI to the Efficient Market Hypothesis. Section 7 concludes. 2 Core Information-Theoretic Concepts In this section, we review the main information-theoretic concepts used throughout the paper, providing complete proofs of all fundamental properties. 2.1 Shannon Entropy Shannon entropy ( 15 ) quantifies the average uncertainty in a probability distribution, providing the fundamental building block for all subsequent information-theoretic measures. Definition 2.1 (Shannon Entropy) . Let (\Omega,\mathcal{F},P) be a probability space with X:\Omega\to\mathcal{X} a discrete random variable taking values in a finite set \mathcal{X}=\{x_{1},\ldots,x_{n}\} . The Shannon entropy of X is defined as: H(X)=H(P)=-\sum_{x\in\mathcal{X}}P(x)\log P(x)=-\mathbb{E}_{P}[\log P(X)] (1) where we adopt the convention 0\log 0=0 by continuity, and logarithms are natural (base e ) unless otherwise stated. Theorem 2.2 (Properties of Entropy) . Let P be a probability distribution over \mathcal{X} with |\mathcal{X}|=n . Then: (i) Non-negativity : H(P)\geq 0 with equality if and only if P is a point mass. (ii) Maximum entropy : H(P)\leq\log n with equality if and only if P is uniform: P(x)=1/n for all x\in\mathcal{X} . (iii) Strict concavity : H(\cdot) is strictly concave on the probability simplex. (iv) Continuity : H(\cdot) is continuous in P under total variation topology. (v) Additivity : For independent random variables X,Y : H(X,Y)=H(X)+H(Y) (2) Proof. (i) Non-negativity : Since 0\leq P(x)\leq 1 for all x , we have \log P(x)\leq 0 , so -P(x)\log P(x)\geq 0 . Thus H(P)\geq 0 . Equality holds when all non-zero terms vanish, which occurs only when P(x)\in\{0,1\} for all x , i.e., P is a point mass. (ii) Maximum entropy : We maximize H(P)=-\sum_{i}p_{i}\log p_{i} subject to \sum_{i}p_{i}=1 using Lagrange multipliers. The Lagrangian is: \mathcal{L}(p,\lambda)=-\sum_{i=1}^{n}p_{i}\log p_{i}-\lambda\left(\sum_{i=1}^{n}p_{i}-1\right) (3) Taking derivatives and setting to zero: \frac{\partial\mathcal{L}}{\partial p_{i}}=-\log p_{i}-1-\lambda=0\implies p_{i}=e^{-1-\lambda} (4) Since \sum_{i}p_{i}=1 , we have ne^{-1-\lambda}=1 , yielding p_{i}=1/n for all i . Substituting: H_{\max}=-\sum_{i=1}^{n}\frac{1}{n}\log\frac{1}{n}=\log n (5) (iii) Strict concavity : For 0<\lambda<1 and distributions P , Q , let R=\lambda P+(1-\lambda)Q . Then: \displaystyle H(R) \displaystyle=-\sum_{x}r(x)\log r(x) (6) \displaystyle=-\sum_{x}[\lambda p(x)+(1-\lambda)q(x)]\log[\lambda p(x)+(1-\lambda)q(x)] (7) By the strict concavity of -t\log t : \displaystyle H(R) \displaystyle>-\lambda\sum_{x}p(x)\log[\lambda p(x)+(1-\lambda)q(x)] (8) \displaystyle\quad-(1-\lambda)\sum_{x}q(x)\log[\lambda p(x)+(1-\lambda)q(x)] (9) Using the log-sum inequality and properties of the logarithm: H(R)>\lambda H(P)+(1-\lambda)H(Q) (10) provided P\neq Q , establishing strict concavity. (iv) Continuity : Let P_{n}\to P in total variation: \sum_{x}|P_{n}(x)-P(x)|\to 0 . The function f(t)=-t\log t (with f(0)=0 ) is continuous and bounded on [0,1] . Thus: \displaystyle|H(P_{n})-H(P)| \displaystyle=\left|\sum_{x}[f(P_{n}(x))-f(P(x))]\right| (11) \displaystyle\leq\sum_{x}|f(P_{n}(x))-f(P(x))|\to 0 (12) by uniform continuity of f on [0,1] . (v) Additivity : If X and Y are independent, then P_{X,Y}(x,y)=P_{X}(x)P_{Y}(y) . Thus: \displaystyle H(X,Y) \displaystyle=-\sum_{x,y}P_{X,Y}(x,y)\log P_{X,Y}(x,y) (13) \displaystyle=-\sum_{x,y}P_{X}(x)P_{Y}(y)\log[P_{X}(x)P_{Y}(y)] (14) \displaystyle=-\sum_{x,y}P_{X}(x)P_{Y}(y)[\log P_{X}(x)+\log P_{Y}(y)] (15) \displaystyle=-\sum_{x}P_{X}(x)\log P_{X}(x)-\sum_{y}P_{Y}(y)\log P_{Y}(y) (16) \displaystyle=H(X)+H(Y) (17) ∎ 2.2 Differential Entropy Differential entropy extends the concept of entropy to continuous variables. Definition 2.3 (Differential Entropy) . Let X be a continuous random variable with density f_{X}(x) supported on \mathbb{R}^{d} . The differential entropy of X is: h(X)=-\int_{\mathbb{R}^{d}}f_{X}(x)\log f_{X}(x)\,dx (18) provided the integral exists. Remark 2.4 . Unlike discrete entropy, differential entropy can be negative and is not invariant under smooth transformations of the variable. However, differences of entropies and related quantities, such as mutual information and KL divergence, retain meaningful invariance properties. 2.2.1 Computing Differential Entropy via k-Nearest Neighbors To compute differential entropy, we use k-nearest neighbors (k-NN) estimators ( 8 ) . Theorem 2.5 (k-NN Entropy Estimator) . The k-NN estimator for differential entropy is given by: \hat{h}(X)=\frac{1}{N}\sum_{i=1}^{N}\log\left(\frac{N\cdot\epsilon(i)}{k}\right)+\log c_{d}+\psi(k)-\psi(N) (19) where N is the number of samples, \epsilon(i) is twice the distance from the i -th sample to its k -th nearest neighbor, c_{d} is the volume of the unit ball in d -dimensional space, and \psi is the digamma function. Proof sketch. The k-NN estimator is derived from the Kozachenko–Leonenko approach, which approximates the density f(x_{i}) at each point x_{i} by: \hat{f}(x_{i})\approx\frac{k}{N\cdot c_{d}\cdot\rho_{k}(x_{i})^{d}} (20) where \rho_{k}(x_{i}) is the distance to the k -th nearest neighbor. Substituting into