Pointwise mutual information bounded by stochastic Fisher information

Pedro B. Melo · 2026

Read Pointwise mutual information bounded by stochastic Fisher information by Pedro B. Melo (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-12573.txt.

Introduction

Pedro Melo asks how much information one observed outcome can carry about an unknown parameter. He derives upper bounds on pointwise mutual information that use stochastic Fisher information. The bounds cover bounded ranges and smooth priors, with clear cases where they saturate. Averaging his result recovers a known link between mutual and Fisher information. He then tests the ideas on a Langevin particle and on a thermal qubit that senses a field.

Catalog record

CREATORPedro B. Melo
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE31190
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.12573

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Pointwise mutual information bounded by stochastic Fisher information Pedro B. Melo Abstract We derive general upper bounds to pointwise mutual information in terms of stochastic Fisher information and show these bounds average to known results in the literature for bounds to mutual information in terms of Fisher information. These results deepen the connection between information-theoretical quantities and are shown to hold in general cases. We test the bounds in classical systems and provide a quantum generalization. Our results are useful for stochastic dynamics, quantum sensing and quantum communication, providing a less costly way to realize and saturate the bounds. I INTRODUCTION Parameter estimation is a fundamental task in physics 6 ; 12 ; 20 ; 2 , where information-theoretic quantities like mutual information (MI) and Fisher information (FI) are utilized to quantify how much a measurement reveals about an unknown parameter 3 ; 11 ; 13 ; 23 . Traditionally, these quantities are treated as ensemble-averaged metrics. However, the inherent fluctuations of physical processes often prevent a direct local-global relation in standard parameter estimation 10 ; 19 . In fields like stochastic thermodynamics and continuous quantum monitoring, systems are fundamentally characterized by single realizations or trajectories 8 ; 15 ; 9 . At this single-trajectory level, the local information gained from a specific measurement outcome is captured by the pointwise mutual information (PMI) 14 ; 24 ; 4 . Correspondingly, the local sensitivity to the parameter is governed by a state-dependent quantity, the stochastic Fisher information (SFI) 16 ; 17 . Recently, it has been shown that a fundamental bound relates the average MI to the FI 11 . In this work, we present a trajectory-level generalization of this result. We derive upper bounds for the PMI directly in terms of the SFI for classical systems, and in terms of the conditional quantum Fisher information (CQFI) for quantum single-shot realizations 18 . These bounds can be tighten on quantum systems via the CQFI on trajectory level 18 . By spectral decomposition, it decomposes into three distinct components, an incoherent term arising from population changes, a coherent term arising from unitary rotations of the eigenbasis, and a cross-term representing interference between the incoherent and coherent channels. This cross-term can be negative, meaning there is destructive interference between the incoherent weight of probabilities and the basis rotation relative to the probe state. The destructive interference during continuous quantum measurements can saturate bounds for single-trajectories. This work is divided as follows: In section II, we introduce the bounds on PMI given by the probability distributions, the stochastic entropy and the stochastic Fisher information. In section III, we show that these bounds are related to the average ones, for the mutual information 11 . In section IV, we propose the bounds for the quantum PMI, analogous to the classical ones. In section V, we calculate the proposed bounds for some examples, such as an overdamped Langevin dynamics, single qubit phase estimation, real-time adaptive metrology, and information thermodynamics at trajectories level. In section VI, we discuss the results and present the conclusions. II BOUNDS ON PMI To formally establish these trajectory-level limits, we first define our core quantities. Consider an unknown parameter \theta drawn from a prior distribution p(\theta) , and a measurement outcome x governed by a conditional probability p(x|\theta) . The local information gained from a single realization is quantified by the PMI 4 , which compares the joint probability to the product of marginals i(x,\theta)=\log\frac{p(x|\theta)}{p(x)}. (1) Simultaneously, the local sensitivity of the trajectory to the parameter \theta is captured by the Stochastic Fisher Information (SFI) 16 ; 17 , defined as \iota(x,\theta)=(\partial_{\theta}\log p(x|\theta))^{2}. (2) Building upon the definitions of the PMI and the SFI, we establish upper bounds for the PMI that depend directly on the local stochastic fluctuations of the system. It has been shown 11 that the average mutual information follows a bound given by the Fisher information and the prior probability distribution p(\theta) . Here, we show a generalization to the trajectory level, relating the PMI to the SFI. Theorem 1. If an unknown parameter \theta is guaranteed to lie in a finite size set, such that \text{supp }p(\theta)\subseteq[a,b] , then the PMI is bounded by: i(x,\theta)\leq\log\left(\frac{p(x|a)+p(x|b)}{p(x)}+\int_{a}^{b}d\theta\left|\frac{p(x|\theta)}{p(x)}\right|\sqrt{\Lambda_{1}(x,\theta)}\right) (3) where \Lambda_{1}(x,\theta)=\iota(x,\theta) . Theorem 2. For an arbitrary differentiable probability distribution of the parameter p(\theta) , we have that: i(x,\theta)\leq\log\left(\int_{-\infty}^{\infty}d\theta\left|\frac{p(x|\theta)}{p(x)}\right|\sqrt{\Lambda_{2}(x,\theta)}\right)+s(\theta) (4) where \displaystyle\Lambda_{2}(x,\theta) \displaystyle=\iota(x,\theta)p(\theta)^{2}+\dot{p}(\theta)^{2}+2\partial_{\theta}\log p(x|\theta)\dot{p}(\theta)p(\theta) (5) Here, \dot{p}(\theta)=dp(\theta)/d\theta and the final term s(\theta) acts as an upper bound for the stochastic entropy. It is important to note that this bound is not parameter invariant, and does not depend on X in principle, highlighting its sensitivity to the chosen parameter. Details of PMI bounds. To derive eqs. ( 3 ) and ( 4 ), we introduce an arbitrary, non-negative function f(\theta) such that \text{supp}f(\theta)\supseteq\text{supp}p(\theta) . We rewrite the PMI algebraically as i(x,\theta)=\log\frac{p(x|\theta)f(\theta)}{p(x)}-\log f(\theta). (6) Assuming f(\theta) vanishes at infinity, we can bound the argument of the first logarithm using the fundamental theorem of calculus by integrating the absolute value of its derivative over all parameter space \frac{p(x|\theta)f(\theta)}{p(x)}\leq\int_{-\infty}^{\infty}d\theta^{\prime}\left|\frac{d}{d\theta^{\prime}}\left(\frac{p(x|\theta^{\prime})f(\theta^{\prime})}{p(x)}\right)\right|. (7) Expanding the derivative inside the absolute value using the product rule, and recognizing that probability distributions are strictly non-negative, we can factor out p(x|\theta^{\prime}) . Utilizing the identity \frac{\partial p(x|\theta)}{\partial\theta}=p(x|\theta)\partial_{\theta}\log p(x|\theta) , we express the remaining terms inside a square root. This naturally introduces the stochastic Fisher information, \iota(x,\theta)=(\partial_{\theta}\log p(x|\theta))^{2} . Let us define the general term inside the square root as \Lambda(x,\theta)\equiv\iota(x,\theta)f(\theta)^{2}+\dot{f}(\theta)^{2}+2\partial_{\theta}\log p(x|\theta)f(\theta)\dot{f}(\theta). (8) Substituting this expansion back into our original PMI expression yields the generalized bound i(x,\theta)\leq\log\left(\int_{-\infty}^{\infty}d\theta^{\prime}\frac{p(x|\theta^{\prime})}{p(x)}\sqrt{\Lambda(x,\theta^{\prime})}\right)-\log f(\theta). (9) From this generalized integral bound, our two theorems naturally emerge through specific choices of f(\theta) . For Theorem 1, the parameter lies in a finite-size set \text{supp}p(\theta)\subseteq[a,b] , and we choose f(\theta) to be a boxcar function over [a,b] . To accommodate the step function inside the integral, we note the subadditivity property \sqrt{y+z}\leq\sqrt{y}+\sqrt{z} , which allows us to bound the generalized integral by decoupling the stochastic Fisher information from the absolute derivative |\dot{f}(\theta)| . The absolute derivative yields Dirac delta functions at the boundaries, extracting the specific boundary probability conditions p(x|a) and p(x|b) . Within the open interval (a,b) , f(\theta)=1 and \dot{f}(\theta)=0 , which simplifies the remaining functional to \Lambda_{1}(x,\theta)=\iota(x,\theta) . Finally, because f(\theta)=1 inside the interval, the penalty term -\log f(\theta) vanishes. For Theorem 2, we set the arbitrary function to be the exact prior probability distribution, f(\theta)=p(\theta) . Substituting this into the general functional immediately recovers \Lambda_{2}(x,\theta) . The penalty term -\log f(\theta) becomes -\log p(\theta) , which defines the stochastic entropy s(\theta) . The proofs are discussed in more detail in Appendix A . III Recovering the average bounds Having established the state-dependent bounds for the PMI, we now demonstrate how these local limits relate to the global bounds for the MI 11 . The MI is defined as the ensemble average of the PMI over the joint probability distribution p(x,\theta)=p(x|\theta)p(\theta) , such that I(X,\Theta)=\langle i(x,\theta)\rangle . To find the average bound, we take the expectation value of the generalized bound from Eq. ( 9 ). Averaging over the joint distribution yields \displaystyle I(X,\Theta) \displaystyle\leq\sum_{x}\int d\theta~p(x,\theta) \displaystyle\times\left[\log\left(\int d\theta^{\prime}\left|\frac{p(x|\theta^{\prime})}{p(x)}\right|\sqrt{\Lambda(x,\theta^{\prime})}\right)-\log f(\theta)\right] \displaystyle=\sum_{x}p(x)\log\left(\int d\theta^{\prime}\frac{p(x|\theta^{\prime})}{p(x)}\sqrt{\Lambda(x,\theta^{\prime})}\right) \displaystyle-\int d\theta p(\theta)\log f(\theta). (10) Notice that the second term immediately recovers the penalty term associated with

Read the complete text