A multi-scale information geometry reveals the structure of mutual information in neural populations
Simone Azeglio, Steeve Laquitaine, Ulisse Ferrari, Matthew Chalk · 2026
Read A multi-scale information geometry reveals the structure of mutual information in neural populations by Simone Azeglio, Steeve Laquitaine, Ulisse Ferrari, Matthew Chalk (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-06304.txt.
Introduction
Simone Azeglio and three co-authors derive a multi-scale geometry for how neural populations encode sensory information. A representational geometry measures distances between stimuli by how reliably brain activity separates them. Different constructions of that distance can lead to qualitatively different conclusions about the neural code, which has made the approach hard to trust without firmer foundations.
Starting from how distances must contract when stimulus resolution is lost, the authors show a unique Riemannian geometry emerges. It extends the classic Fisher information metric across scales, from fine details to coarse global distinctions. Well encoded stimulus directions expand in this geometry, and poorly encoded ones contract, tying the metric exactly to mutual information. Estimated with diffusion models and applied to visual cortex data, it yields interpretable, robust features.
Catalog record
| CREATOR | Simone Azeglio, Steeve Laquitaine, Ulisse Ferrari, Matthew Chalk |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 70 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.06304
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
A multi-scale information geometry reveals the structure of mutual information in neural populations Simone Azeglio, Steeve Laquitaine, Ulisse Ferrari, Matthew Chalk Abstract Understanding how neural population responses represent sensory information is a central problem in systems neuroscience. One approach is to define a representational geometry on stimulus space in which distances reflect how reliably stimuli can be distinguished from neural activity. However, different constructions of these distances can lead to qualitatively different conclusions about the neural code. Here, we show that a unique Riemannian representational geometry emerges from first principles governing how distances contract as stimulus resolution is lost through coarse-graining. This results in a multi-scale extension of the Fisher information metric, capturing encoding structure from fine stimulus details to coarse global distinctions. The resulting geometry is exactly related to the mutual information encoded by the population: well encoded stimulus directions — those contributing more to mutual information — are expanded, whereas poorly encoded directions are contracted. The metric tensor can be estimated using diffusion models, making the framework practical for large neural populations and high-dimensional stimuli. Applied to visual cortical responses to natural images, the eigenvectors of the metric tensor identify stimulus variations that contribute most to information transmission, yielding interpretable features that are robust to modelling choices. Together, these results provide a principled, information-theoretic framework for characterising neural population codes. 1 Introduction How do neural populations represent sensory stimuli? A promising approach is to define a representational geometry over stimulus space, in which distances between stimuli reflect how reliably the population distinguishes them. Such geometries have been used to compare representations across systems and stages of processing [ 1 , 2 ] , track changes in representation during learning [ 3 , 4 ] , and compare the internal representations of biological and artificial networks [ 5 , 6 ] . However, many ways exist to define such a geometry from neural responses, and different choices can lead to qualitatively different conclusions about what a population encodes. Here we show that a unique representational geometry emerges from first principles governing how representational distances transform as stimulus resolution is reduced. Because neural responses are noisy, we reason that the geometry should depend on the full response distribution rather than treating responses as deterministic. The canonical Riemannian geometry for distributions is constructed from the Fisher information metric, which characterizes how sensitive the response distribution is to infinitesimal stimulus perturbations [ 7 ] . However, Fisher information is purely local: two codes can have identical Fisher information everywhere yet differ markedly in their ability to distinguish distant stimuli [ 8 ] . We therefore seek a geometry that captures how populations encode stimulus differences at all scales, not only locally. This geometry is uniquely determined by simple requirements on how representational distances change under stimulus coarse-graining, whereby fine stimulus details become progressively harder to discriminate. The resulting geometry provides a multi-scale extension of the Fisher metric, capturing encoding structure from fine discriminations between nearby stimuli to coarse global distinctions. The geometry has an exact relationship to the mutual information encoded by the population: distances between stimuli are locally expanded along well-encoded directions, which contribute most to mutual information, and contracted along poorly encoded ones. We show, moreover, that the metric tensor can be estimated for high-dimensional natural stimuli using diffusion models, making the framework practical for neural populations responding to complex natural stimuli. We apply our approach to recorded neural populations in visual cortex. The eigenvectors of the metric tensor identify the stimulus directions stretched by the geometry, revealing which stimulus variations contribute most to the mutual information. These directions yield interpretable image features that differ systematically across visual areas. Because the geometry emphasises stimulus directions that contribute to encoded information, and are therefore constrained by the data, these features reflect robust properties of the neural code rather than details of a fitted model. In contrast, we show that Fisher information can be sensitive to stimulus directions that contribute little to encoded information and are therefore poorly constrained. Together, our results establish a principled multi-scale geometry that reveals the structure of information transmission in neural population codes. 2 From Fisher information to a multi-scale geometry of neural coding Consider a continuous stimulus x\sim p(x) , which elicits a neural population response r with likelihood p(r\mid x) . Our goal is to define a geometry on stimulus space in which distances reflect how reliably different stimuli can be distinguished from neural activity. This can be formalized by endowing stimulus space with a Riemannian metric, with infinitesimal line element ds^{2}=dx^{\top}G(x)\,dx, (1) where G(x) is some positive semi-definite metric tensor. A classical result from information geometry, Čencov’s theorem [ 7 ] , shows that under mild conditions on the family of distributions p(r|x) indexed by x 1 1 1 The support of r does not depend on x , and p(r\mid x) is everywhere differentiable in x with finite Fisher. , the unique metric (up to scale) depending locally on p(r\mid x) and its first derivatives at x , while also invariant to transformations of r that preserve its sufficient statistics (i.e. to reparameterisations that retain all stimulus information), is the Fisher information matrix G(x)\propto J(x) , J(x)=\mathbb{E}_{p(r\mid x)}\left[\nabla_{x}\log p(r\mid x)\,\nabla_{x}\log p(r\mid x)^{\top}\right]. (2) The Fisher information matrix thus defines the canonical Riemannian geometry over the family of response distributions, p(r\mid x) . It quantifies how sensitive p(r\mid x) is to infinitesimal stimulus perturbations through the relation, D_{\mathrm{KL}}(p(r\mid x)\|p(r\mid x+dx))=\tfrac{1}{2}dx^{\top}J(x)\,dx+O(\|dx\|^{3}) . Geometrically, the Fisher thus deforms stimulus space so that regions where nearby stimuli elicit more distinguishable responses are stretched further apart. However, two neural codes can share identical local structure — equal sensitivity to infinitesimal stimulus perturbations — while differing arbitrarily in global structure, and thus in how well they distinguish distant stimuli [ 8 ] . For example, for a scalar stimulus with Gaussian observation noise, where J(x)\propto f^{\prime}(x)^{2} and f(x)=\mathbb{E}[r\mid x] is the tuning curve, two tuning curves can share the same |f^{\prime}(x)| everywhere, yielding identical Fisher information at every stimulus, yet encode very different information about the stimulus globally (Fig. 1 A–C). Figure 1: Fisher and multi-scale Fisher for a one-dimensional stimulus. ( A – B ) Bell-shaped and monotonic tuning curves ( \mathbb{E}[r\mid x]=f(x) ) for a single neuron with stimulus-independent Gaussian noise, encoding a scalar stimulus x with uniform prior. ( C ) The Fisher information is identical for both tuning curves, since they share the same local gradient magnitude and Gaussian noise variance. ( D – E ) Contribution at each diffusion scale, [\phi_{t}*J_{t}](x)\,\delta t , to the multi-scale Fisher, for the bell-shaped (D) and monotonic (E) tuning curves. ( F ) The multi-scale Fisher is larger everywhere for the monotonic tuning curve, reflecting that it encodes strictly more mutual information. This limitation reflects a more fundamental point. The posterior p(x\mid r) , which describes what can be inferred from neural responses, depends on the response distribution p(r\mid x^{\prime}) across the entire stimulus space (through the normalisation constant in Bayes’ rule). Thus, a geometry based on J(x) – a local functional of p(r\mid x) – cannot, in general, fully capture what can be inferred about the stimulus from neural responses. Here we seek a geometry that reflects