Projected Normal Distribution: Moment Approximations and Generalizations
Daniel Herrera-Esposito, Johannes Burge · 2025
Read Projected Normal Distribution: Moment Approximations and Generalizations by Daniel Herrera-Esposito, Johannes Burge (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-17461.txt.
Introduction
Daniel Herrera-Esposito and Johannes Burge work out formulas for the projected normal distribution in a math paper from 2025. The distribution arises when a normal random vector is divided by its own length. The result lives on the surface of a unit sphere, handy for data with direction.
No exact formulas exist for its mean and spread, which limits its use. The authors build close approximations using Taylor expansions. They also draw on the theory of quadratic forms of Gaussian variables. Wider versions of the distribution follow, shaped for systems neuroscience. In those versions, a matrix and a constant tune the scaling. The formulas make the distribution far easier to fit.
Catalog record
| CREATOR | Daniel Herrera-Esposito, Johannes Burge |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 58 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-17461
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Projected Normal Distribution: Moment Approximations and Generalizations Daniel Herrera-Esposito, Johannes Burge Abstract The projected normal distribution, also known as the angular Gaussian distribution, is obtained by dividing a multivariate normal random variable 𝐱 \mathbf{x} by its norm 𝐱 T 𝐱 \sqrt{\mathbf{x}^{T}\mathbf{x}} . The resulting random variable follows a distribution on the unit sphere. No closed-form formulas for the moments of the projected normal distribution are known, which can limit its use in some applications. In this work, we derive analytic approximations to the first and second moments of the projected normal distribution using Taylor expansions and using results from the theory of quadratic forms of Gaussian random variables. Then, motivated by applications in systems neuroscience, we present generalizations of the projected normal distribution that divide the variable 𝐱 \mathbf{x} by a denominator of the form 𝐱 T 𝐁𝐱 + c \sqrt{\mathbf{x}^{T}\mathbf{B}\mathbf{x}+c} , where 𝐁 \mathbf{B} is a symmetric positive definite matrix and c c is a non-negative number. We derive moment approximations as well as the density function for these other projected distributions. We show that the moments approximations are accurate for a wide range of dimensionalities and distribution parameters. Furthermore, we show that the moments approximations can be used to fit these distributions to data through moment matching. These moment matching methods should be useful for analyzing data across a range of applications where the projected normal distribution is used, and for applying the projected normal distribution and its generalizations to model data in neuroscience. keywords Projected normal distribution, Angular Gaussian, Directional statistics, Moments approximation, Quadratic forms, Divisive normalization 1 Introduction The projected normal distribution, also known as the angular Gaussian distribution, is a probability distribution on the unit sphere \mathcal{S}^{n-1} . A random variable \mathbf{y}\in\mathcal{S}^{n-1} that is distributed according to the projected normal distribution \mathbf{y}\sim\mathcal{PN}(\boldsymbol{\mu},\boldsymbol{\Sigma}) is obtained by radially projecting a random vector \mathbf{x}\sim\mathcal{N}(\boldsymbol{\mu},\boldsymbol{\Sigma}) onto \mathcal{S}^{n-1} as \mathbf{y}=\mathbf{x}/||\mathbf{x}|| 1 1 1 In the literature, the term projected normal sometimes refers to the special case \boldsymbol{\Sigma}=\mathbf{I} , where \mathbf{I} is the identity matrix. Here we use the term projected normal distribution to refer to the distribution with arbitrary \boldsymbol{\Sigma} . . Some appealing properties of the projected normal distribution are that it is simple to sample from, that it can be easily generalized to arbitrary dimensions, and that variants of the distribution can be readily obtained by imposing constraints on the parameters of the variable \mathbf{x} ( Paine et al. 2018 ) . However, the projected normal distribution has seen rare use in the classical literature on directional statistics. The paucity of its use is likely due to its relatively complicated density, the fact that it has a larger number of parameters compared to other angular distributions (e.g. the Kent distribution), and the lack of closed-form formulas for its moments ( Wang and Gelfand 2013 ; Paine et al. 2018 ) . Nonetheless, interest in the projected normal distribution is growing, due to its intuitive simplicity, recently described variants of the distribution with fewer parameters ( Paine et al. 2018 ) , and computational advances in parameterization and sampling methods ( Wang and Gelfand 2013 ; Hernandez-Stumpfhauser et al. 2017 ; Yu and Huang 2024 ) . Recent work in physics, biology, and in Deep Learning, has used the projected normal distribution to model data on the circle, the sphere, and the hypersphere ( Paine et al. 2018 ; Hernandez-Stumpfhauser et al. 2017 ; Maruotti 2016 ; Yu and Huang 2024 ; Michel et al. 2024 ) . It has also recently been proposed that the projected normal distribution is a natural choice to model the effects of divisive normalization on response variability in neural populations ( Herrera-Esposito and Burge 2024 ) . Divisive normalization is a model describing the sublinear relation between the inputs and outputs of a neural population ( Carandini and Heeger 2012 ) . A simple version of the model can be given by \mathbf{y}=\mathbf{x}/||\mathbf{x}|| , where \mathbf{x} is a vector of inputs to a neural population, and \mathbf{y} is the vector of the neural responses or outputs. More flexible divisive normalization schemes use denominators of the form \sqrt{\mathbf{x}^{T}\mathbf{B}\mathbf{x}+c} , where \mathbf{B} is a symmetric positive definite matrix and c is a non-negative constant ( Carandini and Heeger 2012 ; Coen-Cagli et al. 2012 ; Coen-Cagli and Schwartz 2013 ) . Figure 1: Geometry of the projected normal for the 2D case, and the generalizations considered here. Each column shows one of the four distributions considered in this work. The first row show the formula corresponding to each version of the corresponding random variable \mathbf{y} . Each distribution is obtained by dividing the Gaussian distributed random variable \mathbf{x}\sim\mathcal{N}(\boldsymbol{\mu},\boldsymbol{\Sigma}) by a different denominator. The second row shows the notation used to refer to each version of the random variable \mathbf{y} . The third row shows the geometry of each projected variable \mathbf{y} . The first column shows the random variable \mathbf{y} with a projected normal distribution, which projects \mathbf{x} onto the unit sphere \mathcal{S}^{n-1} . The second column shows the random variable \mathbf{y} with an added constant c in the denominator, which projects \mathbf{x} into the interior of the unit sphere. The third column shows the random variable \mathbf{y} with a symmetric positive definite matrix \mathbf{B} in the denominator, which projects \mathbf{x} onto the surface of an ellipsoid. The fourth column shows the random variable \mathbf{y} with a symmetric positive definite matrix \mathbf{B} and an added constant c in the denominator, which projects \mathbf{x} into the interior of an ellipsoid. One particular question of interest in systems neuroscience is how divisive normalization interacts with noise in the neural inputs to shape the response properties of neural population responses, especially the mean and the noise covariance of the neural responses ( Goris et al. 2014 ; Verhoef and Maunsell 2017 ; Coen-Cagli and Solomon 2019 ; Weiss et al. 2023 ; Goris et al. 2024 ) . However, models in computational neuroscience that incorporate divisive normalization have mostly been used to account for mean neural responses. Response (co)variance is most often added as an independent source of noise (but see Coen-Cagli and Schwartz 2013 ; Goris et al. 2014 ; Coen-Cagli and Solomon 2019 ; Weiss et al. 2023 ). There is a need for statistical models that can describe the joint effects of input noise and divisive normalization on neural population responses. Notably, by letting the neural population inputs \mathbf{x} be a random variable with a multivariate normal distribution–a common noise assumption in models of neural systems ( Kohn et al. 2016 ; Coen-Cagli and Solomon 2019 ; Goris et al. 2024 ) –the projected normal distribution and some generalized versions of it become a natural choice for modeling how input neural noise interacts with divisive normalization. One limitation of the projected normal distribution for this and other applications, however, is that no formulas for the first and second moments of the projected normal distribution are known. Here, we derive analytic approximations to the first and second moments of the projected normal distribution \mathcal{PN}(\boldsymbol{\mu},\boldsymbol{\Sigma}) . Then, motivated by applications in systems neuroscience, we also derive moment approximations and density functions for generalizations of the projected normal distribution having normalizing denominators of the form \sqrt{\mathbf{x}^{T}\mathbf{B}\mathbf{x}+c}