Exact detection threshold of the packing test

Tuan Pham · 2026

Read Exact detection threshold of the packing test by Tuan Pham (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2608-00445.txt.

Introduction

Pham derives the exact detection threshold of the packing test for spherical uniformity. The alternatives are high-dimensional Fisher-von Mises-Langevin and Watson models. Poisson approximation techniques drive the derivation. The result confirms an empirical observation with rigor. The packing test is strictly suboptimal for uniformity in both models.

In the FvML model, the threshold takes a precise power-log form in dimension and sample size. In the Watson model, it centers near p over two with a root-p log correction. Non-null limiting distributions are derived for both models. The largest squared inner product shows a discontinuous phase transition under Watson. No such phenomenon occurs under FvML, he shows.

Catalog record

CREATORTuan Pham
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE141 KB
LICENSEhttp://creativecommons.org/publicdomain/zero/1.0/
RIGHTSCC0
SOURCEarXiv

Source: https://arxiv.org/abs/2608.00445

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Exact detection threshold of the packing test Tuan Pham Abstract Using Poisson approximation techniques, we derive the detection threshold of the packing test in Cai et al. [2013] when testing spherical uniformity under high-dimensional Fisher–von Mises–Langevin (FvML) and Watson alternatives. Our result rigorously confirms the empirical observation that the packing test is strictly suboptimal for testing uniformity in these two popular models. In the high-dimensional FvML model, its detection threshold is precisely κ = Θ ⁡ ( p 3 / 4 / ( log ⁡ n ) 1 / 4 ) \kappa=\Theta\left(p^{3/4}/(\log n)^{1/4}\right) . In the high-dimensional Watson model, its detection threshold is p − 2 ​ κ = Θ ⁡ ( p ​ log ⁡ n ) p-2\kappa=\Theta(\sqrt{p\log n}) , or equivalently κ = p / 2 − Θ ⁡ ( p ​ log ⁡ n ) \kappa=p/2-\Theta(\sqrt{p\log n}) . We show that the limiting scalings of the largest squared inner product undergo a discontinuous phase transition in the Watson model, whereas no analogous phenomenon occurs in the FvML model. 1 Introduction Assessing uniformity is a classical goodness-of-fit problem in directional statistics. Arguably one of the most fundamental questions in the field, uniformity testing has attracted considerable attention over the past few decades. Let us briefly describe the setting. Let \bm{X}_{1},\bm{X}_{2},\ldots,\bm{X}_{n} be observations with \bm{X}_{i}\in\mathbb{S}^{p-1} for all i=1,2,\ldots,n . We assume that the variables \bm{X}_{i} are drawn independently from an unknown distribution \mu supported on the hypersphere \mathbb{S}^{p-1} . Denote the uniform distribution on \mathbb{S}^{p-1} by \mathrm{Unif}(\mathbb{S}^{p-1}) . The uniformity testing problem can then be formulated as \displaystyle H_{0}:\ \mu=\mathrm{Unif}(\mathbb{S}^{p-1})\qquad\text{versus}\qquad H_{1}:\ \mu\neq\mathrm{Unif}(\mathbb{S}^{p-1}). (1) In fixed dimensions, particularly for p=2 and p=3 , uniformity testing plays an important role in applications such as geology, paleomagnetism, and cosmology. For detailed background and examples, we refer to the monographs Fisher et al. [1987] ; Ley and Verdebout [2017] ; Mardia and Jupp [2000] . Recent tests that apply in arbitrary but fixed dimensions include García-Portugués et al. [2023] ; Fernández-de-Marcos and García-Portugués [2023] ; García-Portugués et al. [2021] (see also the references therein). We also refer to the survey papers Portugués and Verdebout [2018] ; Pewsey and García-Portugués [2021] for an overview of recent progress and additional testing procedures. More recently, the testing problem ( 1 ) has found new applications in high-dimensional statistics and machine learning. The situation in high dimensions is more interesting than its fixed-dimensional counterpart because the sphere suffers from the curse of dimensionality in high dimensions, and a test can be suboptimal in terms of sample size, dimension, or both. Let us briefly highlight some applications below. Testing spherical symmetry . It is well known that a random vector \bm{X}\in\mathbb{R}^{p} is spherically symmetric if and only if \|\bm{X}\| is independent of \bm{X}/\|\bm{X}\| , and \bm{X}/\|\bm{X}\| is uniformly distributed on \mathbb{S}^{p-1} . Therefore, spherical symmetry can be assessed by combining an independence test with a uniformity test. In practice, departures from spherical symmetry often manifest as violations of uniformity for the projected directions (see Cutting et al. [2017] for details). Contrastive learning . Contrastive learning is a form of representation learning in which one seeks to learn a map \phi , given data \{\bm{X}_{1},\ldots,\bm{X}_{n}\} , such that \phi extracts useful features for a downstream task, which may range from estimation and classification to clustering. More precisely, for each i\in[1,n] , one generates two augmented views \left(\bm{X}^{(1)}_{i},\bm{X}^{(2)}_{i}\right) of \bm{X}_{i} using random transformations (one may think of \bm{X}_{i} as an image and of the random transformations as random cropping, blurring, or color distortion). An ideal \phi should align the paired views and separate the unpaired views. One way to separate the unpaired views is to require that the normalized transformed data \bm{z}^{(j)}_{i}:=\frac{\phi\left(\bm{x}^{(j)}_{i}\right)}{\left\|\phi\left(\bm{x}^{(j)}_{i}\right)\,\right\|};\qquad j=1,2 satisfy \bm{z}^{(1)}_{1},\dots,\bm{z}_{n}^{(1)}\stackrel{{\scriptstyle i.i.d.}}{{\sim}}\mbox{Unif}\left(\mathbb{S}^{p-1}\right)\qquad\text{and}\qquad\bm{z}^{(2)}_{1},\dots,\bm{z}_{n}^{(2)}\stackrel{{\scriptstyle i.i.d.}}{{\sim}}\mbox{Unif}\left(\mathbb{S}^{p-1}\right). A high-dimensional version of Ajne’s test Ajne [1968] for uniformity was used in Fürst et al. [2022] to assess the quality of the learned map \phi ; see also Wang and Isola [2020] ; Jing et al. [2021] and the references therein. Regularization of neural networks . In overparameterized neural networks, regularization is crucial for preventing overfitting and improving generalization. Given n neuron weight vectors \bm{w}_{1},\bm{w}_{2},\ldots,\bm{w}_{n}\in\mathbb{R}^{p} , a regularization term typically takes the form \displaystyle\underbrace{\lambda_{1}\sum_{i=1}^{n}h(\bm{w}_{i})}_{\text{magnitude regularization}}+\underbrace{\lambda_{2}\,g(\bm{w}_{1},\bm{w}_{2},\ldots,\bm{w}_{n})}_{\text{structure regularization}}. The penalty function h typically regularizes the magnitudes of the neurons, for example through \ell_{1} or \ell_{2} norms, analogous to the Lasso or ridge penalties in high-dimensional statistics. In contrast, the term g aims to promote specific structures among the neurons. A line of empirical work Lin et al. [2020] ; Liu et al. [2018] ; Xie et al. [2017] has demonstrated that when g is designed to encourage hyperspherical uniformity among the neurons, it can lead to improved generalization. Uniformly distributed neurons have also been shown to help avoid spurious local minima during training Xie et al. [2017] . Connections between this perspective and testing hyperspherical uniformity have been discussed in Liu et al. [2021] . Despite the abundance of existing tests in fixed- and low-dimensional settings, uniformity testing in high dimensions remains comparatively underexplored. To the best of the author’s knowledge, only a few high-dimensional tests have been investigated in the literature. We provide a brief overview of these tests below. 1. Rayleigh test Cutting et al. [2017] ; Paindaveine and Verdebout [2016] . This test can be formulated as a U-statistic of the data points with the inner-product kernel: \displaystyle R_{n} \displaystyle:=\frac{\sqrt{2p}}{n}\sum_{1\leq i<j\leq n}\bm{X}^{\top}_{i}\bm{X}_{j}. (2) 2. Bingham test Cutting et al. [2022] ; Zou et al. [2014] ; Paindaveine and Verdebout [2016] . This test is also based on a U-statistic of the data points, but with a quadratic inner-product kernel: \displaystyle B_{n} \displaystyle:=\frac{p}{n}\sum_{1\leq i<j\leq n}\left[\bigl(\bm{X}^{\top}_{i}\bm{X}_{j}\bigr)^{2}-\frac{1}{p}\right]. (3) 3. Packing test Cai et al. [2013] . This test is based on the smallest pairwise angle, or equivalently on the largest absolute inner product: \displaystyle P_{n} \displaystyle:=p\cdot\max_{1\leq i<j\leq n}\bigl(\bm{X}^{\top}_{i}\bm{X}_{j}\bigr)^{2}-4\log n+\log\log n. (4) 4. High-dimensional Sobolev tests Ebner et al. [2025] . This is a family of Sobolev-based tests that generalizes the classical tests proposed in Gine [1975] . Among the tests above, the packing test ( 4 ) remains comparatively less understood in terms of sharp detection rates and consistency against standard local parametric alternatives. Empirically, it does not appear to be optimal against common classes of alternatives, although it is provably consistent against certain types of non-local alternatives Jiang and Pham [2025a] . For the Rayleigh and Bingham tests, several detection-rate and optimality results have already been established in the literature. The Rayleigh test ( 2 ) is known to be optimal against the FvML distributions (see ( 5 ) below for a precise definition) and blind to the Watson distributions (see ( 6 ) below for a precise definition) Cutting et al. [2017] . The Bingham test exhibits the opposite behavior: it is optimal against the Watson distributions but suboptimal against the FvML distributions Cutting et al. [2022] . The goal of the present article is to rigorously derive and justify the detection rates of the packing test under the classes of FvML and Watson distributions using Poisson approximation techniques; see, for example, Arratia et al. [1989] and the references therein. Our result shows that the detection threshold for the packing test is \Theta\left(p^{3/4}/\left(\log n\right)^{1/4}\right) under the FvML model and p/2-\Theta\left(\sqrt{p\log n}\right) under

Read the complete text