Coverage correlation: detecting singular dependencies between random variables

Xuzhi Yang, Mona Azadkia, Tengyao Wang · 2025

Read Coverage correlation: detecting singular dependencies between random variables by Xuzhi Yang, Mona Azadkia, Tengyao Wang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-06402.txt.

Introduction

Yang, Azadkia and Wang present coverage correlation, a measure that detects when two quantities bunch on a thin, singular pattern rather than spreading on their own. Standard tools can miss such links. Their score estimates a gap between the joint distribution and independence, reading zero only for independence and one only for a singular link. Its rank-based build frees it from shape assumptions.

The measure extends to vectors, comes with a tractable null curve, and runs fast. The authors aim it at large-scale pairwise testing, where hidden curved links matter and many pairs must be screened.

Catalog record

CREATORXuzhi Yang, Mona Azadkia, Tengyao Wang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE135 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-06402

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Coverage correlation: detecting singular dependencies between random variables Xuzhi Yang, Mona Azadkia, Tengyao Wang Abstract We introduce the coverage correlation coefficient, a novel nonparametric measure of statistical association designed to quantifies the extent to which two random variables have a joint distribution concentrated on a singular subset with respect to the product of the marginals. Our correlation statistic consistently estimates an f f -divergence between the joint distribution and the product of the marginals, which is 0 if and only if the variables are independent and 1 if and only if the copula is singular. Using Monge–Kantorovich ranks, the coverage correlation naturally extends to measure association between random vectors. It is distribution-free, admits an analytically tractable asymptotic null distribution, and can be computed efficiently, making it well-suited for detecting complex, potentially nonlinear associations in large-scale pairwise testing. 1 Introduction Correlation is a measure of statistical association that quantifies how two variables tend to vary together. Classically, Pearson’s correlation, r^{X,Y} , captures linear relationships between real-valued variables X and Y ( Pearson 1920 ) . In contrast, Spearman’s rank correlation, \rho^{X,Y} , and Kendall’s rank correlation, \tau^{X,Y} , capture monotonic associations between X and Y , using different definitions of rank concordance ( Spearman 1904 ; Kendall 1938 ) . A key limitation of these classical measures is their poor performance in detecting non-monotonic associations, even in noise-free data. To overcome this limitation, numerous approaches have been proposed, including the maximal correlation coefficient ( Hirschfeld 1935 ; Gebelein 1941 ; Rényi 1959 ; Breiman and Friedman 1985 ) , various methods based on joint cumulative distribution functions and ranks ( Hoeffding 1948 ; Blum et al. 1961 ; Yanagimoto 1970 ; Puri and Sen 1971 ; Rosenblatt 1975 ; Csörgö 1985 ; Romano 1988 ; Bergsma and Dassios 2014 ; Nandy et al. 2016 ; Weihs et al. 2016 ; Weihs et al. 2018 ; Han et al. 2017 ; Wang et al. 2017 ; Drton et al. 2020 ; Gamboa et al. 2018 ; Shi et al. 2022 ; Shi et al. 2025 ; Deb and Sen 2023 ; Zhou and Müller 2025 ) , kernel-based methods ( Gretton et al. 2005 ; Gretton et al. 2008 ; Sen and Sen 2014 ; Pfister et al. 2018 ; Zhang et al. 2018 ) , information-theoretic coefficients ( Linfoot 1957 ; Kraskov et al. 2004 ; Reshef et al. 2011 ; Berrett and Samworth 2019 ; Berrett et al. 2021 ) , copula-based coefficients ( Sklar 1959 ; Schweizer and Wolff 1981 ; Dette et al. 2013 ; Lopez-Paz et al. 2013 ; Zhang 2019 ; Griessenberger et al. 2022 ) , and coefficients based on pairwise distances ( Friedman and Rafsky 1983 ; Heller et al. 2013 ; Lyons 2013 ; Székely and Rizzo 2009 ; Székely et al. 2007 ; Pan et al. 2020 ) . Although many of these coefficients are commonly applied, two significant drawbacks remain. Most are constructed with the primary goal of testing for independence, offering little direct information about the magnitude of the underlying dependence. Moreover, their null distributions are often analytically intractable, so p-values often must be obtained through computationally intensive permutation procedures. Recently, there has been renewed interest in developing nonparametric measures of statistical association, driven in part by the need to identify relevant features and interactions in large datasets. Several new statistics have been proposed to capture the extent to which Y can be expressed as a deterministic (measurable) function of X ( Dette et al. 2013 ; Chatterjee 2021 ; Azadkia and Chatterjee 2021 ; Deb et al. 2020 ; Wiesel 2022 ; Azadkia and Roudaki 2025 ) . Among these recent proposals, Chatterjee’s correlation ( Chatterjee 2021 ) has seen remarkably rapid adoption in practice, particularly in fields such as bioinformatics, where uncovering complex and potentially nonlinear associations in high-dimensional data is a central challenge ( Dong et al. 2023 ; Suo et al. 2024 ; Sansalone et al. 2024 , e.g.) . Its popularity arises from several appealing properties: the statistic is distribution-free under the null hypothesis of independence, allowing precise characterisation of its asymptotic null distribution, and it is computationally efficient, scaling well to large datasets. To illustrate, consider the task of detecting covariation in gene expression levels in a single-cell RNA sequencing experiment, where thousands of genes are measured across tens of thousands of cells. The scale of this problem creates a substantial multiple testing burden, often requiring raw p-values on the order of 10^{-8} or smaller to declare significance for any gene pair. In such settings, resampling-based tests such as permutation become computationally prohibitive, making access to an accurate asymptotic null distribution essential. Chatterjee’s correlation is specifically designed to capture the extent to which Y can be expressed as a measurable function of X and is therefore inherently asymmetric. While this asymmetry can be advantageous in certain contexts, such as when a clear predictor-response relationship is present, it may be less suitable in others. In the genetic association example above, the direction of dependence between gene expression levels is often not known a priori , and in fact, the relationship may not be directional at all. For instance, two genes, A and B, may exhibit strong statistical dependence simply because they are both downstream of a common regulator gene C, rather than one being a function of the other. Motivated by such considerations, we propose a new measure of statistical association, the coverage correlation coefficient , which is symmetric and designed to capture more general implicit functional relationships of the form f(X,Y)=0 . More precisely, the coverage correlation coefficient quantifies the extent to which the joint distribution P^{(X,Y)} is singular with respect to the product of marginals P^{X}\otimes P^{Y} , thereby detecting dependencies that may lie on low-dimensional structures within the joint space. 1.1 Coverage correlation coefficient To provide intuition for the coverage correlation coefficient, consider a simplified setting in which the random variables X and Y have marginal distributions \mathrm{Unif}[0,1] . Given an i.i.d. sample \{(X_{i},Y_{i})\}_{i=1}^{n} drawn from the joint distribution P^{(X,Y)} , we examine two extreme cases: (i) X and Y are independent; (ii) P^{(X,Y)} is singular with respect to \mathrm{Unif}([0,1]^{2}) . In the first case, the sample points (X_{i},Y_{i}) are uniformly distributed over the unit square [0,1]^{2} . In contrast, under the second scenario, the points (X_{i},Y_{i}) are concentrated on a subset of [0,1]^{2} with Lebesgue measure zero. These two cases yield qualitatively distinct scatter plots, reflecting the presence or absence of dependence. To quantify this difference, consider the area of the region in [0,1]^{2} not covered by the union of \ell_{\infty} -balls (squares) centred at each sample point (X_{i},Y_{i}) , where the area of each ball is fixed to be 1/n . The behaviour of this uncovered area has been extensively studied in the context of coverage processes ( Hall 1988 , see, e.g.) . As n\to\infty , the limiting uncovered area exhibits fundamentally different behaviour in the two cases considered above: when X and Y are independent, it converges to e^{-1} , whereas when P^{(X,Y)} is singular with respect to \mathrm{Unif}([0,1]^{2}) , it converges to 1 in probability. Building on this geometric intuition, we propose the coverage correlation coefficient of

Read the complete text