Kendall Correlation Coefficient for non-Identically Distributed Variables

Alexei Stepanov · 2026

Read Kendall Correlation Coefficient for non-Identically Distributed Variables by Alexei Stepanov (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-25055.txt.

Introduction

Stepanov defines a Kendall rank correlation for data pairs that are not drawn from one shared law. Classic theory assumes each pair follows the same distribution. In the mixed case, he builds a theoretical coefficient for a sample of size n. He proves the usual rank statistic has exactly that value as its mean. He also shows the statistic settles toward a fixed limit as the sample grows. These results certify the new coefficient as the right target. Computer trials back the theory.

Catalog record

CREATORAlexei Stepanov
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE23400
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.25055

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Kendall Correlation Coefficient for non-Identically Distributed Variables Alexei Stepanov Abstract In the present paper, we discuss for the first time the theoretical Kendall correlation coefficient for non-identical bivariate data. In the non-identical case, we first introduce a theoretical Kendall correlation coefficient τ n \tau_{n} and show that the expected value of the rank Kendall correlation coefficient τ ~ n \tilde{\tau}_{n} is equal to τ n \tau_{n} . We then prove that τ ~ n \tilde{\tau}_{n} converges in probability to τ = lim n → ∞ τ n \tau=\lim_{n\rightarrow\infty}\tau_{n} . These facts enable us to state that τ n \tau_{n} is a correctly defined theoretical Kendall correlation coefficient for the non-identical case. We also support our theoretical results by simulation experiments. Keywords and Phrases : non-identical bivariate data; correlation coefficients; convergence in probability. AMS 2000 Subject Classification: 60G70, 62G30 1 Introduction Let (X,Y),(X_{1},Y_{1}),\ldots,(X_{n},Y_{n}) be independent and identically distributed (iid) random vectors with absolutely continuous bivariate distribution function F(x,y)=P(X\leq x,Y\leq y) , density function f(x,y) and marginal distribution functions H(x) and G(y) . There are three basic measures of dependence rate: the Pearson \rho , the Spearman \rho_{S} and the Kendall \tau correlation coefficients. The rate of dependence between the variables X and Y is most often measured by the Pearson correlation coefficient \rho=\frac{E(X-EX)(Y-EY)}{\sigma_{X}\sigma_{Y}}. The random variable \tilde{\rho}_{n}=\frac{\sum_{i=1}^{n}(X_{i}-\bar{X})(Y_{i}-\bar{Y})}{\sqrt{\sum_{i=1}^{n}(X_{i}-\bar{X})^{2}\sum_{i=1}^{n}(Y_{i}-\bar{Y})^{2}}} represents the sample Pearson correlation coefficient, for which it is known that \tilde{\rho}_{n}\stackrel{{\scriptstyle p}}{{\rightarrow}}\rho ; see, for example, Fisher (1921). Let X_{1,n}\leq\ldots\leq X_{n,n} be the order statistics obtained from the sample X_{1},\ldots,X_{n} . For these order statistics, let us define their concomitants Y_{1,n},\ldots,Y_{n,n} . Let X_{i}=X_{j,n} , then Y_{j,n}=Y_{i} be the concomitant of the order statistic X_{j,n} . The concept of concomitants is discussed in the papers of David and Galambos (1974), Bhattacharya (1974), Egorov and Nevzorov (1984), David and Nagaraja (2003), Balakrishnan and Lai (2009), Bairamov and Stepanov (2010), Balakrishnan and Stepanov (2015). See also the references therein. Let I_{ji}=I(Y_{j,n}\leq Y_{i,n}),\ i\not=j\in\{1,2,\ldots,n\} , where I is the indicator function. The random variable \tilde{\tau}_{n}=\frac{4\sum_{i=2}^{n}\sum_{j=1}^{i-1}I_{ji}}{n(n-1)}-1 (1.1) is known as the rank Kendall correlation coefficient. The theoretical analogue of \tilde{\tau}_{n} is presented by \tau=4E[F(X,Y)]-1=4\int_{\mathbb{R}^{2}}F(x,y)f(x,y)dxdy-1. It is known, see, for example, Balakrishnan and Lai (2009) or Stepanov (2025a), that \tau=E\tilde{\tau}_{n} . It is also shown in Stepanov(2025a) that \tilde{\tau}_{n}\stackrel{{\scriptstyle p}}{{\rightarrow}}\tau as n\rightarrow\infty . The random variable \tilde{\rho}_{n,S}=1-\frac{6\sum_{i=1}^{n}\left(\sum_{j=1}^{n}I_{ji}-i\right)^{2}}{n^{3}-n} is known as the rank Spearman correlation coefficient. The theoretical analogue of \tilde{\rho}_{n,S} is presented by \rho_{S}=12E[H(X)G(Y)]-3=12\int_{\mathbb{R}^{2}}H(x)G(y)f(x,y)dxdy-3. New theoretical and rank correlation coefficients were introduced and analyzed in Stepanov (2025b). The theoretical correlation coefficient r was defined by \displaystyle r \displaystyle= \displaystyle 6E[F(X,Y)-H(X)G(Y)] \displaystyle= \displaystyle 6\int_{\mathbb{R}^{2}}[F(x,y)-H(x)G(y)]f(x,y)dxdy and the rank correlation coefficient \tilde{r}_{n} was defined by \tilde{r}_{n}=\frac{3\tilde{\tau}_{n}-\tilde{\rho}_{n,S}}{2} . The rationale for introducing r is as follows. Let us consider the dependence function F(x,y)-H(x)G(y) , which gives us the dependence value in every point (x,y) of the distribution support. We adjust the definition of the dependence function and redefine it as 6[F(x,y)-H(x)G(y)] . We can view any correlation coefficient as some average value of the dependence rate, or of the dependence function. Observe that the dependence function does not take into account the likelihood of obtaining points (x,y) . In the above definition of r , we take this likelihood into account. Thus, the correlation coefficient r represents the “ideal” average of the dependence rate. Since E\tilde{r}_{n}\rightarrow r,\ \tilde{r}_{n}\stackrel{{\scriptstyle p}}{{\rightarrow}}r\ (n\rightarrow\infty) , see Stepanov (2025b), the coefficient \tilde{r}_{n} can be viewed as the rank representative of r . The correlation coefficients \tilde{\rho}_{n},\ \tilde{\rho}_{n,S},\ \tilde{\tau}_{n} and \tilde{r}_{n} were compared in Stepanov (2025b). It was revealed that the behavior of \tilde{\rho}_{n} can be very different from the behavior of the rank correlation coefficients \tilde{\rho}_{n,S},\ \tilde{\tau}_{n},\ \tilde{r}_{n} , which, in turn, behave in a similar way with each other. This follows from the definitions of \tilde{\rho}_{n} and \tilde{\rho}_{n,S},\ \tilde{\tau}_{n},\ \tilde{r}_{n} . The coefficient \tilde{\rho}_{n} measures the association between the variables X and Y , whereas the coefficients \tilde{\rho}_{n,S},\ \tilde{\tau}_{n} and \tilde{r}_{n} measure the association between the corresponding ranks. The latter, in particular, means that the coefficients \tau,\ \rho_{S} and r are invariant under any increasing transformation. A question was raised: which correlation coefficient measures the dependence rate best? Based on the simulation analysis of the variances of correlation coefficients, it was concluded in Stepanov (2025b) that \tilde{\rho}_{n} is preferable when the association between X and Y is ”close“ to \pm 1 and \tilde{\rho}_{n,S},\ \tilde{\tau}_{n},\ \tilde{r}_{n} are preferable, otherwise. Of course, the range ”close“ is negotiable. It was also shown that amongst the rank coefficients \tilde{\tau}_{n},\ \tilde{\rho}_{n,S} and \tilde{r}_{n} the coefficient \tilde{r}_{n} has the smallest variances when the association between X and Y is not ”close“ to \pm 1 . Some disadvantages of \rho/\tilde{\rho}_{n} were also highlight in Stepanov (2025b). For example, the disadvantage of \rho and, correspondingly, of \tilde{\rho}_{n} is that \rho cannot be defined if the second moments do not exist. Observe that \rho_{S},\ \tau and r exist for any absolutely continuous non-degenerate distribution function. Another disadvantage of \tilde{\rho}_{n} is that \tilde{\rho}_{n} is very sensitive to contamination of outliers, while \tilde{\rho}_{n,S},\ \tilde{\tau}_{n} and \tilde{r}_{n} are rather robust, see, for example, Shevlyakov and Vilchevski (2002), Xu et al. (2013) and Stepanov (2025b). The coefficients \tilde{\rho}_{n},\ \tilde{\rho}_{n,S},\ \tilde{\tau}_{n} and \tilde{r}_{n} continue to be well-defined in the non-identical case. They can be easily computed, but their asymptotic behaviors are unpredictable due to the difficulties with defining their theoretical analogues \rho_{n},\ \rho_{n,S},\ \tau_{n} and r_{n} . Observe that the theoretical correlation coefficients depend on n in the non-identical case. The goal of this paper is to determine and study (for the first time) the theoretical Kendall correlation coefficient in the non-identical case. Let (X_{1},Y_{1}),\ldots,(X_{n},Y_{n}) be independent random vectors with absolutely continuous bivariate distribution functions F_{1}(x,y),\ldots,F_{n}(x,y) , density functions f_{1}(x,y),\ldots,f_{n}(x,y) and marginal distribution functions H_{1}(x),\ldots,H_{n}(x) and G_{1}(y),\ldots,G_{n}(y) . The relationship between the samples X_{1},\ldots,X_{n} and Y_{1},\ldots,Y_{n} can be measured by the Kendall correlation coefficient defined by \displaystyle\tau_{n} \displaystyle= \displaystyle\frac{4\sum_{i=1}^{n}\sum_{j=1,j\not=i}^{n}E[F_{i}(X_{j},Y_{j})]}{n(n-1)}-1 (1.2) \displaystyle= \displaystyle\frac{4\sum_{i=1}^{n}\sum_{j=1,j\not=i}^{n}\int_{\mathbb{R}^{2}}F_{i}(x,y)f_{j}(x,y)dxdy}{n(n-1)}-1 \displaystyle= \displaystyle\frac{4\sum_{i=1}^{n}\sum_{j=1,j\not=i}^{n}P(X_{j}\leq X_{i},\ Y_{j}\leq Y_{i})}{n(n-1)}-1. The rank correlation coefficient \tilde{\tau}_{n} in the non-identical case can again be defined by ( 1.1 ). It has the same form as in the iid case. Observe that in the iid case, i.e., when F_{i}=F , ( 1.2 ) reduces to \tau_{n}=4E[F(X,Y)]-1=\tau . Since the sample (X_{i},Y_{i})\ (i=1,\ldots,n) consists of non-identically distributed vectors, the coefficients \tilde{\tau}_{n} and \tau_{n} allows us also to work with iid sample containing outliers. The rest of the paper is organized as follows. In Section 2, we show that E\tilde{\tau}_{n}=\tau_{n} and that there exists a \tau\in[0,1] , such that \tau_{n}\rightarrow\tau,\quad\tilde{\tau}_{n}\stackrel{{\scriptstyle p}}{{\rightarrow}}\tau\quad(n\rightarrow\infty). These results enable us to consider \tilde{\tau}_{n} and \tau_{n} as a pair of conjugate Kendal correlation coefficients (rank and theoretical) in the non-identical case. In Section 3, we support our theoretical results by simulation experiments. 2 Results Theorem 2.1 . The expected value of \tilde{\tau}_{n} has the form E\tilde{\tau}_{n}=\tau_{n}. For finding E\tilde{\tau}_{n} , let us study E\left[\sum_{i=2}^{n}\sum_{j=1}^{i-1}I_{ji}\right]=\sum_{i=2}^{n}\sum_{j=1}^{i-1}P(Y_{j,n}\leq Y_{i,n}) . For n=2 , it has the form E\left[\sum_{i=2}^{2}\sum_{j=1}^{i-1}I_{ji}\right]=P(Y_{1,2}\leq Y_{2,2}) . We have two options: either X_{1}=X_{1,2},\ X_{2}=X_{2,2} , or X_{1}=X_{2,2},\ X_{2}=X_{1,2} . Since X_{1,2}\leq X_{2,2} , we obtain that \displaystyle P(Y_{1,2}\leq Y_{2,2}) \displaystyle= \displaystyle P(X_{1,2}\leq X_{2,2},\ Y_{1,2}\leq Y_{2,2}) \displaystyle= \displaystyle P(X_{1}\leq X_{2},Y_{1}\leq Y_{2})+P(X_{2}\leq X_{1},Y_{2}\leq Y_{1})=p_{21}+p_{12}, where p_{ij}=\int_{\mathbb{R}^{2}}F_{j}(x,y)f_{i}(x,y)dxdy . The result is shown for n=2 . Let us consider the case n=3 . We have E\left[\sum_{i=2}^{3}\sum_{j=1}^{i-1}I_{ji}\right]=P(Y_{1,3}\leq Y_{2,3})+P(Y_{1,3}\leq Y_{3,3})+P(Y_{2,3}\leq

Read the complete text