Improving the Power of Bonferroni Adjustments under Joint Normality and Exchangeability Abstract Bonferroni’s correction is a popular tool to address multiplicity but is notorious for its low power when tests are dependent. This paper proposes a practical modification of Bonferroni’s correction when test statistics are jointly normal and exchangeable. This method is intuitive to practitioners and achieves higher power in sparse alternatives, as our simulations suggest. We also prove that this method successfully controls the family-wise error rate at any significance level. key words : Bonferroni’s correction, Multiple comparisons, Exchangeable, Jointly normal test statistics. Caleb Hiltunen and Yeonwoo Rho 1 1 1 emails: C. Hiltunen (cahiltun@mtu.edu), Y. Rho (yrho@mtu.edu) Michigan Technological University 1 Introduction Multiple comparison correction procedures are becoming increasingly important with the prevalence of large datasets. When it comes to controlling family-wise error rate (FWER), Bonferroni’s correction ( 4 ) , for its ease of use, remains one of the popular methods among practitioners ( 18 ) , despite the existence of alternative approaches such as 21 ; 8 ; 17 ; 15 ; 22 . However, Bonferroni is also well-known for its conservatism, particularly when the number of test statistics becomes very large or when tests are dependent ( 5 ) . Currently, other methods exist which are not as conservative as Bonferroni in the face of dependence, such as 12 , 1 , 19 , 23 , and 13 . In this paper, we modify Bonferroni’s correction to improve its power under dependence. We limit our scope to jointly normal test statistics that are invariant to permutations, i.e., exchangeable. We also assume test statistics are standardized with variance 1. These assumptions are not too uncommon in the p -value combination literature ( 11 ; 20 ; 6 ; 10 ) , as many null distributions of test statistics are standard normal, and exchangeability is the simplest assumption for dependence when there are no specific orders among the test statistics. By limiting its scope, our method keeps the intuitive nature of Bonferroni’s and achieves a significant improvement in power, particularly under sparse alternatives, without assuming the knowledge of any unknown parameters. Our method is anchored on 11 , where a modification of Bonferroni’s is proposed under joint normality and exchangeability. However, their method requires information on the common pairwise correlation of \rho , which, in practice, is unknown. Estimation of \rho has been somewhat dismissed in the p -value combination literature, particularly when there is only one set of test statistics, perhaps because the absence of replication typically prevents consistent estimation via the weak law of large numbers. We propose to estimate \rho using the sample variance. This is possible because one set of positively correlated test statistics under the null would appear to be clustered around a single random number. The magnitude of the correlation determines the tightness of the cluster, which can be quantified by the sample variance. In fact, this idea is not entirely new. 9 proposed this estimator of \rho in a location test with joint normal data with exchangeability. They developed a likelihood ratio test in this setting, demonstrating a use as O’Brien’s test ( 16 ) . However, 9 ’s approach has received little attention in the p-value combination literature, and the idea of estimating \rho via sample variance has not been applied to 11 ’s method. This paper showcases the use of \rho estimation with 11 ’s modification of Bonferroni’s correction. This method boasts higher power under sparse alternatives, compared to the O’Brien’s test in 9 . It can also be a practical alternative to recently developed p -value combination methods based on heavy-tails ( 23 ; 13 ) when larger significance level is desired. As a Bonferroni-type procedure, our method allows easier identification of individual significant tests following rejection of the global null, compared to the sum-based tests such as O’Brien’s and 23 ; 13 . This paper is organized as follows. Section 2 introduces our method along with the theorems that prove its validity, and Section 3 explores the performance in finite samples. Section 4 provides concluding remarks. Proofs are relegated to Appendix A . Appendix B presents size tables. 2 Method Let X=\left(X_{1},...,X_{n}\right) be a sequence of jointly normal, exchangeable, and standardized test statistics with mean \bm{\mu}\in\mathbb{R}^{n} and positive semi-definite covariance matrix \Sigma_{\rho}\in\mathbb{R}^{n}\times\mathbb{R}^{n} , where \rho\in[0,1) indicates the common correlation. Consider the following hypothesis test, H_{0}:\bm{\mu}=\bm{0}\hskip 85.35826ptH_{a}:\bm{\mu}\neq\bm{0}, where \bm{0} is the zero vector of size n . While 11 develop their method for one-sided alternatives, we extend this framework to accommodate two-sided tests. For brevity, we focus our description and simulations on the two-sided case, as the procedures for one-sided tests are similar. We provide Theorem 2 detailing how our method can be adapted for one-sided alternatives. When normal variables are exchangeable, they can be expressed as X_{i}=\sqrt{\rho}Z_{0}+\sqrt{1-\rho}Z_{i}\hskip 56.9055pti=1,2,...,n, where Z_{i} are i.i.d variates pulled from standard normal distributions for i=0,1,...,n . With this representation, we will tweak the method described in 11 for a two-sided alternative using similar methods found in 7 . We combine our test statistics into a global test statistic, M_{n}\left(\left|X\right|\right)=\max_{1\leq i\leq n}(|X_{i}|) , like in the Bonferroni case. We aim for an exact 2 2 2 Exact control meaning that FWER = \alpha as opposed to strict control meaning FWER \leq\alpha . control of the FWER at some level \alpha , so we would then find the critical value c_{\alpha} such that \displaystyle P(M_{n}(|X|)\leq c_{\alpha}) \displaystyle=P\left(\max_{i}\left(\left|\sqrt{\rho}Z+\sqrt{1-\rho}Z_{i}\right|\right)\leq c_{\alpha}\right) \displaystyle=E_{Z}\left[P\left(\max_{i}\left(\left|\sqrt{\rho}Z+\sqrt{1-\rho}Z_{i}\right|\right)\leq c_{\alpha}|Z=z\right)\right] \displaystyle=\int_{-\infty}^{\infty}\Psi_{\mu=\sqrt{\rho}z,\sigma=\sqrt{1-\rho}}^{n}\left(c_{\alpha}\right)\phi(z)dz=1-\alpha, where \Psi_{\mu,\sigma}(\cdot) indicates the folded-normal distribution with an underlying normal variable of mean \mu and standard deviation \sigma , and \phi(\cdot) indicates the standard normal density function. Here, we can then obtain the critical value c_{\alpha} through numerical integration. The global null H_{0} is rejected when M_{n}(|X|)\geq c_{\alpha} . Alternatively, the p -value, p_{0} , for this global test statistic, M_{n}(|X|) , can be calculated: the global null is rejected when p_{0}\leq\alpha , where p_{0}(\rho)=1-\int_{-\infty}^{\infty}\Psi_{\mu=\sqrt{\rho}z,\sigma=\sqrt{1-\rho}}^{n}\left(M_{n}(|X|)\right)\phi(z)dz. (GNP*) 11 provides a table of critical values c_{\alpha} for the one-sided alternative, assuming \rho is known. However, in practice, \rho is often unknown, making it impossible to use 11 ’s table. In this paper, we propose to estimate \rho using 9 ’s method-of-moments style estimator 3 3 3 It should be noted that 9 define their estimator as \widehat{\rho}=\max(0,1-s_{n}^{2}) , which is equivalent to MOM . As our framework was developed prior to our awareness of 9 , we keep MOM in this form to ensure consistency with our theorems and proofs. : \widehat{\rho}_{MOM}=(1-s_{n}^{2})I(s_{n}^{2}<1). (MOM) Here, s_{n}^{2} indicates the sample variance of X , s_{n}^{2}=\frac{1}{n-1}X^{\prime}\left(I_{n}-\frac{1}{n}J_{n}\right)X, where I_{n} is identity matrix of size n and J_{n} is the matrix of ones of size n . While 9 also provide a maximum-likelihood estimator (MLE) of \rho , this paper will only consider MOM , since the two estimators are asymptotically equivalent, as 9 point out. While GNP* - MOM require n\rightarrow\infty , our simulation suggest that n=20 is a good benchmark for arbitrary \alpha and \rho such that \alpha is controlled. See Table 1 in Appendix B . We shall prove that GNP* - MOM controls FWER. In fact, any other estimator of \rho that satisfies Assumption 1 will work with GNP* . Assumption 1 . \sqrt{2\ln(n)}\left(\sqrt{1-\rho}-\sqrt{1-\widehat{\rho}}\right)\xrightarrow[n\rightarrow\infty]{P}0. Theorem 1 proves that \widehat{\rho}_{MOM} satisfies Assumption 1 . Theorem 1 . Consider a sequence of jointly standard normal random variables X=(X_{1},...,X_{n})^{\prime} where E[X_{i}]=0,\hskip 56.9055ptE[X_{i}^{2}]=1,\hskip 56.9055ptCorr(X_{i},X_{j})=\rho for 1\leq i\leq n,1\leq j\leq n,i\neq j, and 0<\rho<1 . Then, with \widehat{\rho} defined as in MOM , we have \sqrt{a_{n}}\left(\sqrt{1-\rho}-\sqrt{1-\widehat{\rho}}\right)\xrightarrow[n\rightarrow\infty]{P}0, where a_{n}=o(n) . Since \ln(n)=o(n) , Theorem 1 implies that MOM satisfies Assumption 1 . Theorem 2 proves that GNP* - MOM controls the FWER. Theorem 2 . Consider a sequence of jointly standard normal random variables X=(X_{1},...,X_{n})^{\prime} where E[X_{i}]=0,\hskip 56.9055ptE[X_{i}^{2}]=1,\hskip 56.9055ptCorr(X_{i},X_{j})=\rho for 1\leq i\leq n,1\leq j\leq n,i\neq j, and 0<\rho<1 . Then, with M_{n}(X)=\max(X_{1},...,X_{n}) , |X|=(|X_{1}|,...,|X_{n}|)^{\prime} , and and an estimator \widehat{\rho} that satisfies Assumption 1 , \left|\int_{-\infty}^{\infty}\left(\Psi_{\mu=\sqrt{\rho}z,\sigma=\sqrt{1-\rho}}^{n}\left(M_{n}\left(\left|X\right|\right)\right)-\Psi_{\mu=\sqrt{\widehat{\rho}}z,\sigma=\sqrt{1-\widehat{\rho}}}^{n}\left(M_{n}\left(\left|X\right|\right)\right)\right)\phi(z)dz\right|\xrightarrow[n\rightarrow\infty]{P}0, where \Psi_{\mu,\sigma}(\cdot) is the cumulative distribution function of the folded-normal distribution with location \mu and scale \sigma and \phi(\cdot) is the standard normal density function. Consequently, p_{0}(\rho)-p_{0}(\widehat{\rho})\xrightarrow[n\rightarrow\infty]{P}0, where p_{0}(\cdot) is defined in GNP* . Because the observed p -value, p_{0}(\widehat{\rho}) , converges to the theoretical p -value, p_{0}(\rho) , FWER is controlled. For completeness, Theorem 3 proves FWER is controlled in the one-sided test case. Without loss of generality, we assume a positive alternative, H_{a}:\bm{\mu}>0 in this Theorem. For negative alternative, H_{a}:\bm{\mu}<0 , simply replace M_{n}(X) with M_{n}(-X) . Theorem 3 . Consider a sequence of jointly standard normal random variables X=(X_{1},...,X_{n})^{\prime} where E[X_{i}]=0,\hskip 56.9055ptE[X_{i}^{2}]=1,\hskip 56.9055ptCorr(X_{i},X_{j})=\rho for 1\leq i\leq n,1\leq j\leq n,i\neq j, and 0<\rho<1 . Then, with M_{n}=\max(X_{1},...,X_{n}) and an estimator \widehat{\rho} that satisfies Assumption 1 , \left|\int_{-\infty}^{\infty}\left(\Phi^{n}\left(\frac{x\sqrt{\rho}+M_{n}(X)}{\sqrt{1-\rho}}\right)-\Phi^{n}\left(\frac{x\sqrt{\widehat{\rho}}+M_{n}(X)}{\sqrt{1-\widehat{\rho}}}\right)\right)\phi(x)dx\right|\xrightarrow[n\rightarrow\infty]{P}0, implying convergence of the p -value for M_{n}(X) . Once the global null is rejected, this Bonferroni-type procedure allows an identification of significant tests. A test statistic X_{i} will be significant if and only if X_{i}\geq c_{\alpha} , where c_{\alpha} can be found through numerical integration. This method will always yield the maximum, M_{n}(|X|) , as a signficant test statistic, though may be too conservative for the other test statistics. See Figure 3 for simulation evidence of the conservative nature and Section 4 for discussion on potential adjustments. 3 Simulation Studies When simulating the exchangeable sequence X , we use the following computationally efficient scheme, X_{i}=\sqrt{\rho}Z_{0}+\sqrt{1-\rho}Z_{i}+\mu_{i}, where Z_{i} are independent and identically distributed standard normal variates for 0\leq i\leq n . We will perform three sets of simulations. In the first two sets of simulations, the power of GNP* - MOM (GNPMOM) is compared against Bonferroni ( 4 ) , HMP and HMPADJ ( 23 ) , and F-P ( 23 ) . HMP indicates the harmonic mean of p -values, whereas HMPADJ indicates the adjusted harmonic mean of p -values using the Landau distribution. The first set of simulations considers an extremely sparse alternative: \bm{\mu}=(\mu_{1},0,\ldots,0)^{\prime} . \mu_{1} will be selected from the range [0,3] , increasing by 0.05 each run. We set the number of iterations m=10{,}000 ; number of test statistics n=1{,}000 ; varying \rho\in(0.0,0.2,0.5,0.9) ; and varying FWER \alpha\in(0.01,0.05,0.10) . See results in Figure 1 . Observe that GNP* - MOM yields at least equal power compared to other methods. When \rho and \alpha increase we are rewarded with increased power while other methods falter. The second set of simulations considers an alternative which begins sparse and becomes more dense. In \bm{\mu} , the first n-s values are set to 0 while the other n-s+1 values are set to \sqrt{\ln(n)}/s^{0.1} , where s\in[0,1] . The same parameters m,n,\rho,\alpha listed the paragraph above were used. For results, refer to Figure 2 . When the ratio of non-zero means is less than 10%, GNP* - MOM appears to attain higher power compared to the other methods. This effect is particularly noticeable for larger \rho and \alpha . The last simulation considers a \bm{\mu} where n/2 test statistics attain mean 3 while the remaining n/2 test statistics attain mean 0 . In this method, we set m=1 ; n=1{,}000 ; \alpha=0.10 ; and \rho=0.5 . The test statistics and plotted and a horizontal red line is imposed to denote the critical value c_{\alpha} . See the results in Figure 3 . Although it is guaranteed to select the maximum X_{(n)} as a significant test statistic, c_{\alpha} struggles to capture other test statistics which exist in the alternative hypothesis. Out of 500 possible test statistics to capture, only 8 are denoted significant. Further refinement of this process is discussed in Section 4 . Lastly, for size analysis of the methods, refer to Appendix B . In the tables, we see that method GNP* - MOM provides exact control of \alpha for varying n , \rho , and \alpha , while other methods do not provide exact control everywhere. Figure 1: Comparison of the power of GNP* against various methods when a single test statistic attains a non-zero mean. Size is indicated by the horizontal black line. Note the higher power achieved by GNP* compared to the other methods. Figure 2: Comparison of the power of GNP* against various methods as the proportion of test statistics attaining non-zero mean increases. Size is indicated by the horizontal black line. Note the higher power achieved by GNP* compared to the other methods when the proportion of non-zero mean test statistics is less than 10%. Figure 3: Absolute test statistics plotted based on index, where indices less than 500 attain mean 3 while others attain mean 0. The red line indicates the critical value while the blue line indicates the separation between mean 3 and mean 0. Note the conservative nature of the critical value when detecting other test statistics which are not the maximum. 4 Conclusion In this paper, we extended the one-sided findings presented in 11 to the two sided case and provided an implementable form using an estimator described in 9 . This method provides a stable control of the FWER at size \alpha as n\rightarrow\infty , with reasonable control already at n=20 . This method is intuitive as a Bonferroni-like procedure which is favorable for practitioners. However, numerical integration may be a barrier for many people. For one-sided alternatives, refer to Table 1 in 11 after estimating \rho with MOM . The selection process of significant test statistics can be improved. Although guaranteed to yield the maximum test statistic as significant, it fails to detect many others. A couple of sequential-type tests are recommended for further investigation. One method involves directly using the distribution functions for the r^{th} largest variates as described in 11 . The other method removes the maximal data point and reexamining the global hypothesis, repeating until a non-significant test appears. One could also directly find the joint distribution of order statistics X_{(1)},...,X_{(n)} to solve for a critical value c_{\alpha} . Further extensions into the T case is desired, particularly the case of T statistics with different realized (independent) \chi^{2} variates. Appendix A Proofs Lemma 1 . Consider a sequence of jointly standard normal random variables X=(X_{1},...,X_{n})^{\prime} where E[X_{i}]=0,\hskip 56.9055ptE[X_{i}^{2}]=1,\hskip 56.9055ptCorr(X_{i},X_{j})=\rho for 1\leq i\leq n,1\leq j\leq n,i\neq j, and 0<\rho<1 . Using the estimator \widehat{\rho_{a}}=1-s_{n}^{2}, where s_{n}^{2} indicates the (unbiased) sample variance, we have that \widehat{\rho_{a}}\xrightarrow[n\rightarrow\infty]{P}\rho and \widehat{\rho_{a}}-\rho=O_{P}\left(\frac{1}{\sqrt{n}}\right). Proof of Lemma 1 . First, we want to show that 1-s_{n}^{2}\xrightarrow[n\rightarrow\infty]{P}\rho. The sample variance is defined to be s_{n}^{2}=\frac{X^{\prime}\left(I_{n}-\frac{1}{n}J_{n}\right)X}{n-1}, where I_{n} is the identity matrix of size n and J_{n} is the matrix of 1 s of size n . So the expected value is \displaystyle E[s^{2}_{n}] \displaystyle=\text{tr}\left(\frac{\left(I-\frac{1}{n}J\right)}{n-1}\Sigma\right) (1) \displaystyle=1-\rho, where \Sigma is the matrix representation of the exchangeable structure and tr (\cdot) is the trace of a matrix. Note then that \frac{(n-1)s_{n}^{2}}{1-\rho}\sim\chi^{2}(n-1) so we have that \displaystyle Var\left(\frac{(n-1)s_{n}^{2}}{1-\rho}\right)=2(n-1) (2) \displaystyle\Rightarrow Var(s_{n}^{2})=\frac{2(1-\rho)^{2}}{(n-1)}. So by Chebyshev’s, we then have that \forall\epsilon>0, \displaystyle P(|1-s_{n}^{2}-\rho|\geq\epsilon) \displaystyle\leq\frac{2(1-\rho)^{2}}{(n-1)\epsilon^{2}} (3) \displaystyle\xrightarrow[n\rightarrow\infty]{}0, which sufficiently shows \widehat{\rho_{a}}\xrightarrow[n\rightarrow\infty]{P}\rho . To show \widehat{\rho_{a}}-\rho=O_{P}\left(\frac{1}{\sqrt{n}}\right) , we apply Theorem 14.4-1 in 3 , so \displaystyle\widehat{\rho_{a}}-\rho \displaystyle=O_{P}\left(\sqrt{Var(\widehat{\rho_{a}}})\right) (4) \displaystyle=O_{P}\left(\frac{1}{\sqrt{n}}\right). ∎ Lemma 2 . Consider the sequence of jointly standard normal random variables defined in Lemma 1. If we let I(\cdot) represent the indicator function, we have then I(s_{n}^{2}<1)\xrightarrow[n\rightarrow\infty]{P}1 which, consequently, provides us that 1. I(s_{n}^{2}>1)\xrightarrow[n\rightarrow\infty]{P}0, 2. a_{n}I(s_{n}^{2}>1)\xrightarrow[n\rightarrow\infty]{P}0\hskip 28.45274pt\text{where }a_{n}\in\mathbb{R}^{n}. Proof of Lemma 2 . We want to show that I(s_{n}^{2}<1)\xrightarrow[n\rightarrow\infty]{P}1 which is equivalent to the statement P(s_{n}^{2}<1)\xrightarrow[n\rightarrow\infty]{}1. Recall that from Lemma 1 that we can adjust s_{n}^{2} into a \chi^{2} variable. Then, we can use the convergence property from Chapter 5 of 14 to show that \displaystyle P\left(\frac{(n-1)s_{n}^{2}}{1-\rho}<\frac{n-1}{1-\rho}\right) \displaystyle=P\left(\frac{\frac{(n-1)s_{n}^{2}}{1-\rho}-(n-1)}{\sqrt{2(n-1)}}<\frac{\frac{n-1}{1-\rho}-(n-1)}{\sqrt{2(n-1)}}\right) (5) \displaystyle\xrightarrow[n\rightarrow\infty]{D}P(Z<\infty) \displaystyle=1 where Z\sim N(0,1) . Therefore, we have that I(s_{n}^{2}<1)\xrightarrow[n\rightarrow\infty]{P}1 . Then consequence 1) is straightforward. For consequence 2), we have then \displaystyle P\left(\sqrt{a_{n}}\left|I(s_{n}^{2}>1)\right|>\epsilon\right) \displaystyle=P\left(I(s_{n}^{2}>1)>\frac{\epsilon}{\sqrt{a_{n}}}\right) (6) \displaystyle=\left\{\begin{array}[]{ll}0&\text{ if }I(s_{n}^{2}>1)=0\\ \\ P(s_{n}^{2}>1)&\text{ if }I(s_{n}^{2}>1)=1\\ \end{array}\right. which, from consequence 1), produces convergence to 0 in probability. ∎ Lemma 3 . Consider the sequence of jointly standard normal random variables defined in Lemma 1 . Then, we have that \widehat{\rho}=(1-s_{n}^{2})I(s_{n}^{2}<1)\xrightarrow[n\rightarrow\infty]{P}\rho Proof of Lemma 3 . This is an application of Slutsky’s theorem with Lemma 1 and Lemma 2 . ∎ Proof of Theorem 1 . Using Taylor Series on f(x)=\sqrt{x} centered at 1-\rho , observe that \displaystyle f(1-\widehat{\rho})=\sqrt{1-\rho}+\frac{1}{2\sqrt{1-\rho}}(\rho-\widehat{\rho})+R_{m} (7) \displaystyle\Rightarrow\sqrt{1-\widehat{\rho}}-\sqrt{1-\rho}=\frac{1}{2\sqrt{1-\rho}}(\rho-\widehat{\rho})+R_{m} where R_{m}=\frac{\sum_{m=2}^{\infty}f^{(m)}(1-\rho)(\rho-\widehat{\rho})^{m}}{m!}\sim O_{P}((p-\widehat{\rho})^{m})=O_{p}\left(\left(\frac{1}{\sqrt{n}}\right)^{m}\right). So to show that Assumption 1 holds for \widehat{\rho} , we simply have to show that \sqrt{a_{n}}(\rho-\widehat{\rho})\xrightarrow[n\rightarrow\infty]{P}0 . With \widehat{\rho_{a}}=1-s_{n}^{2} as in Lemma 1 , we have that \displaystyle\sqrt{a_{n}}\left(\widehat{\rho}-\rho\right) \displaystyle=\sqrt{a_{n}}\left((1-s_{n}^{2})I(s_{n}^{2}<1)-\rho-\rho I(s_{n}^{2}<1)+\rho I(s_{n}^{2}<1\right) (8) \displaystyle=\sqrt{a_{n}}(\widehat{\rho_{a}}-\rho)I(s_{n}^{2}<1)-\sqrt{a_{n}}I(s_{n}^{2}>1)\rho \displaystyle=o\left(\sqrt{n}\right)O_{p}\left(\frac{1}{\sqrt{{n}}}\right)I(s_{n}^{2}<1)-o\left(\sqrt{n}\right)I(s_{n}^{2}>1)\rho. Here, both o\left(\sqrt{n}\right)O_{p}\left(\frac{1}{\sqrt{{n}}}\right)I(s_{n}^{2}<1) and \sqrt{\ln(n)}I(s_{n}^{2}>1)\rho converges to 0 in probability through Slutsky’s theorem and Lemma 2 . Consequently, \sqrt{a_{n}}R_{m}\xrightarrow[n\rightarrow\infty]{P}0 as well, so then by the continuous mapping theorem, the entire expression converges to 0 in probability and Assumption 1 holds. ∎ Proof of Theorem 3 . First let F_{n}(x,\rho,M_{n})=\Phi^{n}\left(\frac{x\sqrt{\rho}+M_{n}}{\sqrt{1-\rho}}\right) for brevity, and see from the mean value theorem that we can find some c_{x} such that \displaystyle\left|\int_{-\infty}^{\infty}\left(F(x,\rho,M_{n}(X))-F(x,\widehat{\rho},M_{n}(X))\right)\phi(x)dx\right| \displaystyle\leq\int_{-\infty}^{\infty}\left|\left(F(x,\rho,M_{n}(X))-F(x,\widehat{\rho},M_{n}(X))\right)\phi(x)\right|dx \displaystyle=\int_{-\infty}^{\infty}n(\Phi(c_{x}))^{n-1}\phi(c_{x})\left|\ \frac{x\sqrt{\rho}+M_{n}(X)}{\sqrt{1-\rho}}-\frac{x\sqrt{\widehat{\rho}}+M_{n}(X)}{\sqrt{1-\widehat{\rho}}}\right|\phi(x)dx \displaystyle\leq\frac{1}{\sqrt{2\pi}}\int_{-\infty}^{\infty}n\Phi^{n-1}(c_{x})\left|f_{n}(x,\hat{\rho},\rho)\right|\phi(x)dx where \displaystyle f_{n}(x,\widehat{\rho},\rho)=\frac{1}{\sqrt{1-\rho}\sqrt{1-\widehat{\rho}}}\cdot( \displaystyle A_{n}(\rho)\sqrt{1-\widehat{\rho}}-A_{n}(\rho)\sqrt{1-\rho}) \displaystyle-\sqrt{2\ln(n)(1-\rho)}(\sqrt{1-\rho}-\sqrt{1-\widehat{\rho}}) \displaystyle+x(\sqrt{\rho}\sqrt{1-\widehat{\rho}}-\sqrt{\widehat{\rho}}\sqrt{1-\rho}) and observe that n\Phi^{n-1}(c_{x})\xrightarrow[n\rightarrow\infty]{}0 since \Phi(c_{x})\in(0,1) . Then, we have f_{n}(x,\widehat{\rho},\rho)\xrightarrow[n\rightarrow\infty]{D}0 pointwise in x through the continuous mapping theorem and the assumption. Because F(x,\rho,M_{n}(X))-F(x,\widehat{\rho},M_{n}(X))\xrightarrow[n\rightarrow\infty]{}0 pointwise in x and is dominated by \phi(x) , we have by the dominated convergence theorem that \lim_{n\rightarrow\infty}\int_{-\infty}^{\infty}n\Phi^{n-1}(c_{x})\left|f_{n}(x,\hat{\rho},\rho)\right|\phi(x)dx=\int_{-\infty}^{\infty}\lim_{n\rightarrow\infty}n\Phi^{n-1}(c_{x})\left|f_{n}(x,\hat{\rho},\rho)\right|\phi(x)dx=0 which concludes the proof. ∎ Lemma 4 . Consider a sequence of jointly standard normal random variables defined in Theorem 2 and define M_{n}(X)=\max(X_{1},...,X_{n}) . Then, we have that P(M_{n}(|X|)>c_{\alpha})=1-\int_{-\infty}^{\infty}\Psi^{n}_{\mu=\sqrt{\rho}z,\sigma=\sqrt{1-\rho}}(c_{\alpha})\phi(z)dz where \phi(\cdot) is the standard normal density function, \Psi_{\mu,\sigma}(\cdot) is the cumulative distribution function of |Y| when Y\sim N(\mu,\sigma) , and c_{\alpha} is some real number. Proof of Lemma 4 . Since X_{1},...,X_{n} are N(0,1) with equicorrelation \rho , we are able to express these X_{i} as X_{i}=\sqrt{\rho}Z+\sqrt{1-\rho}Z_{i}, where Z and Z_{i} are N(0,1) and all are jointly independent. Then, we have that \displaystyle P(M_{n}(|X|)>c_{\alpha}) \displaystyle=1-P(M_{n}(|X|)