Optimal Adjustment and Combination of Independent Discrete p p -Values
Gonzalo Contador, Zheyang Wu · 2025
Read Optimal Adjustment and Combination of Independent Discrete p p -Values by Gonzalo Contador, Zheyang Wu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-02647.txt.
Introduction
Merging p-values from many tests is a basic statistical move, but discrete p-values break the usual recipes. Gonzalo Contador and Zheyang Wu extended in 2025 a transport-based fix that reshapes discrete values into a smooth stand-in distribution.
Their framework unifies five classic merging rules under one approach. Theory and simulations show error control holds when the adjusted spread matches the smooth case. When the best possible test is a monotone function of a merging rule, their approximation nearly matches its power. They demonstrate the method on a study of rare genetic variants and ship it in a free R package.
Catalog record
| CREATOR | Gonzalo Contador, Zheyang Wu |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 79 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-02647
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Optimal Adjustment and Combination of Independent Discrete p p -Values Gonzalo Contador, Zheyang Wu Abstract Combining p p -values from multiple independent tests is a fundamental task in statistical inference, but presents unique challenges when the p p -values are discrete. We extend a recent optimal transport-based framework for combining discrete p p -values, which constructs a continuous surrogate distribution by minimizing the Wasserstein distance between the transformed discrete null and its continuous analogue. We provide a unified approach for several classical combination methods, including Fisher’s, Pearson’s, George’s, Stouffer’s, and Edgington’s statistics. Our theoretical analysis and extensive simulations show that accurate Type I error control is achieved when the variance of the adjusted discrete statistic closely matches that of the continuous case. We further demonstrate that, when the likelihood ratio test is a monotonic function of a combination statistic, the proposed approximation achieves power comparable to the uniformly most powerful (UMP) test. The methodology is illustrated with a genetic association study of rare variants using case-control data, and is implemented in the R package DPComb . Keywords : Meta-Analysis, Continuous Approximations, Optimal Transport, Global Hypothesis Testing, Integral Transform. 1. Introduction Combining multiple p -values to test a global hypothesis is a fundamental statistical technique with broad applications, including signal detection, meta-analysis, and integrative data analysis. In this framework, a set of p -values P_{1},\ldots,P_{n} , each representing evidence from an individual hypothesis test, are aggregated into a single summary statistic. This combined statistic is then used to assess the overall evidence against the global null hypothesis. For example, in signal detection, P_{j} , j=1,\ldots,n , may represent the significance of the j th feature or marker; in meta-analysis, P_{j} corresponds to the result from the j th study. By combining these p -values, researchers can evaluate the collective significance across multiple tests or studies, thereby increasing power and robustness [ 13 , 10 ] . Specifically, consider the global null hypothesis H_{0}=\bigcap_{j=1}^{n}H_{0j}, (1) where each H_{0j} is an individual null hypothesis for j=1,\ldots,n . Let P_{j} denote the p -value from the j th test. A common approach for testing H_{0} is to aggregate these p -values into a single statistic that summarizes the overall evidence against the global null. In this paper, we consider a general family of such statistics: T=\sum_{j=1}^{n}G^{-1}(P_{j})\quad\text{or}\quad T=\sum_{j=1}^{n}G^{-1}(1-P_{j}), (2) where G is a strictly increasing cumulative distribution function (CDF). Different choices of G yield various classical combination statistics, as summarized in Table 1 . For example, Fisher’s and Pearson’s combinations correspond to G^{-1}(1-P_{j}) and G^{-1}(P_{j}) , respectively, with G being the CDF of the \chi^{2}_{2} distribution. George’s, Stouffer’s, and Edgington’s combinations correspond to G^{-1}(P_{j}) with G being the CDF of the Logistic (0,1) , \mathcal{N}(0,1) , and Uniform (0,1) distributions, respectively. Note that in some literature [ 15 , 17 , 25 ] , Stouffer’s and George’s statistics are defined as \tilde{T}_{S}=\sum_{j=1}^{n}\Phi^{-1}(1-P_{j}) and \tilde{T}_{G}=\sum_{j=1}^{n}\log\frac{1-P_{j}}{P_{j}} , respectively. Since the standard normal and logistic distributions are symmetric about zero, i.e., G^{-1}(x)=-G^{-1}(1-x) , it follows that \tilde{T}_{S}=-T_{S} and \tilde{T}_{G}=-T_{G} . Thus, all results in this paper correspond to the definitions in Table 1 , but can be directly translated to these alternative forms. To test the global null hypothesis, compare the observed value of T to the quantiles of its null distribution at significance level \alpha . Specifically, reject H_{0} if T=\sum_{j=1}^{n}G^{-1}(P_{j}) is less than or equal to the \alpha quantile of its null distribution, or if T=\sum_{j=1}^{n}G^{-1}(1-P_{j}) is greater than or equal to the 1-\alpha quantile. This ensures that smaller values of T (for G^{-1}(P_{j}) ) or larger values of T (for G^{-1}(1-P_{j}) ) provide stronger evidence against the global null. Table 1 : Classical p -value combination tests and their null distributions under the assumption of continuous p -values. Test Statistic Null distribution under continuity Fisher [ 13 ] T_{F}=-2\sum_{j=1}^{n}\log P_{j} \chi^{2}_{2n} Pearson [ 36 ] T_{P}=-2\sum_{j=1}^{n}\log(1-P_{j}) \chi^{2}_{2n} George [ 28 ] T_{G}=\frac{T_{P}-T_{F}}{2}=\sum_{j=1}^{n}\log\frac{P_{j}}{1-P_{j}} \approx Logistic (0,n) [ 16 , 33 ] Stouffer [ 41 ] T_{S}=\sum_{j=1}^{n}\Phi^{-1}(P_{j}) \mathcal{N}(0,n) Edgington [ 10 ] T_{E}=\sum_{j=1}^{n}P_{j} \text{Irwin-Hall}(n) In much of the literature, it is assumed that the underlying p -values are continuous. Under this assumption, the P_{j} are independent and identically distributed as Uniform (0,1) random variables. If G in ( 2 ) is the CDF of a continuous distribution, then both G^{-1}(P_{j}) and G^{-1}(1-P_{j}) follow this distribution, making it straightforward to derive the null distribution of T . For the statistics in Table 1 , Fisher’s and Pearson’s combination tests correspond to the chi-squared distribution, Stouffer’s combination corresponds to the normal distribution, Edgington’s combination corresponds to the Irwin-Hall distribution, and George’s combination test corresponds approximately to the logistic distribution. In practice, however, the data and resulting test statistics are often discrete. For example, rare genetic mutations lead to discrete test statistics in genetic association studies, where treating them as continuous can result in poor performance [ 29 ] . Discrete tests also pose unique challenges: they tend to be conservative [ 3 ] , and the resulting p -values are not uniformly distributed under the null. In this paper, we consider a general setting where the input p -values are discrete and may arise from left-, right-, or two-sided tests under an arbitrary discrete null distribution (see Appendix B for details on the definitions and distributions of left-, right-, and two-sided p -values). Specifically, we assume the possible values of a discrete p -value P form a finite or countable, increasingly ordered set 0=F_{0}<F_{1}<\ldots<F_{i}<\ldots\leq 1 (with F_{\infty}=1 if needed), and P\in\{F_{i}:i\in\mathbb{N}\},\quad\text{with}\quad\mathbb{P}(P=F_{i})=p_{i}=F_{i}-F_{i-1}. (3) The CDF of P is F(x)=\mathbb{P}(P\leq x)=F_{i} for x\in(F_{i-1},F_{i}] , and the probability mass function (PMF) p_{i} is non-negative and sums to 1. In general, the distribution of P is not uniform. Throughout this paper, the index i refers to the possible values of P , while the index j in ( 2 ) refers to the independent tests and their corresponding p -values. The combination procedure for global hypothesis testing presents additional challenges. For discrete P_{j} ’s, obtaining the exact distribution of the statistics in Table 1 requires an n -fold convolution, which quickly becomes computationally infeasible as n increases [ 27 ] . Resampling-based methods can be used to approximate the null distribution of T_{n} , but they are computationally intensive and may lack accuracy for controlling p -values at small significance levels \alpha [ 37 ] . Several strategies have been proposed to address these challenges. One approach, the randomization strategy [ 9 ] , constructs a test variable with a uniform distribution by combining the discrete p -value with an independent random variable. This enables the use of continuous-case testing procedures [ 35 , 31 , 32 ] . However, randomized p -values do not satisfy Birnbaum’s admissibility criterion—meaning the same observed data can lead to different decisions [ 5 ] —and, more importantly, they introduce additional randomness into the combination process [ 38 , 40 ] . For these reasons, we do not consider randomization strategies in this work. Another strategy is to adjust the observed test statistic in ( 3 ) to better approximate a continuous null distribution. A classic approach is the mid- p -value, defined as \tilde{P}=\frac{F_{i}+F_{i-1}}{2} when P=F_{i} [ 21 ] . Barnard [ 1 ] argued that