Intra-Class Correlation Coefficient Ignorable Clustered Randomized Trials for Detecting Treatment Effect Heterogeneity
Chen Yang, Márcio A. Diniz, Deukwoo Kwon, Madhu Mazumdar · 2025
Read Intra-Class Correlation Coefficient Ignorable Clustered Randomized Trials for Detecting Treatment Effect Heterogeneity by Chen Yang, Márcio A. Diniz, Deukwoo Kwon, Madhu Mazumdar (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-15503.txt.
Introduction
Chen Yang and co-authors published a research paper in 2025 on a class of group-randomized trials where a pesky planning number can be ignored altogether. Trials that randomize whole clusters, like schools or clinics, must guess how alike people inside a cluster are. That guess swings the needed sample size wildly, and early data for it are often missing.
For trials hunting differences in treatment effect between subgroups, the team proves the guess cancels out of the power math. Power then grows by enlarging clusters rather than adding more of them, a relief where clusters are scarce or costly. The paper gives proofs, practical guidance, and worked examples.
Catalog record
| CREATOR | Chen Yang, Márcio A. Diniz, Deukwoo Kwon, Madhu Mazumdar |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 81 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-15503
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Intra-Class Correlation Coefficient Ignorable Clustered Randomized Trials for Detecting Treatment Effect Heterogeneity Chen Yang, Márcio A. Diniz, Deukwoo Kwon, Madhu Mazumdar Abstract Abstract. Accurately estimating the intra-class correlation coefficient (ICC) is crucial for adequately powering clustered randomized trials (CRTs). Challenges arise due to limited prior data on the specific outcome within the target population, making accurate ICC estimation difficult. Furthermore, ICC can vary significantly across studies, even for the same outcome, influenced by factors like study design, participant characteristics, and the specific intervention. Power calculations are extremely sensitive to ICC assumptions. Minor variation in the assumed ICC can lead to large differences in the number of clusters needed, potentially impacting trial feasibility and cost. This paper identifies a special class of CRTs aiming to detect the treatment effect heterogeneity, wherein the ICC can be completely disregarded in calculation of power and sample size. This result offers a solution for research projects lacking preliminary estimates of the ICC or facing challenges in their estimate. Moreover, this design facilitates power improvement through increasing the cluster sizes rather than the number of clusters, making it particular advantageous in the situations where expanding the number of clusters is difficult or costly. This paper provides a rigorous theoretical foundation for this class of ICC-ignorable CRTs, including mathematical proofs and practical guidance for implementation. We also present illustrative examples to demonstrate the practical implications of this approach in various research contexts in healthcare delivery. Key words and phrases : Cluster Randomized Trials, Intra-class Correlation Coefficient, Heterogeneity of Treatment Effect, Unequal Cluster Sizes, Random Allocation Rule, Pre-randomization Expected Power. 1 Introduction Interest in investigating heterogeneity of treatment effect (HTE) ( Yang et al., 2020 ) in cluster randomized trials (CRTs) is growing, particularly for interventions implemented at the cluster level (e.g., evaluation of clinical decision support systems or training programs for physicians caring for multiple patients in clinics as clusters) ( Yang et al., 2024 ) . Although randomization occurs at the cluster level in CRTs, data collection and subsequent analyses are conducted at the individual patient level. Individual outcomes are correlated within clusters, an effect quantified by the intra-class correlation coefficient (ICC). Additionally, individuals within specific subgroups (e.g., sex, age or race/ethnicity) may respond similarly to the intervention, but these responses can differ significantly across subgroups. Mixed-effects models or generalized estimating equations are commonly used to analyze CRT data. These models typically include cluster and treatment as random effect, the subgroup and treatment interaction as fixed effects to estimate HTE. The overall treatment effect (OTE) often serves as the primary endpoint in trials, while subgroup analyses examining HTE are often secondary ( Nowalk et al., 2014 ; Sequist et al., 2010 ; Garbutt et al., 2015 ; Kruis et al., 2014 ) . Trials primarily focused on detecting HTE often lack sufficient power, as sample size calculations are typically based on the OTE. This issue was particularly pronounced in health disparity research, stimulating substantial research in this area. Yang et al. (2024) formulated a power calculation method for detecting HTE in parallel CRTs with equal cluster sizes. Tong et al. (2022) extended this framework to include scenarios with unequal cluster sizes. For CRTs with binary outcomes, Maleyeff et al. (2023) derived the design effect under equal cluster sizes using a logistic mixed-effect model. Tong et al. (2023) provided the design effect for CRTs with equal cluster sizes when outcomes are missing completely at random. Li et al. (2023) further explored the design effect in three-level CRTs, considering different levels of randomization. These contributions collectively provide a comprehensive framework for sample size determination and power calculation in CRTs aimed at detecting HTE as a function of the ICC. Note that the aforementioned references ( Yang et al., 2024 ; Tong et al., 2022 ) implicitly rely on the assumption of homogeneous subgroup distributions within each cluster, which might require additional verification in practical applications. Accurately estimating the ICC is crucial for adequately powering CRTs. Challenges arise due to limited prior data on the specific outcome within the target population, making accurate ICC estimation difficult. Furthermore, ICC can vary significantly across studies, even for the same outcome, influenced by factors like study design, participant characteristics, and the specific intervention. Power calculations are extremely sensitive to ICC assumptions. Minor variation in the assumed ICC can lead to large differences in the number of clusters needed, potentially impacting trial feasibility and cost. Underestimating the ICC increases the risk of underpowering the trial, leading to higher probability of failing to detect a true treatment effect. Addressing this challenge requires incorporating ICC uncertainty into power calculations. While this approach can be complex and may require specialized statistical software, it is crucial for robust trial design. Sensitivity analyses are commonly employed to assess the impact of ICC uncertainty on sample size requirements. However, these analyses can sometimes yield a wide range of sample size recommendations, potentially limiting their practical utility. To address this problem, in this paper, we identify a class of parallel CRTs specifically designed to detect HTE, where the ICC can be completely disregarded in sample size determination and power calculation (hereafter referred to as “ICC-ignorable CRTs”). Furthermore, the sample size and power calculation formulas for ICC-ignorable CRTs exhibit patterns closely resembling those of individual-level randomized trials. This allows for enhanced statistical power in CRTs by increasing either the number of clusters or the cluster sizes, providing greater flexibility in study design and potentially increasing the feasibility of conducting adequately powered trials. This is particularly advantageous for underpowered CRTs where increasing the number of clusters is infeasible. Moreover, our ICC-ignorable design requires only that the proportions of subgroups be identical within each cluster, which is more accessible than the assumption of homogeneous subgroup distribution and readily verifiable compared with the potential extra steps to verifying the homogeneous distribution within each cluster in practice. We also verify that the ICC-ignorable property applies to CRTs with unequal cluster sizes. In such cases, the pre-randomization expected power (PREP), defined as the average power across all possible treatment assignments, is influenced by randomization schemes ( Ouyang et al., 2021 ) . Therefore, we focus on the power and sample size calculation for ICC-ignorable CRTs under the random allocation rule ( Lachin, 1988 ) , which ensures a 1:1 ratio between intervention and control arms. We propose an approximation method for power and sample size calculation in ICC-ignorable CRTs and evaluate its performance using Monte Carlo simulation. The rest of the paper is organized as follows: Section 2 introduces the statistical model and parameters for general parallel CRTs. Section 3 presents our main findings regarding the ICC-ignorable property for both equal and unequal cluster sizes. This section also reviews the random allocation rule and provides an approximation of the variance for the generalized least squares estimation of the HTE under this rule. Section 4 details the operational characteristics of our simulations, which verify the ICC- ignorable property and evaluate the performance of our proposed variance approximation under the random allocation rule. Section 5 illustrates the sample size and power calculations for detecting HTE using two existing CRTs. Finally, Section 6 concludes the paper with discussions and future directions. 2 Statistical Model Assume there are I (