Evaluating the impact of outcome delay on the efficiency of sample size re-estimation

Aritra Mukherjee, Michael J. Grayling, James M. S. Wason · 2026

Read Evaluating the impact of outcome delay on the efficiency of sample size re-estimation by Aritra Mukherjee, Michael J. Grayling, James M. S. Wason (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-12797.txt.

Introduction

Mukherjee, Grayling and Wason study how outcome delay harms sample-size re-estimation in clinical trials. When recruitment continues while outcomes are awaited, long delays add pipeline participants who do not feed the interim analysis. That inflates the final sample size and power, raising cost. The team derives the final sample-size distribution under varied delays for continuous and binary outcomes, and assesses precision with RMSE plus two new metrics, delay impact and cost. Trials whose re-estimated size falls below the original plan suffer most, often ending overpowered.

Catalog record

CREATORAritra Mukherjee, Michael J. Grayling, James M. S. Wason
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE43164
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.12797

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Evaluating the impact of outcome delay on the efficiency of sample size re-estimation Aritra Mukherjee, Michael J. Grayling, James M. S. Wason Abstract Sample size re-estimation (SSR) can be a powerful tool to ensure that a clinical trial meets its pre-specified power requirements when uncertainty regarding a design parameter exists at the planning stage. However, long-term primary endpoints can be harmful to the efficiency of this trial design. If recruitment is continued while treatment outcomes are awaited, long delay can potentially lead to a large number of ‘pipeline’ participants being recruited in the trial that do not contribute to the interim analysis. This may lead to a larger number of recruited participants than are actually deemed required, resulting in an over-powered trial with high cost. This paper studies the exact impact of such outcome delay on the efficiency of ‘internal pilot’ type SSR designs. The distribution of the final sample size post SSR is obtained under various delay lengths for both continuous and binary outcome data; how delay impacts the precision of the final sample size estimate is then discussed. Precisely, the impact of delay on this precision is assessed through RMSE, as well as two more novel metrics, termed the delay impact and cost . The results indicate that with increase in delay length, the delay impact increases, inflating average sample size and power. However, the severity of the effect of delayed outcomes depends highly on the exact trial setting. Trials where the re-estimated sample size is smaller than originally planned suffer the most from delayed outcomes, often leading to an over-powered trial. However, the impact of delay is substantially less if the original planned sample size remains smaller than the re-estimated sample size. Keywords: Adaptive design; Interim analysis; Sample size re-estimation; Two-stage; Outcome delay 1 Introduction Sample size estimation is an integral part of every clinical trial. This is because it is important to be able to detect a pre-specified treatment effect with the correct power, such that efficacious drugs have a high chance of being identified without using unnecessary resources. The estimation of sample size requires estimates of nuisance parameter(s) along with the treatment effect. These nuisance parameters could reflect, e.g., the outcome variance, and intra-class correlation coefficient for clustered settings, or the population event rate, depending on the type of data and the study design. Unfortunately, in practice, there is often little information available on these nuisance parameters at the trial planning stage. Similarly, a particular treatment effect may be assumed in a sample size calculation that poorly reflects the true population treatment effect; this is problematic as the trial will be incorrectly powered. In such scenarios, a sample size re-estimation (SSR) design may be useful [ 2 ] . A SSR design allows adjustment of the sample size of the trial based on accrued participant data on nuisance parameter(s) and/or the treatment effect, in order to achieve a pre-specified power level. There are several available approaches [ 6 , 7 , 8 , 13 , 10 , 19 , 21 , 23 ] to SSR, often sub-classified as to whether they are blinded or unblinded. As the name suggests, blinded SSR preserves the blinding of participant allocations to the treatment arms. Whereas, in unblinded SSR, the treatment allocation is revealed at the interim: often this will be because an estimate of the treatment effect is desired for use in a conditional power calculation [ 14 , 9 , 12 , 3 ] . Where possible, blinded SSR is preferred over unblinded SSR, for better preservation of the integrity of the trial. While the literature suggests many different approaches for SSR, a common assumption across these articles is that the treatment outcomes are immediately available. This might poorly reflect many trials in practice. In the presence of such outcome delay, the trial might stop recruitment while awaiting treatment outcomes during the interim analysis, prolonging the trial duration. Or, the trial might continue to recruit participants during the interim analysis leading to a number of ‘pipeline’ participants being recruited in the trial for whom we do not have the treatment outcome available. Either of the above scenarios is not desirable for an efficient trial [ 24 , 15 ] . While there exists methods for SSR which include partial information from participants [ 25 , 26 ] , these are rarely taken up in practice. Earlier studies on Simon’s two-stage design [ 18 ] , two-arm group-sequential designs [ 16 ] and multi-arm multi-stage designs [ 17 ] showed that a delayed outcome heavily impacts the efficiency of these trial designs. While Wason et al. considered SSR less susceptible to outcome delay than other adaptive designs, it was noted further research was required [ 24 ] . Indeed, the influence of such pipeline participants has been significant on the expected sample sizes of multi-stage trials with futility/efficacy interim assessments, but there has been no study that summarizes how a delayed outcome impacts other kinds of adaptation. Therefore, in this paper, we aim to analyse the impact of long-term primary outcomes on the efficiency of SSR designs. We focus on the often used ‘internal pilot’ type of SSR design, that does not re-estimate the treatment effect assumed in the sample size calculation and thus can typically be performed in a blinded manner. In particular, the distribution of the re-estimated sample size is used to assess the impact of outcome delay through a number of summary metrics. 2 Motivating example As an example, consider the phase III randomized placebo-controlled trial (NCT02836496) that assessed the efficacy of mepolizumab for hypereosinophilic syndrome [ 20 ] . In this trial, the primary outcome was the proportion of participants who experienced a hyper eosinophilic syndrome flare during a 32 week study period. Participants were recruited from March 7th 2017 until October 18th 2018. Therefore, the total recruitment length was approximately 19 months, with the primary outcome taking 32 weeks to observe following enrollment. An initial sample size of 80 participants (under 1:1 randomization) was estimated as being required to achieve 90% power to detect an absolute reduction of 38% (at a two-sided \alpha=0.05 ) in the proportion of participants experiencing a flare during the study period. The initial assumption for the true proportion of participants experiencing a flare on placebo was 60%. Due to a lack of evidence to support this estimate of 60%, a pre-planned blinded SSR was conducted, with an increase in sample size to be carried out if the blinded overall flare rate was less than 30%. The interim analysis was planned after 30 participants were recruited in each arm and the maximum sample size allowed was 120. Based on the observed data, the re-estimated sample size was set to be 100. Per clinicaltrials.gov, the trial recruited a total of 108 participants in 19 months. Assuming that participants were recruited uniformly over this 19 month period, the average rate of participant recruitment would have been approximately 6 participants/month. Therefore, if recruitment was not paused during the follow-up period after 60 participants had been recruited, the number of participants that would have been recruited while the primary outcomes were awaited to conduct the interim analysis for 32 weeks would have been

Read the complete text