Bayesian Optimal Phase II design with optimised stopping boundaries and response-adaptive randomisation.
Connor Fitchett, Ayon Mukherjee, Sofía S. Villar, David S. Robertson · 2025
Read Bayesian Optimal Phase II design with optimised stopping boundaries and response-adaptive randomisation. by Connor Fitchett, Ayon Mukherjee, Sofía S. Villar, David S. Robertson (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-14714.txt.
Introduction
Connor Fitchett, Ayon Mukherjee, Sofía S. Villar, and David S. Robertson improve a popular design for phase II clinical trials. The Bayesian Optimal Phase II framework can adapt a trial as results come in, but it splits patients evenly and spaces interim checks evenly. The authors ask whether smarter choices would do better.
They add response-adaptive randomization, which sends more patients to the treatment doing best, and they optimize when interim checks occur. Simulations show better allocation and smaller expected sample sizes with little loss of statistical power. The paper gives practical advice and free code, so trial teams can apply the changes with confidence.
Catalog record
| CREATOR | Connor Fitchett, Ayon Mukherjee, Sofía S. Villar, David S. Robertson |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 64 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-14714
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Bayesian Optimal Phase II design with optimised stopping boundaries and response-adaptive randomisation. Connor Fitchett, Ayon Mukherjee, Sofía S. Villar, David S. Robertson Abstract The Bayesian Optimal Phase II (BOP2) framework is a flexible trial design that can naturally facilitate complex adaptations due to its Bayesian setting. BOP2 uses equal randomisation and equally placed interim analyses in its design, but it is unclear whether these give the best operating characteristics. By incorporating Bayesian Response-Adaptive Randomisation (BRAR) and optimal interim analysis placement, we show that allocation to the best treatment and expected sample size can be improved with minimal impact on power. We discuss recommendations on implementing these adaptations, using simulation-based evidence, to give practical advice to practitioners. Reproducible code for the simulations is freely provided. Keywords: Bayesian adaptive design, early stopping, patient allocation, power, Project FrontRunner 1 Introduction Phase II clinical trials are typically used to identify whether a drug has promising efficacy: enough to proceed to a phase III design and eventually to market. They can evaluate different number of treatment arms: single-arm, examining only the experimental treatment; two-arm, which compares the treatment against an accepted standard of care (a control); or multi-arm, where several drugs may be evaluated at once in order to save time and money. Single-arm trials were historically common, but early phase two-arm and multi-arm studies are becoming more popular. This could be in part due to type I error rate inflation issues in single-arm designs [ 26 ] , but also in part due to the US Food and Drug Administration (FDA) new Project Optimus guidance, which encourages more work on early phase dose finding to identify the best dose for the patient [ 9 ] . Project Optimus aims to move past just accepting the maximum tolerated dose (MTD) and instead promotes evaluating both safety and efficacy in order to find the dose that is best for the patient. This shift in focus towards flexible endpoints that can model any treatment has paved the way for novel trail designs such as BOP2. BOP2 (Bayesian Optimal Phase II) is a trial design originally proposed by Zhou et al. (2017) [ 34 ] , designed for versatility to innately handle any endpoint that can be modelled in a Bayesian setting. At interim analyses, it uses Bayesian posteriors to determine the probability that one treatment is better than another, and uses this to decide whether the trial should be ended early for futility or superiority. It is optimal in the sense that it selects its stopping rules to protect the type I error rate whilst maximising the power for pre-selected null and alternate hypothesises. Since its implementation, it has been used in over 50 trials at MD Anderson [ 31 ] and has been the focus of several papers extending its reach. Zhao et al. (2023) [ 31 ] introduces BOP2-DC (BOP2 Dual-Criterion) which extends decision making from simple rejecting/accepting a treatment to rejecting/ accepting/ consider, signifying when it is best to gather more information rather than end the trial with an uncertain decision. Ding (2023) [ 6 ] considers Randomised-BOP2, where one of the main advantages is that it does not limit the number of interim analyses, thus allowing as many checks as would be suitable for the trial in progress. Zhou et al. (2020) [ 33 ] adapts the Bayesian model of BOP2 so that it caters to time-to-event data such as PFS (Progression Free Survival), giving practitioners more choice of what endpoints to evaluate. Of most note to this paper however are Zhao et al. (2022) and Mulier et al. (2024) [ 32 ] [ 20 ] , which extended the one-arm BOP2 to the two-arm and multi-arm settings, respectively. Trials beyond one-arm allow us to consider a wider range of adaptations, such as modifying how patients are allocated. Thus this paper will be taking these designs and considering what benefits can be gained by modifying the randomisation and early stopping regimes. BOP2 already incorporates early stopping rules but assumes that the interim analyses are evenly spaced. We will going further by analysing what benefits could be gained if we optimised the number and timing of interim analyses (IAs). Early stopping by itself can already reduce the average number of patients that need to be enrolled in a trial, but several papers show that optimising IA timing can lead to improved patient benefit metrics, across a range of binary and continuous endpoints. Simon (1989) [ 24 ] proposed an optimal two stage design which minimises the expected sample size (ESS) and is now commonly referenced in the trial design literature. The optimisation works via enumeration, calculating every single IA timing and then calculating what is the best ESS. Building on this work, Feng and Zee (2024) [ 10 ] attempt to move on from enumeration, as it can be computationally taxing, and introduce a utility function that effectively combines power and ESS. Whilst utility functions do allow a compromise between ESS and power, they are inevitably held back by the fact that the utility weight needs to be pre-specified. Another theoretical approach is the curtailment approach of Brannath et al. (2006) [ 3 ] . This allows the practitioner to be flexible in the number of IAs they wish to consider, as there is the option to remove a future IA at a current IA if you would be unlikely to make a decision there. Finally, both Jung et al. (2001) and Fleming (1982) [ 13 ] [ 11 ] optimise the IA via enumeration using different criterion to Simon (1989) [ 24 ] rather than simply minimising the ESS. Qin et al. (2020) [ 21 ] compares the three methods, evaluating when each method performs best. This paper will generally focus on enumeration techniques to optimise ESS as well as extending this enumeration work to multi-arm trials, with most discussion on this being found in Section 3 . Alongside having direct effects on patient benefit metrics, the timing and frequency can also effect the potential value of any response-adaptive randomisation (RAR) scheme that is used. BOP2 in its original papers has fixed, equal allocation to all of its treatment arms; an aim of this paper is to illustrate that patient benefit metrics can be improved when RAR is implemented thoughtfully. RAR moves the randomisation away from fixed randomisation (typically equal randomisation amongst all the arms, although other schemes exist) and towards an adaptive scheme that learns from the data: as more patient data are gathered, most types of RAR will skew the allocation probabilities so that more patients are allocated towards the best performing arm. Robertson et al. (2023) [ 22 ] summarises a wide range of RAR which has been analysed in the current literature, including the RAR this paper focuses on: Bayesian RAR (BRAR). Initially defined by Thompson (1933) [ 28 ] , BRAR uses Bayesian posterior probabilities to guide the allocation of patients, therefore naturally working well with Bayesian designs. BRAR has now been successfully used in modern trials such as BATTLE [ 16 ] and I-SPY 2 [ 2 ] . Bayesian Response Adaptive Randomisation fits into the regulatory focus by promoting efficient, ethical, and data-driven trial designs that