A General Framework for Designing and Evaluating Active-Controlled Trials with Non-Inferiority Objectives

Antonio Olivas-Martinez, Fei Gao, Holly Janes · 2025

Read A General Framework for Designing and Evaluating Active-Controlled Trials with Non-Inferiority Objectives by Antonio Olivas-Martinez, Fei Gao, Holly Janes (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-22071.txt.

Introduction

Antonio Olivas-Martinez, Fei Gao, and Holly Janes work on trial designs that compare a new treatment against a proven one rather than against a placebo. Such non-inferiority trials are the right tool when effective options exist but a newcomer might be cheaper, safer, or easier to deliver, yet they carry a built-in weakness. With no placebo arm, the proven treatment's effect must be borrowed from history.

The classic rule demands the new option preserve a set share of that borrowed effect. When the standard treatment is very strong, a useful newcomer can fail the rule unfairly. Newer criteria instead ask whether the new option is effective enough against a hypothetical placebo. The authors propose a general framework that folds the existing analytic methods into one design and evaluation scheme.

Catalog record

CREATORAntonio Olivas-Martinez, Fei Gao, Holly Janes
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE77 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2510-22071

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

A General Framework for Designing and Evaluating Active-Controlled Trials with Non-Inferiority Objectives Antonio Olivas-Martinez, Fei Gao, Holly Janes Abstract Active-controlled trials with non-inferiority objectives are often used when effective interventions are available, but new options may offer advantages or meet public health needs. In these trials, participants are randomized to an experimental intervention or an active control. The traditional non-inferiority criterion requires that the new intervention preserve a substantial proportion of the active control effect. A key challenge is the absence of a placebo arm, which necessitates reliance on historical data to estimate the active control effect and assumptions about how well this effect applies to the target population. Another challenge arises when the active control is highly effective, as the new intervention may still be valuable even if it does not meet the traditional criterion. This has motivated alternative criteria based on sufficient efficacy relative to a hypothetical placebo. In this work, we propose a general framework for designing and evaluating non-inferiority trials that integrates all existing analytical methods and accommodates both traditional and alternative success criteria. The framework enables the systematic comparison of methods in terms of type I error, power, and robustness to misspecification of the active control effect. We illustrate its applicability in the design of a future HIV prevention trial with a highly effective active control. In this application, our framework identifies methods that provide greater efficiency and robustness than commonly used approaches and demonstrates practical advantages of the alternative non-inferiority criterion. Overall, this framework offers a comprehensive toolkit for rigorous non-inferiority trial design, supporting method selection and the evaluation of new interventions. 1 Introduction Active-controlled trials are the most frequently used phase 2b/3 trial design when a current intervention is known to be effective and is available, but new interventions are still warranted ( Rothmann et al., 2011 ; Fleming et al., 2011 ; FDA et al., 2016 ) . The new intervention may have superior or clinically-relevant efficacy and advantages in terms of reduced cost or toxicity, improved tolerability, adherence, or ease of implementation; or additional products may be needed to serve public health needs. In such contexts, a placebo-controlled design may not be justified. In active-controlled trials, participants are randomized to one or more experimental interventions or to an active control, without a placebo arm. They may be designed to assess whether the new intervention is superior or non-inferior to the active control, where being non-inferior commonly is defined as preserving a fraction of the active control effect, often 50\% , a standard known as the preservation of effect criterion ( FDA et al., 2016 ; Fleming, 2008 ) . Active-control trials designed to assess non-inferiority are often called non-inferiority trials. A significant challenge in drawing inferences from active-controlled trials is the absence of a placebo arm. Assessing non-inferiority traditionally involves estimating the active control effect relative to placebo based on historical data, preferably from randomized trials, necessitating assumptions about the extent to which the historical estimate of the active control effect applies to the target population. These assumptions must take into account possible effect modification by both measured and unmeasured modifiers, as well as factors such as advancements in concomitant care, shifts in disease etiology or diagnostic criteria, evolving trial endpoints, and changes in the dose or regimen of the active control as its clinical use evolves ( Fleming et al., 2011 ) . One commonly invoked assumption in this setting is constancy, which essentially posits that the active control effect estimated in the historical trial(s) remains unchanged in the target population. Regrettably, any deviations from this assumption may undermine the validity of conclusions drawn from non-inferiority trials ( Rothmann et al., 2011 ; Fleming et al., 2011 ; FDA et al., 2016 ; Wang et al., 2002 ; Odem-Davis and Fleming, 2013 ) . The primary methods for assessing non-inferiority based on active-controlled trials are the fixed-margin and synthesis methods ( Rothmann et al., 2011 ; FDA et al., 2016 ; Wang et al., 2002 ) . The fixed-margin method utilizes a predetermined margin to evaluate the efficacy of the experimental intervention against the active control, while the synthesis method integrates data from both the active-controlled trial and historical trial(s) in order to assess non-inferiority. Both methods have been extensively evaluated under constancy and non-constancy conditions. While the traditional synthesis method only controls type-I error under constancy, the fixed-margin method is demonstrated to be robust to some deviations from constancy ( Wang et al., 2002 ; Odem-Davis and Fleming, 2013 ; Hung et al., 2003 ; Hung et al., 2007 ; Snapinn and Jiang, 2008 ; Brittain et al., 2012 ) . A generalization of the synthesis method improves robustness to non-constancy ( Odem-Davis and Fleming, 2013 ) . Another challenge with non-inferiority design arises in the context of a highly effective active control. In such a context, an experimental intervention may still have public health impact even if it would not satisfy commonly employed preservation of effect non-inferiority criteria. For example, if the active control has 95 \% prevention efficacy, a typical 50 \% preservation of effect criterion would stipulate that a new intervention have a prevention efficacy greater than 77.6 \% , corresponding to a 50% preservation of the log hazard ratio. Such a high bar may not be appropriate if the new intervention has advantages in terms of individual preference, cost, or feasibility of implementation. A compelling success criterion may be that the new intervention meets the success criterion that would have been used had a placebo-controlled design been possible. This is the spirit of the inferred efficacy criterion proposed for supporting the design of COVID-19 vaccine non-inferiority trials ( Fleming et al., 2021 ) . A unified approach for comparing the operating characteristics of the various analytical methods for different non-inferiority criteria is lacking. In light of the aforementioned challenges, we propose a general framework for evaluating the non-inferiority of experimental interventions compared to active controls. Our framework accommodates both traditional and new non-inferiority criteria and all existing methods for non-inferiority analysis, and facilitates the systematic evaluation and comparison across methods based on operating characteristics that are either defined conditional on the historical data or unconditional. It also enables quantification of the degree of non-constancy accommodated by each method, and offers a design approach that formally factors in uncertainty in the active control effect based on historical data. We demonstrate the applicability of our framework by designing a future HIV prevention trial with a highly effective active control. 2 Motivating Example Much success has been seen in recent years in biomedical prevention of HIV, with oral ( Grant et al., 2010 ; Baeten et al., 2012 ; Thigpen et al., 2012 ; Van Damme et al., 2012 ; Marrazzo et al., 2015 ) and now injectable ( Landovitz et al., 2021 ; Delany-Moretlwe et al., 2022 ; Bekker et al., 2024 ; Gilead Sciences, 2024 ) antiretrovirals proven effective for prevention, known as pre-exposure prophylaxis (PrEP). Long-acting Cabotegravir (CAB-LA) has proven highly effective and superior to oral PrEP in both women and men who have sex with men ( Landovitz et al., 2021 ; Delany-Moretlwe et al., 2022 ) . However, rollout, uptake, and adherence remain

Read the complete text