A cautious use of auxiliary outcomes for decision-making in randomized clinical trials.
Massimiliano Russo, Steffen Ventz, Lorenzo Trippa · 2025
Read A cautious use of auxiliary outcomes for decision-making in randomized clinical trials. by Massimiliano Russo, Steffen Ventz, Lorenzo Trippa (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-04187.txt.
Introduction
Clinical trials collect many outcomes, but decisions at interim and final analyses usually rest on the primary one alone. Russo, Ventz, and Trippa build a framework that lets auxiliary outcomes, such as treatment response, inform those decisions without weakening error control.
The Bayesian decision-theoretic framework matters most when the outcome that counts, like overall survival, arrives years after enrollment while earlier signals are already in hand. The method keeps false positive rates and other standard measures under rigorous control, with no assumption that the auxiliary and primary outcomes agree. It can also use outcomes from new tools such as circulating tumor assays. Simulations show real efficiency gains, meaning trials can reach sound decisions sooner or with fewer patients.
Catalog record
| CREATOR | Massimiliano Russo, Steffen Ventz, Lorenzo Trippa |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 118 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-04187
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
A cautious use of auxiliary outcomes for decision-making in randomized clinical trials. Massimiliano Russo, Steffen Ventz, Lorenzo Trippa Abstract Clinical trials often collect data on multiple outcomes, such as overall survival (OS), progression-free survival (PFS), and response to treatment (RT). In most cases, however, study designs only use primary outcome data for interim and final decision-making. In several disease settings, clinically relevant outcomes, for example OS, become available years after patient enrollment. Moreover, the effects of experimental treatments on OS might be less pronounced compared to auxiliary outcomes such as RT. We develop a Bayesian decision-theoretic framework that uses both primary and auxiliary outcomes for interim and final decision-making. The framework allows investigators to control standard frequentist operating characteristics, such as the type I error rate and can be used with auxiliary outcomes from emerging technologies, such as circulating tumor assays. False positive rates and other frequentist operating characteristics are rigorously controlled without any assumption about the concordance between primary and auxiliary outcomes. We discuss algorithms to implement this decision-theoretic approach and show that incorporating auxiliary information into interim and final decision-making can lead to relevant efficiency gains according to established and interpretable metrics. Keywords: Auxiliary variables, breast cancer, decision theory, glioblastoma, multiple hypothesis testing, trial design 1 Introduction Clinical trials evaluate the efficacy and safety of experimental treatments. In most cases, regulatory decisions on the efficacy of treatments are based on comparisons of primary outcomes between the experimental treatment and the standard of care (SOC). In oncology, these comparisons typically attempt to demonstrate improvements in overall survival (OS). However, in several disease settings, collecting data on OS requires long follow-up times. Therefore, using only OS for decision-making may be inefficient and expose patients to potentially ineffective experimental treatments. Some outcomes are available earlier than the primary outcomes of interest and may provide stronger signals of treatment effects, potentially reducing trial size and duration ( Pilz et al., 2012 ; Chen et al., 2019 , e.g.,) . In oncology, outcomes such as progression-free survival (PFS), response to treatment (RT), and tumor size reduction have also been used in regulatory decisions. When these are used in place of the primary outcomes for decision-making, they are referred to as surrogate outcomes . Alternatively, investigators may report summaries of these outcomes without using them for decision-making, during and or the end of the study. Also, in some trials, outcomes such as PFS inform only interim decisions (e.g., early stopping), without influencing the final reporting of primary results and recommendations at the end of the study. An ideal surrogate outcome should unambiguously inform on the effects of experimental treatments on the primary outcome (see Prentice (1989) for formal definitions). However, the relationship between treatment effects on primary and surrogate outcomes is often hypothetical or controversial. For instance, in glioblastoma, lomustine combined with bevacizumab showed improved PFS compared to lomustine alone, but later studies indicated no effect on OS ( Wick et al., 2017 ) . There is extensive literature on how to evaluate agreement between the assessment of experimental therapies based on primary outcomes and evaluations based on surrogate endpoints ( Buyse et al., 2000 ; Elliott et al., 2015 ; Vandenberghe et al., 2018 , e.g.,) . When prior evidence indicates strong agreement, investigators may consider using the surrogate as the primary endpoint in future trials, while weighing its benefits and risks. In this paper, we examine the use of auxiliary outcomes —outcomes that have not been rigorously validated, such as tumor response in glioma—to support decision-making in clinical trials. When trials are conducted, regulators would not accept these outcomes as surrogates and would require evidence of treatment effects on the primary outcome for drug approval. We develop a method for making interim and final clinical trial decisions—such as recommendations for treating future patients with the experimental therapy—that incorporates both primary and auxiliary outcomes while adhering to strict regulatory requirements regarding the risks of false positive results. Examples of regulatory requirements include the control the family-wise error rate (FWER) if the treatment is tested in multiple subgroups. We illustrate the potential advantages of joint modeling of auxiliary and primary outcomes discussing two examples: 1-Trials designs with patient subgroups. The aim is to provide evidence of treatment effects for specific subgroups while controlling the FWER ( LeBlanc et al., 2009 ; Chugh et al., 2009 , e.g.,) . Auxiliary outcomes can help identify which subgroups benefit most from the experimental treatment, thereby increasing the likelihood of reporting positive results without compromising the control of the FWER. 2-Multi-stage trial designs ( Simon, 1989 ; Ensign et al., 1994 , e.g.,) . Auxiliary outcomes can support early futility decisions while ensuring power above a desired threshold and strict control of the probability of a false positive result. Unpromising results on auxiliary outcomes can lead to early termination of the study, potentially reducing resources spent on ineffective treatments. In both cases, the regulatory constraints are defined through standard frequentist requirements. We rely on the Bayesian decision-theoretic framework ( Berger, 1985 ) to incorporate primary and auxiliary outcomes for decision-making. Throughout the paper, the optimal clinical trial design, which includes a detailed plan for interim and final decisions, coincides with the solution of a constrained maximization problem defined by three key components: (i) a utility function ( Lindley, 1976 ) ; (ii) a Bayesian prior model representative of previous studies that includes primary and auxiliary outcomes; and (iii) constraints on frequentist operating characteristics, such as the rigorous control of the probability of a false positive result below a pre-specified \alpha level, enforced across all potential scenarios in which the experimental treatment does not improve the primary outcomes. Importantly, the design is optimized using a Bayesian model, but also satisfies frequentist constraints. Our decision-making approach considers the perspectives of two distinct stakeholders. The utility function and prior model represent the viewpoint of the investigators or the pharmaceutical company. Their primary objective is to select a study design that maximizes expected utility (e.g., projected revenue if the drug succeeds) while minimizing losses (e.g., sunk costs if development is halted), given the information incorporated in the prior model. From a Bayesian decision-theoretic perspective, the optimal design for this stakeholder maximizes the expected utility. However, using this ideal, unconstrained optimization is often impractical due to regulatory requirements imposed by a different stakeholder, the regulator (e.g., the FDA). Consequently, our optimal designs will aim to maximize expected utility criteria within a constrained subset of candidate study designs that comply with regulatory requirements (e.g., family-wise error rate or statistical power). Differences in how investigators and regulators view auxiliary outcomes are often evident. Investigators typically expect auxiliary outcomes to be representative of the clinical benefit captured by the primary outcomes. At the same time, regulators require direct evidence of treatment effects on the primary outcomes, with stringent control of false positives and bias. For example, in breast cancer research, trial sponsors have long regarded early responses to therapy as promising predictors of long-term benefit. Over the past two decades, however, regulatory agencies have progressively changed their recommendations on the use of early outcomes, informed by large-scale evaluations of candidate surrogate endpoints across multiple clinical trials ( Spring et al., 2020 ) . Bayesian decision theory