Graph Based, Adaptive, Multi Arm, Multiple Endpoint, Two Stage Design
Cyrus Mehta, Ajoy Mukhopadhyay, Martin Posch, Cytel Corporation, Harvard T.H.Chan School of Public Health, Novo Nordisk, Medical University of Vienna · 2025
Read Graph Based, Adaptive, Multi Arm, Multiple Endpoint, Two Stage Design by Cyrus Mehta, Ajoy Mukhopadhyay, Martin Posch, Cytel Corporation, Harvard T.H.Chan School of Public Health, Novo Nordisk, Medical University of Vienna (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-03197.txt.
Introduction
Cyrus Mehta, Ajoy Mukhopadhyay, and Martin Posch extend a graphical method for juggling many hypotheses into adaptive two-stage trial designs. The graph method draws a trial's testing priorities as arrows: when one hypothesis falls, its error budget flows to the next. Adaptive designs complicate the picture, since treatments may be dropped, sample sizes re-estimated, and even the hierarchy revised after stage one. Family-wise error must survive all that freedom.
Two preservation strategies compete: combining p-values across stages, and conditioning the stage-two error rate on stage one. The paper lays out each method's statistical machinery. A large simulation experiment then compares their operating characteristics head to head. Multi-arm, multi-endpoint trials, common in modern drug development, are the beneficiaries. Adaptivity without error control is just optimism; this work prices it honestly.
Catalog record
| CREATOR | Cyrus Mehta, Ajoy Mukhopadhyay, Martin Posch, Cytel Corporation, Harvard T.H.Chan School of Public Health, Novo Nordisk, Medical University of Vienna |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 86 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-03197
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Graph Based, Adaptive, Multi Arm, Multiple Endpoint, Two Stage Design Cyrus Mehta, Ajoy Mukhopadhyay, Martin Posch, Cytel Corporation, Harvard T.H.Chan School of Public Health, Novo Nordisk, Medical University of Vienna Abstract Abstract The graph based approach to multiple testing is an intuitive method that enables a study team to represent clearly, through a directed graph, its priorities for hierarchical testing of multiple hypotheses, and for propagating the available type-1 error from rejected or dropped hypotheses to hypotheses yet to be tested. Although originally developed for single stage non-adaptive designs, we show how it may be extended to two-stage designs that permit early identification of efficacious treatments, adaptive sample size re-estimation, dropping of hypotheses, and changes in the hierarchical testing strategy at the end of stage one. Two approaches are available for preserving the family wise error rate in the presence of these adaptive changes; the p-value combination method, and the conditional error rate method. In this investigation we will present the statistical methodology underlying each approach and will compare the operating characteristics of the two methods in a large simulation experiment. Key Words: MAMS design, multiple endpoints, group sequential, adaptive design, hierarchical testing, graphs, combining p-values, conditional error rate 1 Introduction A common design issue in a confirmatory clinical trial comparing one or more treatment arms to a common control arm is how to perform hypothesis tests for more than one efficacy endpoint while preserving strong control of the family wise error rate (FWER). For example in a double blind clinical trial of patients with acute exacerbation of schizophrenia (ClinicalTrials.gov identifier NCT01469039) two doses of the experimental drug ALK-9072 (350 mg/day or 500 mg/day) were compared to a matching control drug. The primary endpoint was the change from baseline in the PANSS total score at week 12. A key secondary endpoint was the change from baseline in the PANSS negative symptoms score. The trial would be considered a success if efficacy could be demonstrated with either dose for the primary endpoint. Once efficacy is demonstrated for the primary endpoint, there interest in also filing a claim for the secondary endpoint. In settings such as this, a convenient way to conceptualize and display the study team’s strategy for testing the various hypotheses in a hierarchical manner, while recognizing that some hypotheses are more important than others, is through a graph with weighted nodes representing the various hypotheses to be tested, and directed edges for propagating the weights from rejected hypotheses to ones yet to be tested. Graph based approaches were developed in ( Bretz et al. 2009b ; Burman et al. 2009 ) and ( Maurer and Bretz 2013a ) to construct flexible sequentially rejective Bonferroni based tests in single stage designs. The graphs are a convenient way to define weights in a closed testing procedure, ( Marcus et al. 1976 ) , where each intersection hypothesis is tested by a weighted Bonferroni test. Subsequently Bretz et al. 2011 showed how, by separating the weighting strategy from the testing strategy, more efficient weighted Simes and Dunnett type tests could replace Bonferroni tests when additional information about the correlation structure amongst the hypotheses was available. Xi et al. 2017 extended the procedure to weighted mixed tests for settings where the correlation between test statistics is only known for subsets of test statistics. Next, these testing procedures were extended to group sequential tests incorporating interim analyses. First, Maurer and Bretz 2013b considered the case where the correlation between test statistics is unknown. Anderson et al. 2022 extended the group sequential tests to the weighted mixed tests for settings where for some (or all) test statistics the correlation is known. Finally, in the present paper, these approaches are extended to adaptive tests, allowing for adaptations such as the selection of hypotheses, or sample size reassessment after an unblinded interim analysis. Table 1 gives an overview of the available fixed sample, group sequential and adaptive group sequential multiple testing procedures. Table 1: Overview of proposed fixed sample and group sequential multiple testing procedures and adaptive multiple testing procedures based on conditional error rates. * Klinglmueller et al. 2014 mention early rejections as extension in the discussion. Method early rejection adaptive weights nonpara-metric para-metric mixed Bretz et al. 2009b ; Burman et al. 2009 ; Maurer and Bretz 2013a x x Bretz et al. 2011 x x Xi et al. 2017 x x x x Anderson et al. 2022 x x x x x Koenig et al. 2008 x x Magirr et al. 2014 ; Ghosh et al. 2020 ; Placzek and Friede 2019 x x x Posch et al. 2011 ; Klinglmueller et al. 2014 ; Sugitani et al. 2016 \text{x}^{*} x x x This paper x x x x x x We consider two approaches to construct weighted adaptive multiple testing procedures; one based on the combination test principle and the other based on the conditional error rate principle. In the first approach, adaptive p-value combination tests ( Bauer and Köhne 1994 ) , in conjunction with closed testing, are used to construct adaptive multiple testing procedures that control the family wise error rate by combining adjusted stage-wise p-values ( Hommel 2001 ; Bretz et al. 2009a ) . We consider tests where the adjusted p-values are based on weighted Bonferroni tests if the correlation between test statistics is unknown Bretz et al. 2009b , weighted parametric tests if the correlation is known ( Bretz et al. 2011 ) , or weighted mixed tests if the correlation between only some of the test statistics is known ( Xi et al. 2017 ) . The second approach is based on the conditional rejection principle ( Proschan and Hunsberger 1995 ; Posch and Bauer 1999 ; Müller and Schäfer 2004 ) . For settings where the correlation between test statistics is known, this approach has been used to construct multiple testing procedures such as adaptive Dunnett tests ( Koenig et al. 2008 ) , adaptive multi-arm multi-stage group sequential designs incorporating early stopping ( Magirr et al. 2014 ; Ghosh et al. 2020 ) , and adaptive multiple testing procedures for clinical trials with subgroup selection ( Placzek and Friede 2019 ) . However, these approaches use unweighted tests. For settings where the correlation is unknown, weighted adaptive tests based on partial conditional error rates have been proposed by ( Posch et al. 2011 ; Klinglmueller et al. 2014 ; Sugitani et al. 2016 ) , who generalize the adaptive, fixed sample graph based tests to adaptive tests for this scenario. In this paper, we extend both the combination approach and the conditional error approach to two stage group sequential weighted adaptive tests for scenarios where the correlation may be known between some test statistics and unknown in others. Non-negative weights can be defined by graphs ( Bretz et al. 2009b ; Burman et al. 2009 ; Maurer and Bretz 2013a ) or, alternatively, arbitrary non-negative weights summing up to one (or a lower value) can be specified. Section 2 is a quick review of the Bretz et al. 2009b and Bretz et al. 2011 graph-based methodology, applied to a single stage non adaptive design involving two treatment arms, a common control arm, and two endpoints.