Informative simultaneous confidence intervals in graphical group sequential test procedures
Liane Kluge, Werner Brannath · 2026
Read Informative simultaneous confidence intervals in graphical group sequential test procedures by Liane Kluge, Werner Brannath (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-12103.txt.
Introduction
In a 2026 paper, Liane Kluge and Werner Brannath study trials testing many hypotheses while holding the family-wise error rate. They review graph-based tests, special cases of Bonferroni-closure tests, and ask whether each stage should use only its p-value or all past ones. They propose a strategy that works across hypotheses using only current-stage evidence, yet gains power by using past evidence to raise significance levels. They build confidence intervals that add information on treatment effects, with power loss, plus a rule judging bound accuracy.
Catalog record
| CREATOR | Liane Kluge, Werner Brannath |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 98249 |
| LICENSE | http://creativecommons.org/licenses/by-sa/4.0/ |
| RIGHTS | CC BY SA |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.12103
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Informative simultaneous confidence intervals in graphical group sequential test procedures Liane Kluge, Werner Brannath Abstract Test procedures for multiple hypotheses in a group sequential clinical trial that control the family-wise error rate are considered. Several graphical group sequential tests suggested in the literature, which are special cases of Bonferroni-closure tests, are discussed. The focus is on the question of whether to consider at the current stage only the evidence of the current repeated p-value or the evidence over all repeated p-values from the previous stages. A new test strategy controlling the family-wise error rate is introduced that consistently works across all hypotheses, with the evidence (i.e., repeated p-value) from the current stage. The strategy is more powerful than similar previously suggested test procedures. This is achieved by using the evidence from previous stages to increase the significance levels. For the test procedures, corresponding compatible simultaneous confidence intervals are presented, having the disadvantage of often not providing additional information on the treatment effects. For this reason, we extend previous work about informative simultaneous confidence intervals for one-stage graphical tests to graphical group sequential trials. Iterative algorithms are introduced that calculate these informative bounds that have a small power loss compared to the original graphical group sequential test. The boundaries can be calculated after each stage. In addition, previous work is extended by a criterion to estimate the accuracy of the numerically calculated boundaries. The suggested informative bounds can be used to provide median-conservative, i.e., reliable estimators, for estimating the treatment effects in a group sequential test with multiple hypotheses. K eywords Simultaneous confidence intervals, graphical testing procedure, group sequential test, informative confidence intervals, median conservative estimators 1 Introduction For clinical trials with multiple hypotheses and strong control of the family-wise error rate (FWER), many strategies have been suggested. Bonferroni-based closure tests offer the advantage of achieving higher power compared to simple and well-known Bonferroni-adjusted tests. 2 suggested a graphical approach to perform Bonferroni-type tests based on the closure principle. Such designs have several advantages. The graphical tests allow for a visualization of hierarchies and preferences among the different null hypotheses. One special case is the fixed-sequence test with two hypotheses: first one hypotheses (e.g. for the primary endpoint) is tested at the overall significance level \alpha . If it can be rejected, the level \alpha is shifted to the second hypothesis (e.g. for the secondary endpoint) so that it can be tested at level \alpha . Otherwise, both hypotheses are accepted. There is also interest in testing multiple hypotheses repeatedly in time under strong control of the family-wise error rate (FWER). Group sequential designs for single null hypotheses that incorporate at least one interim analysis have already been extensively studied, see, for instance, 15 . Naively borrowing testing strategies from multiple tests for testing multiple hypotheses repeatedly in time can cause inflations of the FWER. 4 and 14 have discussed strategies for the fixed-sequence test. 11 suggest for all graphical tests from 2 a extension to group sequential trials. Two strategies are considered: One only uses the repeated p-value of the currently conducted stage, and the other one uses the so-called sequential p-value , which is defined as the minimum over all repeated p-values up to the conducted stage. In this paper, we will briefly discuss these strategies with regard to the question, how the data from the previous stages should be used at the current stage of data collection. In particular, this leads us to a new suggested testing strategy for multiple group sequential trials that uses for each hypothesis the final stage p-value to decide whether to reject the hypothesis, but the evidence from all repeated p-values over all stages and hypotheses is used to increase the corresponding significance level of the test. This paper deals with simultaneous confidence intervals for graphical group sequential tests, such as those proposed in 4 and 11 and the new suggested strategy. In addition, suitable estimators are considered. We restrict ourselves to a multiple testing problem of left-sided hypotheses H_{j}:\theta_{j}\leq 0 , 1\leq j\leq m , and simultaneous confidence intervals (SCI) that are bounded from the left \text{SCI}=(L_{1},\infty)\times\dots\times(L_{m},\infty) . Due to the possibility of shifting and inverting, the results can easily be extended to other one-sided null hypotheses. By intersecting confidence regions, we can also obtain SCIs for two-sided hypotheses. In general, finding simultaneous confidence intervals for multiple testing strategies with strong control of the familywise error rate that are both compatible and informative is difficult. Compatibility means that the confidence bounds yield the same test decisions as the given multiple test (i.e. H_{j} is rejected if and only if L_{j}\geq 0 ). The term informative refers to bounds which strictly increase with increasing evidence against the corresponding null hypotheses (unless none of the gatekeeper hypotheses were rejected), a property compatible confidence intervals often fail to have. For single-stage tests it is natural to define the evidence against a hypothesis as increasing when the corresponding (un-adjusted) p-value decreases. In this case, informative SCI bounds would almost always provide more information on \theta_{j} (i.e. L_{j}>0 ) if H_{j} but not all null hypothesis are rejected. For multiple tests that are more powerful than the Bonferroni-adjusted test, for instance, those based on the closure principle, constructing SCI bounds that are both compatible and informative poses a problem. This also applies to the graphical group sequential tests introduced in 11 since they are special cases of Bonferroni-based closure tests. One can easily use the results from 13 to obtain compatible simultaneous confidence bounds that will be listed in this paper. Unfortunately, the bounds remain uninformative in the sense that the borders of rejected hypotheses remain stuck at the boundary of the null hypothesis as long as not all hypotheses have been rejected. In 1 we have suggested informative simultaneous confidence intervals based on single-stage graphical tests. The aim of this paper is to extend the concept and method of informative confidence intervals suggested in 1 to graphical group sequential trials, like e.g. in 11 . Similar to 1 , we will see that the rejections made by the graphical algorithms cannot exactly be reproduced by our procedure, but our simultaneous confidence bounds will always be informative for all hypotheses (except for those with gatekeepers). This requires a reasonable definition of evidence for the graphical group sequential tests, which will also be provided in this paper. The informativeness yields that the borders do not stack at the borders of the hypotheses, except for the negligible case that the repeated or sequential p-value is equal to the final local level. To the best of our knowledge, this is not possible for the original graphical group sequential tests. As for the single-stage case, our bounds depend on an information weight q\in(0,1) . The weight indicates the trade-off between informativeness and compatibility with the original group sequential graph. If the information weight tends to zero, the test decisions given through the information bounds become increasingly similar to those of the underlying group sequential graph. For greater information weights, one could roughly say that the expected size of the confidence bounds and, therefore, the informativeness increase, at the expense of the rejections made. The rejections increasingly differ from those of the