Inclusion of zero total event trials in meta-analyses maintains analytic consistency and incorporates all available data.

Friedrich JO, Adhikari NK, Beyene J. · 2007

Read Inclusion of zero total event trials in meta-analyses maintains analytic consistency and incorporates all available data. by Friedrich JO, Adhikari NK, Beyene J. (2007) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/europmc-pmc1783664.txt.

Introduction

Friedrich, Adhikari and Beyene tackled in 2007 a quiet inconsistency in how study results are pooled. A meta-analysis combines many trials into one overall estimate. Trials with zero events in both the treated and the control group are kept when effects are stated as a risk difference, but dropped for relative risk or odds ratios.

The authors reran three published meta-analyses with and without those zero-event trials. Adding them pulled the pooled effect closer to no effect, narrowed its confidence interval, and reduced differences between studies. For relative risk and odds ratios the shifts stayed small, even when such trials were most of the set. For risk difference the shifts grew large. They urge reviewers to include the trials whatever measure is used.

Catalog record

CREATORFriedrich JO, Adhikari NK, Beyene J.
YEAR2007
COLLECTIONPAPERS
FORMATTXT
FILE SIZE22 KB
LICENSECC BY 4.0
RIGHTSCC BY
SOURCEEurope PMC

Source: https://europepmc.org/articles/PMC1783664

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Inclusion of zero total event trials in meta-analyses maintains analytic consistency and incorporates all available data By Jan O Friedrich, Neill KJ Adhikari, Joseph Beyene Published in: BMC Medical Research Methodology DOI: 10.1186/1471-2288-7-5 ABSTRACT Background Meta-analysis handles randomized trials with no outcome events in both treatment and control arms inconsistently, including them when risk difference (RD) is the effect measure but excluding them when relative risk (RR) or odds ratio (OR) are used. This study examined the influence of such trials on pooled treatment effects. Methods Analysis with and without zero total event trials of three illustrative published meta-analyses with a range of proportions of zero total event trials, treatment effects, and heterogeneity using inverse variance weighting and random effects that incorporates between-study heterogeneity. Results Including zero total event trials in meta-analyses moves the pooled estimate of treatment effect closer to nil, decreases its confidence interval and decreases between-study heterogeneity. For RR and OR, inclusion of such trials causes small changes, even when they comprise the large majority of included trials. For RD, the changes are more substantial, and in extreme cases can eliminate a statistically significant effect estimate. Conclusion To include all relevant data regardless of effect measure chosen, reviewers should also include zero total event trials when calculating pooled estimates using OR and RR. BACKGROUND A meta-analysis of randomized controlled trials of a particular treatment quantitatively synthesizes all available trial data and provides the least biased estimate of that treatment's effect. Results from individual studies are statistically combined to provide a weighted average estimate of overall treatment effect. In one common weighting scheme known as the inverse variance method, the treatment effect from each study is weighted by the inverse of its variance. For binary outcomes, the pooled effect measure is usually expressed as either a difference of proportions (risk difference, RD), a ratio of proportions (relative risk, RR), or a ratio of the odds (odds ratio, OR) of intervention and control group patients experiencing an event. The variances of the effect measures for individual studies are determined by two parameters: the number of study subjects in each group, and the number of these subjects with outcome events. Standard meta-analytic procedures also produce an estimate of heterogeneity, which is the extent of variability in treatment effects of individual trials beyond what would be expected by chance. For example, I2 is one summary measure of heterogeneity and is the proportion of total variation among trials due to between-trial variation [1]. Using the inverse variance method of pooling studies, the weight of each study can be adjusted in the presence of significant heterogeneity by using the random-effects model [2]. In many studies of patients at low risk of developing the outcome that the intervention is designed to prevent, no subjects in either the intervention or the control group, or both, experience an outcome event. Meta-analyses using RR or OR as the effect measure traditionally include only studies with zero events in either the intervention or the control group, but not both. In contrast, meta-analyses using RD as the effect measure include studies with zero events in either or both groups [3,4]. The main argument for excluding zero total event trials (trials with zero events in both treatment and control arms) when the pooled effect measure is RR or OR is that they make no contribution to the magnitude of the treatment effect [5,6]. Although these trials do not contribute to producing a pooled treatment effect greater or less than nil, they do provide relevant data by showing that event rates for both the intervention and control groups are low and relatively equal [7]. Excluding such trial data potentially creates the risk of inflating the magnitude of the pooled treatment effect. Indeed, others have argued that zero total event trials should be included "to take into account the samples sizes of these studies" [8]. In addition, some published meta-analyses have included zero total event trials applying the standard continuity correction of 0.5 [9], which is commonly used for trials with zero events in only one arm [10,11]. Others have proposed different continuity corrections that perform better when the numbers of patients in the intervention and control groups are severely imbalanced [5]. The continuity correction is added to each cell of a 2 by 2 table for trials with zero events in one or both arms. When combining such trials using the inverse-variance method, continuity corrections are required to calculate individual trial effect estimates and variances (OR and RR) or to calculate individual trial variances (RD). Continuity corrections are less important or not required for other methods used for fixed effects analyses that do not incorporate between-study heterogeneity, such as Mantel-Haenszel methods and Peto OR [3-5]. Continuity corrections are also not required using Bayesian approaches that incorporate heterogeneity, although Bayesian methods require estimates of prior probabilities that are often based on subjective assessments and opinion [12]. Given these conflicting opinions and practices, the objective of this study was to examine, using illustrative examples, the influence of zero total event trials when the inverse variance method is used to pool RD, RR, and OR treatment effects. METHODS We selected 3 illustrative published meta-analyses that demonstrated a range of proportions of zero total event trials (among all trials with outcomes data), treatment effects, and heterogeneity [13-15]. For each binary effect measure, the meta-analysis was conducted including and excluding zero total event trials using the inverse variance random-effects model. For individual trials with no events in one or both groups, a continuity correction of 0.5 was added to each cell for each effect measure, as implemented in Review Manager 4.2 [4]. Calculations were carried out using standard equations and confirmed with Review Manager where possible. RESULTS For the meta-analysis of low-dose dopamine [13] (Figure 1), the proportion of zero total event trials is large (>70%). Given the absence of a significant treatment effect among trials with at least 1 event, the inclusion of the zero total event trials decreases the confidence intervals of the pooled effect estimates but not the estimates themselves. This decrease in confidence interval is greatest for RD. [Figure: Meta-analysis investigating the use of low-dose dopamine to prevent or treat renal dysfunction [13]. Endpoint: mortality (total of 109 events in 1523 patients in the intervention group and 105 events in 1454 patients in the control group). The first three horizontal bar charts show the proportion of trials, patients, and outcome events in the meta-analysis of all "Trials with No Zeros" (trials with at least one event in both the intervention and control arms), "Trials with One Zero" (trials with no events in either the intervention or the control arm), and "Trials with Two Zeros" (trials with no events in both the intervention and control arms). The next three pairs of bar charts show the total weighting of all trials with no zeros, one zero, and two zeros, respectively, in the final pooled RD, OR, and RR. The first bar in each pair refers to a meta-analysis that includes only trials with at least one event in either the intervention or the control arm ("Event trials"). The second bar includes both trials with and without events ("All trials"). For each effect measure, a

Read the complete text