Metaprop: a Stata command to perform meta-analysis of binomial data.

Nyaga VN, Arbyn M, Aerts M. · 2014

Read Metaprop: a Stata command to perform meta-analysis of binomial data. by Nyaga VN, Arbyn M, Aerts M. (2014) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/europmc-pmc4373114.txt.

Introduction

Victoria Nyaga, Marc Arbyn, and Marc Aerts introduced a Stata command for pooling proportions, in Archives of Public Health in 2014. Meta-analysis combines results across studies, and many health questions need a pooled share, such as how common an infection is. The standard Stata pooling tool handles ratios and differences well, but proportions near zero or one hundred percent break its normal approximations, and studies at those edges were often dropped.

Their command, metaprop, uses methods built for count data, including exact intervals and a variance-stabilizing transform. They show it on two published cases: HPV infection in women with a borderline Pap result, pooled at 43 percent, and cure after treatment for cervical precancer, pooled at 94 percent. No edge studies had to be excluded, and all intervals stayed within valid bounds.

Catalog record

CREATORNyaga VN, Arbyn M, Aerts M.
YEAR2014
COLLECTIONPAPERS
FORMATTXT
FILE SIZE30 KB
LICENSECC BY 4.0
RIGHTSCC BY
SOURCEEurope PMC

Source: https://europepmc.org/articles/PMC4373114

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Metaprop: a Stata command to perform meta-analysis of binomial data By Victoria N Nyaga, Marc Arbyn, Marc Aerts Published in: Archives of Public Health DOI: 10.1186/2049-3258-72-39 ABSTRACT Background Meta-analyses have become an essential tool in synthesizing evidence on clinical and epidemiological questions derived from a multitude of similar studies assessing the particular issue. Appropriate and accessible statistical software is needed to produce the summary statistic of interest. Methods Metaprop is a statistical program implemented to perform meta-analyses of proportions in Stata. It builds further on the existing Stata procedure metan which is typically used to pool effects (risk ratios, odds ratios, differences of risks or means) but which is also used to pool proportions. Metaprop implements procedures which are specific to binomial data and allows computation of exact binomial and score test-based confidence intervals. It provides appropriate methods for dealing with proportions close to or at the margins where the normal approximation procedures often break down, by use of the binomial distribution to model the within-study variability or by allowing Freeman-Tukey double arcsine transformation to stabilize the variances. Metaprop was applied on two published meta-analyses: 1) prevalence of HPV-infection in women with a Pap smear showing ASC-US; 2) cure rate after treatment for cervical precancer using cold coagulation. Results The first meta-analysis showed a pooled HPV-prevalence of 43% (95% CI: 38%-48%). In the second meta-analysis, the pooled percentage of cured women was 94% (95% CI: 86%-97%). Conclusion By using metaprop, no studies with 0% or 100% proportions were excluded from the meta-analysis. Furthermore, study specific and pooled confidence intervals always were within admissible values, contrary to the original publication, where metan was used. Electronic supplementary material The online version of this article (doi:10.1186/2049-3258-72-39) contains supplementary material, which is available to authorized users. BACKGROUND Meta-analyses combine information from multiple studies in order to derive an average estimate. Different meta-analysis procedures exist depending on the statistic to be reported. Examples of statistics of interest include association measures such as risk difference, risk ratio, odds ratio, difference in means, or simply one-dimensional binomial or continuous measures such as proportions or means. There are three important aspects in meta-analysis: a) the analysis framework, b) the model and c) the choice of the method to estimate the heterogeneity parameter. These aspects interact with each other. A meta-analyst has a choice between the fixed- and random-effects model. In the fixed-effects model, it is assumed that the parameter of interest is identical across studies and the difference between the observed proportion and the mean is only due to sampling error. In the random-effects model, the observed difference between the proportions and the mean cannot be entirely attributed to sampling error and other factors such as differences in study population, study designs, etc. could also contribute. Each study estimates a different parameter, and the pooled estimate describes the mean of the distribution of the estimated parameters. The variance parameter describes the heterogeneity among the studies and in the case where the variance is zero, this model simply reduces to the fixed-effects model. There are three frameworks in modeling of binomial data. The most popular framework uses approximation to the normal distribution by use of transformations and is known as the approximate likelihood approach [1, 2]. Some of the common transformations include the logit and the arcsine [3]. Some of the reasons why this approach is popular include lower level of required statistical expertise, faster computations and availability of software to carry out the analysis. The second approach recognises the true nature of the data and is known as the exact likelihood approach. In this framework, the special relationship between the mean and the variance as characterised by binomial data is captured by the binomial distribution [4]. The beta-binomial distribution [5] can be used to fit a random-effects model such that the beta distribution describes the distribution of the varying binomial parameters. While it is possible to perform computations to estimate the parameters of the binomial model, most common statistical software lacks function to fit the beta-binomial model and therefore, this approach is the least popular. The WinBUGS software, a software package for Bayesian statistics, has the capability to perform such analyses. Other software e.g R and SAS (PROC NLMIXED) can also be used, but extensive programming is required. The third approach is a compromise between approximate and exact likelihood. In the first stage, the data is modeled using the binomial distribution. In the second stage, the normal distribution is used after the logit transformation to model the heterogeneity among the studies. This is an emerging approach and is often recommended by statisticians [4]. Most statistical software including Stata(melogit), R, SAS (PROC NLMIXED) have the capability to perform such analyses. There are three popular methods to estimate the parameters. The non-iterative method popularised byDersimonian and Laird [6]. The other two methods are the maximum likelihood (ML) and restricted maximum likelihood (REML) method. For random-effects model, the REML method is preferred because ML leads to underestimation of the variance parameter. For generalized linear mixed models [2, 7, 8] under which models for binomial data falls, the REML method is not used due to intensive computation of high-dimension integrations of the random-effects and as a result most software estimate the heterogeneity parameter using ML methods. The procedure proposed by Dersimonian and Laird is efficient for the mean but not the heterogeneity parameter [9]. Various procedures to perform meta-analysis have been implemented in the Stata command metan[10]. In metan, the confidence intervals are calculated using the normal distribution based on the asymptotic variance. For proportions such intervals may contain inadmissible values especially when the statistic is near the boundary. Furthermore, computation of confidence intervals is not possible when the statistic is on the boundary, as the estimated standard error is set to zero and as a consequence, the metan command automatically excludes studies with proportion equal to 0 or 1 from the calculation of the pooled estimate. Tests of significance on the pooled proportion typically rely on normal probabilities. Proportions (p=rn) are binomial and the normal distribution is a good approximation of the binomial distribution if n is large enough and p is not close to the margins [11]. When n is small and/or p is near the margins, the test statistic may not be approximately normally distributed due to its skewness and discreteness. To make the normal distribution assumptions more applicable to significance testing, several transformations have been suggested. Freeman and Tukey [12] presented a double arcsine transformation to stabilize the variance. We have developed metaprop, a new program in Stata to perform meta-analyses of binomial data to supplement the metan command, which is typically used to pool associations. metaprop builds further on the metan procedure. It allows computation of 95% confidence intervals using the score statistic and the exact binomial method and incorporates the Freeman-Tukey double arcsine transformation of proportions. The program also allows the within-study variability be modelled using the binomial distribution. This article presents a general overview of the program to serve as a starting point for users interested in performing meta-analysis of proportions in Stata software. METHODS A detailed description of various statistical procedures to perform meta-analysis which can be performed with metan can be found elsewhere

Read the complete text