Estimating the sample mean and standard deviation from the sample size, median, range and/or interquartile range.
Wan X, Wang W, Liu J, Tong T. · 2014
Read Estimating the sample mean and standard deviation from the sample size, median, range and/or interquartile range. by Wan X, Wang W, Liu J, Tong T. (2014) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/europmc-pmc4383202.txt.
Introduction
Xiang Wan, Wenqian Wang, Jiming Liu, and Tiejun Tong tackled a common statistics headache in BMC Medical Research Methodology in 2014. Meta-analyses pool the means and standard deviations of many trials, but some trials report only the median, the range, or the quartiles instead. Analysts must estimate the missing values before pooling. The widely used older method for the standard deviation, the authors show, has serious limits and always performs poorly in practice.
Their new method folds sample size into the estimate. Across simulations for three common reporting patterns, it greatly improved accuracy, giving nearly unbiased standard deviations for normal data and only slight bias for skewed data. With the middle-quartile range also available, it still performed very well. The paper closes by comparing the estimators across all patterns, giving analysts a clear pick for each case.
Catalog record
| CREATOR | Wan X, Wang W, Liu J, Tong T. |
|---|---|
| YEAR | 2014 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 37 KB |
| LICENSE | CC BY 4.0 |
| RIGHTS | CC BY |
| SOURCE | Europe PMC |
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Estimating the sample mean and standard deviation from the sample size, median, range and/or interquartile range By Xiang Wan, Wenqian Wang, Jiming Liu, Tiejun Tong Published in: BMC Medical Research Methodology DOI: 10.1186/1471-2288-14-135 ABSTRACT Abstract Background In systematic reviews and meta-analysis, researchers often pool the results of the sample mean and standard deviation from a set of similar clinical trials. A number of the trials, however, reported the study using the median, the minimum and maximum values, and/or the first and third quartiles. Hence, in order to combine results, one may have to estimate the sample mean and standard deviation for such trials. Methods In this paper, we propose to improve the existing literature in several directions. First, we show that the sample standard deviation estimation in Hozo et al.’s method (BMC Med Res Methodol 5:13, 2005) has some serious limitations and is always less satisfactory in practice. Inspired by this, we propose a new estimation method by incorporating the sample size. Second, we systematically study the sample mean and standard deviation estimation problem under several other interesting settings where the interquartile range is also available for the trials. Results We demonstrate the performance of the proposed methods through simulation studies for the three frequently encountered scenarios, respectively. For the first two scenarios, our method greatly improves existing methods and provides a nearly unbiased estimate of the true sample standard deviation for normal data and a slightly biased estimate for skewed data. For the third scenario, our method still performs very well for both normal data and skewed data. Furthermore, we compare the estimators of the sample mean and standard deviation under all three scenarios and present some suggestions on which scenario is preferred in real-world applications. Conclusions In this paper, we discuss different approximation methods in the estimation of the sample mean and standard deviation and propose some new estimation methods to improve the existing literature. We conclude our work with a summary table (an Excel spread sheet including all formulas) that serves as a comprehensive guidance for performing meta-analysis in different situations. Electronic supplementary material The online version of this article (doi:10.1186/1471-2288-14-135) contains supplementary material, which is available to authorized users. Keywords: Interquartile range, Median, Meta-analysis, Sample mean, Sample size, Standard deviation BACKGROUND In medical research, it is common to find that several similar trials are conducted to verify the clinical effectiveness of a certain treatment. While individual trial study could fail to show a statistically significant treatment effect, systematic reviews and meta-analysis of combined results might reveal the potential benefits of treatment. For instance, Antman et al. [1] pointed out that systematic reviews and meta-analysis of randomized control trials would have led to earlier recognition of the benefits of thrombolytic therapy for myocardial infarction and may save a large number of patients. Prior to the 1990s, the traditional approach to combining results from multiple trials is to conduct narrative (unsystematic) reviews, which are mainly based on the experience and subjectivity of experts in the area [2]. However, this approach suffers from many critical flaws. The major one is due to inconsistent criteria of different reviewers. To claim a treatment effect, different reviewers may use different thresholds, which often lead to opposite conclusions from the same study. Hence, from the mid-1980s, systematic reviews and meta-analysis have become an imperative tool in medical effectiveness measurement. Systematic reviews use specific and explicit criteria to identify and assemble related studies and usually provide a quantitative (statistic) estimate of aggregate effect over all the included studies. The methodology in systematic reviews is usually referred to as meta-analysis. With the combination of several studies and more data taken into consideration in systematic reviews, the accuracy of estimations will get improved and more precise interpretations towards the treatment effect can be achieved via meta-analysis. In meta-analysis of continuous outcomes, the sample size, mean, and standard deviation are required from included studies. This, however, can be difficult because results from different studies are often presented in different and non-consistent forms. Specifically in medical research, instead of reporting the sample mean and standard deviation of the trials, some trial studies only report the median, the minimum and maximum values, and/or the first and third quartiles. Therefore, we need to estimate the sample mean and standard deviation from these quantities so that we can pool results in a consistent format. Hozo et al. [3] were the first to address this estimation problem. They proposed a simple method for estimating the sample mean and the sample variance (or equivalently the sample standard deviation) from the median, range, and the size of the sample. Their method is now widely accepted in the literature of systematic reviews and meta-analysis. For instance, a search of Google Scholar on November 12, 2014 showed that the article of Hozo et al.’s method has been cited 722 times where 426 citations are made recently in 2013 and 2014. In this paper, we will show that the estimation of the sample standard deviation in Hozo et al.’s method has some serious limitations. In particular, their estimator did not incorporate the information of the sample size and so consequently, it is always less satisfactory in practice. Inspired by this, we propose a new estimation method that will greatly improve their method. In addition, we will investigate the estimation problem under several other interesting settings where the first and third quartiles are also available for the trials. Throughout the paper, we define the following summary statistics: a= the minimum value, q1= the first quartile, m= the median, q3= the third quartile, b= the maximum value, n= the sample size. The {a,q1,m,q3,b} is often referred to as the 5-number summary [4]. Note that the 5-number summary may not always be given in full. The three frequently encountered scenarios are: Hozo et al.’s method only addressed the estimation of the sample mean and variance under Scenario while Scenarios and are also common in systematic review and meta-analysis. In Sections 'Methods’ and 'Results’, we study the estimation problem under these three scenarios, respectively. Simulation studies are conducted in each scenario to demonstrate the superiority of the proposed methods. We conclude the paper in Section 'Discussion’ with some discussions and a summary table to provide a comprehensive guidance for performing meta-analysis in different situations. METHODS Estimating and Sfrom Scenario assumes that the median, the minimum, the maximum and the sample size are given for a clinical trial study. This is the same assumption as made in Hozo et al.’s method. To estimate the sample mean and standard deviation, we first review the Hozo et al.’s method and point out some limitations of their method in estimating the sample standard deviation. We then propose to improve their estimation by incorporating the information of the sample size. Throughout the paper, we let X1,X2,…,Xn be a random sample of size n from the normal distribution N(μ,σ2), and X(1)≤X(2)≤⋯≤X(n) be the ordered statistics of X1,X2,⋯,Xn. Also for the sake of simplicity, we assume that n=4Q + 1 with Q being a positive integer. Then [formula: 1] In this section, we are interested in estimating the sample mean and the sample standard deviation , given that a,m,b, and n of the data are known. Hozo et