Estimating the mean and variance from the median, range, and the size of a sample.
Hozo SP, Djulbegovic B, Hozo I. · 2005
Read Estimating the mean and variance from the median, range, and the size of a sample. by Hozo SP, Djulbegovic B, Hozo I. (2005) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/europmc-pmc1097734.txt.
Introduction
Hozo, Djulbegovic, and Hozo solve a common stats headache for reviewers of trials in this 2005 paper. Meta-analysis pools results from many trials to judge a treatment. It needs each trial's mean and spread, yet some trials report only the middle value, the lowest and highest values, and the group size. The authors set out to recover the missing figures from those scraps.
Using simple maths bounds, they built two formulas that estimate the mean from the middle value, range ends, and group size. Computer simulations tested the formulas at varied group sizes. For groups over 25, the middle value alone estimates the mean well, they found. For smaller groups their new formula does better. They also give rules for spread: one range-based rule wins for groups up to 70, another for larger ones.
Catalog record
| CREATOR | Hozo SP, Djulbegovic B, Hozo I. |
|---|---|
| YEAR | 2005 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 28 KB |
| LICENSE | CC BY 4.0 |
| RIGHTS | CC BY |
| SOURCE | Europe PMC |
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Estimating the mean and variance from the median, range, and the size of a sample By Stela Pudar Hozo, Benjamin Djulbegovic, Iztok Hozo Published in: BMC Medical Research Methodology DOI: 10.1186/1471-2288-5-13 ABSTRACT Abstract Background Usually the researchers performing meta-analysis of continuous outcomes from clinical trials need their mean value and the variance (or standard deviation) in order to pool data. However, sometimes the published reports of clinical trials only report the median, range and the size of the trial. Methods In this article we use simple and elementary inequalities and approximations in order to estimate the mean and the variance for such trials. Our estimation is distribution-free, i.e., it makes no assumption on the distribution of the underlying data. Results We found two simple formulas that estimate the mean using the values of the median (m), low and high end of the range (a and b, respectively), and n (the sample size). Using simulations, we show that median can be used to estimate mean when the sample size is larger than 25. For smaller samples our new formula, devised in this paper, should be used. We also estimated the variance of an unknown sample using the median, low and high end of the range, and the sample size. Our estimate is performing as the best estimate in our simulations for very small samples (n ≤ 15). For moderately sized samples (15 <n ≤ 70), our simulations show that the formula range/4 is the best estimator for the standard deviation (variance). For large samples (n > 70), the formula range/6 gives the best estimator for the standard deviation (variance). We also include an illustrative example of the potential value of our method using reports from the Cochrane review on the role of erythropoietin in anemia due to malignancy. Conclusion Using these formulas, we hope to help meta-analysts use clinical trials in their analysis even when not all of the information is available and/or reported. BACKGROUND To perform meta-analysis of continuous data, the meta-analysts need the mean value and the variance (or standard deviation) in order to pool data. However, sometimes, the published reports of clinical trials only report the median, range and the size of the trial. In this article we use simple and elementary inequalities in order to estimate the mean and the variance for such trials. Our estimation is distribution-free, i.e., it makes no assumption on the distribution of the underlying data. In fact, the value of our approximation(s) is in giving a method for estimating the mean and the variance exactly when there is no indication of the underlying distribution of the data. In current practice, the median is often substituted for the mean, and the Range/4 or Range/6 for the standard deviation. However, it has not been shown that median can indeed be used to replace mean values, nor when the range-formulas are appropriate. METHODS Assumptions Suppose a clinical trial reports the following summary measures for a certain event: m = Median a = The smallest value (minimum) b = The largest value (maximum) n = The size of the sample. In this article, we want to estimate the mean, and the standard deviation of this sample of size n. First we will order this sample by size: a = x1 ≤ x2 ≤ x3 ≤ … xM-1 ≤ xM = m ≤ xM+1 ≤ … ≤ xn-1 ≤ xn = b, where the Mth number is the median, and (for the sake of simplicity, we will assume that n is an odd number). RESULTS Estimating the sample mean We begin with several simple inequalities: Adding up and diving by n, the middle column is exactly the sample mean, . Adding up and diving by n for all three columns, we get the following inequality: After replacing into the inequality above, we get: Therefore, the lower bound for the sample mean is The upper bound for the sample mean is The sample mean can than be estimated as , or When the size of the sample is fairly large, the second fraction becomes negligible and the estimate can be written in a simplified form: We can use this simple expression even if we do not know the size of the sample. The length of the interval which contains the sample mean (the interval [LB, UB]), is approximately Estimating the sample variance Even when the only information we have about a set of data is it's range: R = b - a, we can still estimate the standard deviation. If our data are normally distributed, then P[-2σ <X - μ < 2σ] = 0.95, and therefore, the range covers approximately 4σ, i.e., . When the data we are dealing with are not normally distributed, we can still use the Chebyshev's inequality [1,2], and obtain the following for k = 3: . Therefore, the range covers approximately 6σ, i.e., . On the other hand, if the summary results for a clinical trial include the median and the size of the sample, we can presumably do better than the two range approximations above. Next section deals with that situation. The Variance S2 – distribution free inequalities Using the inequalities (1) and taking in consideration that all the data are non-negative, we can multiply each row i with the value xi (i = 1, 2, 3, ..., n). We obtain the following inequalities: Adding up by columns, we have the following: Using the inequalities (1) again, we estimate the sums in LB and UB as Therefore, the expressions in (7) can be estimated as The sum of squares can be therefore estimated as The sample variance can be evaluated from the computational formula We can estimate using (10) and using (4). Therefore, after simplifying: Note that if we let n grow without bound, the expression (12) becomes the well-known range formula . The Variance S2 – equidistantly spaced data The formula (4) can also be obtained by dividing the range [a, b] into two parts: [a, m), and [m, b]. We then subdivide each of these two parts into subintervals using equally spaced partition points. In other words, we are estimating each of the data points (except for a, m, and b) with uniformly spaced approximate points: and Therefore our sample is approximately given as a = x1 ≤ x2 ≤ x3 ≤ … ≤ xM-1 ≤ y1 = m ≤ y2 ≤ … ≤ yM-1 ≤ yM = b. We can use this partition to estimate the sample variance (and standard deviation, S). After a little algebra, the sample variance can be estimated by If we let the number of estimation points increase without bounds, i.e., assume that n in the expression (15) is very large, we obtain a simplified version of the expression above: DISCUSSION Analysis and performance of estimates In order to verify the accuracy of these estimates, we ran several simulations using the computer package Maple where the data were variously distributed, and obtained the tables below. We drew samples from five different distributions, Normal, Log-normal, Beta, Exponential and Weibull. The size of the sample ranged from 8 to about 100. In the first subsection we present the results of our estimation for a normal distribution, which