Characteristics of meta-analyses and their component studies in the Cochrane Database of Systematic Reviews: a cross-sectional, descriptive analysis.

Davey J, Turner RM, Clarke MJ, Higgins JP. · 2011

Read Characteristics of meta-analyses and their component studies in the Cochrane Database of Systematic Reviews: a cross-sectional, descriptive analysis. by Davey J, Turner RM, Clarke MJ, Higgins JP. (2011) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/europmc-pmc3247075.txt.

Introduction

Jonathan Davey and colleagues took a census of the Cochrane Database of Systematic Reviews in this 2011 paper in BMC Medical Research Methodology. Cochrane reviews sum up trials of health interventions, and their contents reveal much about the state of health research. The team classified every meta-analysis in one issue of the database by specialty, intervention, and outcome type.

They counted more than twenty-three hundred reviews holding over twenty-two thousand meta-analyses, built from more than a hundred thousand individual studies. Pregnancy and childbirth, mental health, and respiratory disease were the best-covered areas, and most analyses compared drugs against placebo or another drug. The striking finding is how small the building blocks are: a typical meta-analysis rests on just three studies, and a typical study on under a hundred patients. The authors stress the need for methods that behave well with tiny datasets.

Catalog record

CREATORDavey J, Turner RM, Clarke MJ, Higgins JP.
YEAR2011
COLLECTIONPAPERS
FORMATTXT
FILE SIZE36 KB
LICENSECC BY 4.0
RIGHTSCC BY
SOURCEEurope PMC

Source: https://europepmc.org/articles/PMC3247075

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Characteristics of meta-analyses and their component studies in the Cochrane Database of Systematic Reviews: a cross-sectional, descriptive analysis By Jonathan Davey, Rebecca M Turner, Mike J Clarke, Julian PT Higgins Published in: BMC Medical Research Methodology DOI: 10.1186/1471-2288-11-160 ABSTRACT Abstract Background Cochrane systematic reviews collate and summarise studies of the effects of healthcare interventions. The characteristics of these reviews and the meta-analyses and individual studies they contain provide insights into the nature of healthcare research and important context for the development of relevant statistical and other methods. Methods We classified every meta-analysis with at least two studies in every review in the January 2008 issue of the Cochrane Database of Systematic Reviews (CDSR) according to the medical specialty, the types of interventions being compared and the type of outcome. We provide descriptive statistics for numbers of meta-analyses, numbers of component studies and sample sizes of component studies, broken down by these categories. Results We included 2321 reviews containing 22,453 meta-analyses, which themselves consist of data from 112,600 individual studies (which may appear in more than one meta-analysis). Meta-analyses in the areas of gynaecology, pregnancy and childbirth (21%), mental health (13%) and respiratory diseases (13%) are well represented in the CDSR. Most meta-analyses address drugs, either with a control or placebo group (37%) or in a comparison with another drug (25%). The median number of meta-analyses per review is six (inter-quartile range 3 to 12). The median number of studies included in the meta-analyses with at least two studies is three (inter-quartile range 2 to 6). Sample sizes of individual studies range from 2 to 1,242,071, with a median of 91 participants. Discussion It is clear that the numbers of studies eligible for meta-analyses are typically very small for all medical areas, outcomes and interventions covered by Cochrane reviews. This highlights the particular importance of suitable methods for the meta-analysis of small data sets. There was little variation in number of studies per meta-analysis across medical areas, across outcome data types or across types of interventions being compared. BACKGROUND Systematic reviews of randomized trials provide valuable evidence on the effectiveness of healthcare interventions, maximising power, minimising bias and avoiding undue emphasis on the results of individual studies. Many systematic reviews contain meta-analyses, in which the results from independent studies are formally combined using statistical methods. The Cochrane Database of Systematic Reviews (CDSR) is a major resource of systematic reviews on the effects of healthcare interventions that are periodically updated [1,2]. The reviews in the CDSR are prepared by members of The Cochrane Collaboration, which aims to make the findings from systematic reviews of interventions conveniently available so that healthcare consumers, professionals and providers can make choices about healthcare interventions using the most up-to-date and reliable evidence available on their relative effects [3]. The initiative is worldwide in its scope, involving input from more than 27,000 contributors in over 100 different countries, who work with the Cochrane Review Groups responsible for reviews in particular areas of health and health care [4]. As of 2011, more than 4,500 full Cochrane reviews have been produced and published protocols are available for nearly 2,000 more reviews that are at earlier stages in their development. The objective of this paper is to report descriptive statistics relating to one complete issue of the CDSR, published in January 2008. We have classified each meta-analysis in the CDSR by types of interventions, type of outcome and medical specialty. In further work, the classifications will allow us to examine empirically the magnitude and variation of among-study heterogeneity in meta-analyses, enabling us to understand how certain characteristics influence the level of between-study heterogeneity. In this paper, we have described our methods for collating this collection of more than 22,000 meta-analyses and reported statistics relating to the interventions, outcomes and medical areas investigated in these meta-analyses. We have summarised the sizes of reviews, meta-analyses and studies in the CDSR, and explored how these vary across different settings. A number of earlier papers have analysed large collections of systematic reviews and meta-analyses for other purposes. For example, Moher et al. [5] examined a cross-sectional sample of 300 systematic reviews (Cochrane and non-Cochrane) published in one month, and focused on their quality and reporting characteristics. A series of meta-epidemiological studies have analysed collections of meta-analyses in order to estimate the association between methodological flaws such as inadequate allocation concealment or inadequate blinding in randomised trials and exaggeration of the intervention effect; data from several of these studies were recently combined by Wood et al. [6]. Bow et al. [7] have described the characteristics of all Cochrane reviews relevant to child health, 1046 in total. To our knowledge, the characteristics of the entire Cochrane database have not previously been summarised, and the types of interventions and outcomes to which the meta-analyses within Cochrane reviews relate have not been examined in detail. METHODS The full content of the first issue from 2008 of the CDSR was provided to us by the Nordic Cochrane Centre. The highly structured nature of every Cochrane review allowed us to focus on the sections of each review covering 'Data and analyses', and on any pair-wise comparisons of interventions reported and the outcomes within these. Each outcome could contain several subgroups of studies, and each subgroup could contain data from several studies. This structure is illustrated in Figure 1. [Figure: Illustration of the hierarchy of a 'Data and analyses' section of a Cochrane review. Reproduced with permission from Chapter 4 of the Cochrane Handbook for Systematic Reviews of Interventions.] Eligibility criteria We were interested in all full reviews of the effects of health or social care interventions published in Issue 1, 2008 of the CDSR that reported at least one eligible meta-analysis (see below). We excluded protocols for reviews, reviews from the Cochrane Methodology Review Group, and reviews that had been marked as withdrawn. We defined an eligible meta-analysis as a forest plot that had been generated using the Review Manager (RevMan) software [8], and that included data from at least two different studies. We discarded forest plots with a single study, since a meta-analysis would not be performed on a single study, and because Cochrane review authors are often discouraged from including forest plots when there is only one study, meaning that any such forest plots published in Cochrane reviews would not be a representative sample. We included forest plots irrespective of whether review authors had elected to display the results of the meta-analysis within them. In some forest plots, the subgroups presented within an outcome were not mutually exclusive, since the same study data may be included in more than one subgroup. We therefore checked as far as possible for study duplications and extracted data for only the first occurrence of each study in each forest plot. The CDSR includes four types of data which systematic review authors have extracted from the included studies: binary data, continuous data, generic results and "O-E and variance" data. Binary data and continuous data have been entered directly into RevMan as numbers of events or means and standard deviations, together with numbers of participants in each intervention group in each study. Generic results have been entered as an effect estimate with corresponding standard error

Read the complete text