Living systematic reviews: an emerging opportunity to narrow the evidence-practice gap.
Elliott JH, Turner T, Clavisi O, Thomas J, Higgins JP, Mavergames C, Gruen RL. · 2014
Read Living systematic reviews: an emerging opportunity to narrow the evidence-practice gap. by Elliott JH, Turner T, Clavisi O, Thomas J, Higgins JP, Mavergames C, Gruen RL. (2014) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/europmc-pmc3928029.txt.
Introduction
Julian H. Elliott and colleagues argue in PLoS Medicine in 2014 that systematic reviews of medical evidence should be kept alive rather than published once and left to age. A review can go stale fast as new trials appear, and stale reviews mislead doctors and policymakers. Small improvements to the usual updating process, the authors say, will not fix that currency problem.
Their proposal, the living systematic review, is a high-quality online summary that is revised as soon as new research arrives. It depends on faster production methods and on shared standards for publishing updates. Paired with better reporting of new trials and better use of evidence in health systems, living reviews aim to narrow the gap between what research shows and what care actually does.
Catalog record
| CREATOR | Elliott JH, Turner T, Clavisi O, Thomas J, Higgins JP, Mavergames C, Gruen RL. |
|---|---|
| YEAR | 2014 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 26 KB |
| LICENSE | CC BY 4.0 |
| RIGHTS | CC BY |
| SOURCE | Europe PMC |
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Living Systematic Reviews: An Emerging Opportunity to Narrow the Evidence-Practice Gap By Julian H Elliott, Tari Turner, Ornella Clavisi, James Thomas, Julian P T Higgins, Chris Mavergames, Russell L Gruen Published in: PLoS Medicine DOI: 10.1371/journal.pmed.1001603 ABSTRACT Abstract Julian Elliott and colleagues discuss how the current inability to keep systematic reviews up-to-date hampers the translation of knowledge into action. They propose living systematic reviews as a contribution to evidence synthesis to enhance the accuracy and utility of health evidence. SummaryThe current difficulties in keeping systematic reviews up to date leads to considerable inaccuracy, hampering the translation of knowledge into action.Incremental advances in conventional review updating are unlikely to lead to substantial improvements in review currency. A new approach is needed.We propose living systematic review as a contribution to evidence synthesis that combines currency with rigour to enhance the accuracy and utility of health evidence.Living systematic reviews are high quality, up-to-date online summaries of health research, updated as new research becomes available, and enabled by improved production efficiency and adherence to the norms of scholarly communication.Together with innovations in primary research reporting and the creation and use of evidence in health systems, living systematic review contributes to an emerging evidence ecosystem. THE BRIDGE FROM EVIDENCE TO PRACTICE Health research promises societal benefit by making better health possible. However, there has always been a gap between research findings (what is known) and health care practice (what is done), described as the “evidence-practice” or “know-do” gap [1]. The reasons for this gap are complex [2], but it is clear that synthesising the complex, incomplete, and at times conflicting findings of biomedical research into forms that can readily inform health decision making is an essential component of the bridge from “knowing” to “doing.” Systematic reviews (SRs) and meta-analyses have provided incalculable benefit for human health by contributing to the bridge from knowing to doing, but this benefit is limited by characteristics of the current SR enterprise [3]. The methods of SR and meta-analysis are well developed [3]–[5], but less progress has been achieved with the other essential component of accuracy—currency. The time from the date of the last search to SR publication is commonly over a year [6], and in an analysis of the time taken for primary study results to be incorporated into an SR, the median time from primary study publication to SR publication ranged from 2.5 to 6.5 years (Figure 1) [7]. Once published, only a minority of reviews are updated within 2 years of publication [8], and this inability to maintain currency leads to significant inaccuracy. By 2 years post-publication 23% of SRs that have not been updated will have failed to incorporate new evidence that would substantively change conclusions about the effectiveness or harms of therapies [9]. [Figure: Time from primary study publication to incorporation in systematic review.Analysis of 792 study reports incorporated into 73 systematic reviews across 28 high priority topics in the field of neurotrauma. Study reports were included in the analysis if they were incorporated into a systematic review relevant to one of the high priority topics and published in the period 2001–2009. Systematic reviews were included in the analysis if they were relevant to one of the high priority topics and published in the period 2001–2012. Bars represent medians and interquartile range.] Current approaches to updating SRs focus on detecting SRs most in need of updating [10],[11]. While these methods contribute to the currency of SRs, they cannot adequately reduce the inaccuracy caused by out-of-date SRs. It is often difficult to assemble an authorship team to complete prioritised updates; publication of updates takes many months, during which time the SR remains out of date and therefore potentially inaccurate; and many SRs are not designated as high priority and therefore remain out of date and inaccurate. Despite the availability of these methods and the concerted efforts of many individuals, much of the global corpus of SRs remains out of date. Incremental advances in traditional SR updating is unlikely to lead to substantial and sustained improvements in the currency of SRs in the context of exponential growth in primary research and SRs [12]. In order to address this considerable source of SR inaccuracy, and produce evidence summaries that are both methodologically rigorous and up to date, a new approach is needed. This innovation has previously been unachievable because rigorous reviews are demanding of time and resources, and “up to date” required rapid processes, which limited the feasibility of rigorous methods. New technologies create the opportunity to resolve this trade-off and enable answers to health questions that are both methodologically rigorous and up to date. We have named this new approach to the updating of SR “living systematic review.” Our aim in proposing this approach is to address the challenges facing contemporary evidence synthesis, while retaining the strengths of SR that have been a critical underpinning of knowledge for health over the last quarter century. This approach to SR adds to rather than replaces existing methods and is particularly relevant for reviews of controlled trials in fast moving topic areas. LIVING SYSTEMATIC REVIEWS Living systematic reviews are high quality, up-to-date online summaries of health research that are updated as new research becomes available, consistent with the vision of the pioneering Oxford Database of Perinatal Trials to “include a library of trial overviews, which will be updated when new data become available” [13]. There are four fundamental differences between conventional SR and living systematic review: publication format, work processes, author team management, and statistical methods. The essential difference between living systematic review and conventional SR is the publication format. Instead of a conventional static SR report or update, living systematic reviews are dynamic, persistent, online-only evidence summaries, which are updated rapidly and frequently. The corollary of a living publication is three changes to SR production. First, work processes must be adapted. A literature search strategy is maintained and outputs fed continuously into an SR workflow, including continuous updating of identified studies, assessment of study quality, data extraction, meta-analysis, and SR report. Instead of the intense, sporadic effort of conventional SRs and SR updates, living systematic review requires moderate, ongoing contribution. Second, author team management must be responsive to a continuous workflow, coordinating effort over long periods of time and allowing evolution in the author team, while maintaining institutional memory. Third, updating meta-analyses entails a reanalysis of data and, as with repeated analysis of accumulating primary trial data, an inflated rate of false-positive findings is likely if statistical tests are repeated naively [14]. Also, effect size estimates can be unstable, especially in the early stages of evidence generation [15]. These issues are relevant to all updates to meta-analyses, but are particularly important for living systematic reviews given the potential frequency of updates. Statistical monitoring of meta-analyses using formal sequential methods can control the risk of spurious findings, while achieving pre-specified power to identify a pre-specified clinically relevant magnitude of effect [16],[17]. Sequential methods are controversial in meta-analysis since they are based on testing rather than estimation, and an estimate that is widely disseminated on the basis of a significance test result may be biased. As an alternative, a Bayesian approach provides a natural framework for monitoring accumulating evidence in which