Evidence summaries: the evolution of a rapid review approach.
Khangura S, Konnyu K, Cushman R, Grimshaw J, Moher D. · 2012
Read Evidence summaries: the evolution of a rapid review approach. by Khangura S, Konnyu K, Cushman R, Grimshaw J, Moher D. (2012) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/europmc-pmc3351736.txt.
Introduction
Khangura and her team described how their Knowledge to Action research programme produced quick evidence summaries for health decision makers. Managers often need synthesised research faster than a full systematic review allows, so the group formalised a rapid review product and reported their experience openly.
Their eight-step approach was refined through feedback from the managers who requested the summaries. Between November 2009 and March 2011 the team delivered eleven summaries spanning clinical effectiveness and health system questions. Users judged them timely and valuable for decisions. The authors argue that rapid products can stay trustworthy if their shortcuts are transparent and systematically reported.
Catalog record
| CREATOR | Khangura S, Konnyu K, Cushman R, Grimshaw J, Moher D. |
|---|---|
| YEAR | 2012 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 35 KB |
| LICENSE | CC BY 4.0 |
| RIGHTS | CC BY |
| SOURCE | Europe PMC |
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Evidence summaries: the evolution of a rapid review approach By Sara Khangura, Kristin Konnyu, Rob Cushman, Jeremy Grimshaw, David Moher Published in: Systematic Reviews DOI: 10.1186/2046-4053-1-10 ABSTRACT Background Rapid reviews have emerged as a streamlined approach to synthesizing evidence - typically for informing emergent decisions faced by decision makers in health care settings. Although there is growing use of rapid review 'methods', and proliferation of rapid review products, there is a dearth of published literature on rapid review methodology. This paper outlines our experience with rapidly producing, publishing and disseminating evidence summaries in the context of our Knowledge to Action (KTA) research program. Methods The KTA research program is a two-year project designed to develop and assess the impact of a regional knowledge infrastructure that supports evidence-informed decision making by regional managers and stakeholders. As part of this program, we have developed evidence summaries - our form of rapid review - which have come to be a flagship component of this project. Our eight-step approach for producing evidence summaries has been developed iteratively, based on evidence (where available), experience and knowledge user feedback. The aim of our evidence summary approach is to deliver quality evidence that is both timely and user-friendly. Results From November 2009 to March 2011 we have produced 11 evidence summaries on a diverse range of questions identified by our knowledge users. Topic areas have included questions of clinical effectiveness to questions on health systems and/or health services. Knowledge users have reported evidence summaries to be of high value in informing their decisions and initiatives. We continue to experiment with incorporating more of the established methods of systematic reviews, while maintaining our capacity to deliver a final product in a timely manner. Conclusions The evolution of the KTA rapid review evidence summaries has been a positive one. We have developed an approach that appears to be addressing a need by knowledge users for timely, user-friendly, and trustworthy evidence and have transparently reported these methods here for the wider rapid review and scientific community. BACKGROUND Rapid reviews have emerged as a streamlined approach to synthesizing evidence in a timely manner -typically for the purpose of informing emergent decisions faced by decision makers in health care settings. Although there appears to be a growing use of rapid review 'methods', and a proliferation of rapid review products, there is a dearth of published literature on rapid review methodology. With limited transparency, it is impossible to determine the validity, appropriateness and, ultimately, the utility of these products. To address the gap, this paper outlines our experience with rapidly producing, publishing and disseminating evidence summaries in the context of our Knowledge to Action (KTA) research program to date. The KTA research program is a two-year project designed to develop and assess the impact of a regional knowledge infrastructure that supports evidence-informed decision making by regional managers and stakeholders. It is a collaborative effort between researchers with expertise in knowledge synthesis and knowledge translation based at the Ottawa Hospital Research Institute (OHRI), and knowledge users involved in decision making around health service delivery based at the Champlain Local Health Integration Network (LHIN) - a regional health authority in Ontario, Canada. As part of the knowledge intelligence services that comprise the knowledge infrastructure, we have developed 'evidence summaries', our form of rapid review, which have come to be a flagship component of this project. According to the Cochrane handbook, a traditional systematic review is a review that "attempts to collate all empirical evidence that fits pre-specified eligibility criteria in order to answer a specific research question. It uses explicit, systematic methods that are selected with a view to minimizing bias, thus providing more reliable findings from which conclusions can be drawn and decisions made" [1]. While systematic reviews are considered to be the gold standard in knowledge synthesis, they are not without their limitations. For example, they usually require between 6 months and 2 years to complete and often focus on a narrow clinical question or set of questions (see Table 1 for a comparison of rapid review versus systematic review). Policymakers, decision makers, stakeholders and other knowledge users, however, often require access to contextualized resources that succinctly and methodically address a broader scope of scientific evidence quickly [2]. Rapid review is an emerging methodology (or possible set of methodologies) within the broader knowledge syntheses repertoire that has evolved to address this need. A growing number of organizations, across various jurisdictions and countries, appear to be experimenting with this approach [3]. [Table: General comparison of rapid review versus systematic review approaches a] Despite the increasing production and use of rapid review products, its methodology remains underdeveloped. In fact, there is no universally accepted definition of what constitutes a rapid review. Given their potential deficits in the absence of an approved methodology, many experts have questioned the validity of rapid reviews [3,4]. Given this lack of definition and evolving landscape, we have abstained from applying the label 'rapid review' to our KTA syntheses, and have alternatively called them 'evidence summaries'. Despite this, we consider our evidence summaries to be part of the continuum of rapid reviews, as conceptualized by Ganann and colleagues [3] and thus, in developing our evidence summary methods, we aim to advance to the understanding of rapid reviews as a whole. General approach The KTA evidence summary was conceived as an overview of the available evidence addressing a research question or set of research questions related to a single topic (an area of need and priority identified by knowledge users of the Champlain LHIN) produced within a short timeframe (four to five weeks). Because they were developed under the auspices of the KTA research program, and therefore as a means to facilitate collaboration between researchers of the OHRI and knowledge users of the Champlain LHIN, the first several evidence summaries were developed in the absence of a specific methodology; rather, their production was informed by a general intent to consult and synthesize a broad range of quality evidence quickly. Following positive responses to early evidence summaries and the progressive development of a collaborative relationship between the OHRI and Champlain LHIN, considerable effort had been invested toward the advancement of their methods. For example, we have continued to experiment with incorporating more of the established methods of systematic reviews, while maintaining our capacity to deliver a final product in a timely manner. We have also experimented with various user-friendly formats, reporting styles and document lengths to increase usability. Usability has been an oft-neglected component in traditional systematic reviews despite evidence that has shown its capacity to improve the quality and cost effectiveness of health care [5,6]. Potential uses of an evidence summary may include the following: • to serve as an informative brief that prepares stakeholders for discussion on a policy issue; • to support the direction and evidence-base for various health policy initiatives; • to support the development of clinical interventions and/or health services programs. From November 2009 to March 2011 we have produced 11 evidence summaries. Our eight-step approach for producing evidence summaries has been developed iteratively; it is outlined in Table 2 and described below. [Table: Outline of eight steps informing Knowledge to Action evidence summary approach] EVIDENCE SUMMARY METHODS