Applying GRADE-CERQual to qualitative evidence synthesis findings: introduction to the series.
Lewin S, Booth A, Glenton C, Munthe-Kaas H, Rashidian A, Wainwright M, Bohren MA, Tunçalp Ö, Colvin CJ, Garside R, Carlsen B, Langlois EV, Noyes J. · 2018
Read Applying GRADE-CERQual to qualitative evidence synthesis findings: introduction to the series. by Lewin S, Booth A, Glenton C, Munthe-Kaas H, Rashidian A, Wainwright M, Bohren MA, Tunçalp Ö, Colvin CJ, Garside R, Carlsen B, Langlois EV, Noyes J. (2018) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/europmc-pmc5791040.txt.
Introduction
Lewin and co-authors introduce GRADE-CERQual, a method for judging trust in qualitative review findings. Decision makers increasingly lean on reviews of interview and observation studies. CERQual asks whether a finding fairly represents the topic it claims to cover. The approach was built to support guidelines and policy.
Four parts drive the judgment: method limits, coherence, data adequacy, and relevance. A fifth part, spread bias, is under study. Findings are summed in short tables that show each rating. This paper opens a seven part series. Later papers treat each part and the overall rating in depth.
Catalog record
| CREATOR | Lewin S, Booth A, Glenton C, Munthe-Kaas H, Rashidian A, Wainwright M, Bohren MA, Tunçalp Ö, Colvin CJ, Garside R, Carlsen B, Langlois EV, Noyes J. |
|---|---|
| YEAR | 2018 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 50 KB |
| LICENSE | CC BY 4.0 |
| RIGHTS | CC BY |
| SOURCE | Europe PMC |
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Applying GRADE-CERQual to qualitative evidence synthesis findings: introduction to the series By Simon Lewin, Andrew Booth, Claire Glenton, Heather Munthe-Kaas, Arash Rashidian, Megan Wainwright, Meghan A. Bohren, Özge Tunçalp, Christopher J. Colvin, Ruth Garside, Benedicte Carlsen, Etienne V. Langlois Published in: Implementation Science : IS DOI: 10.1186/s13012-017-0688-3 ABSTRACT The GRADE-CERQual (‘Confidence in the Evidence from Reviews of Qualitative research’) approach provides guidance for assessing how much confidence to place in findings from systematic reviews of qualitative research (or qualitative evidence syntheses). The approach has been developed to support the use of findings from qualitative evidence syntheses in decision-making, including guideline development and policy formulation. Confidence in the evidence from qualitative evidence syntheses is an assessment of the extent to which a review finding is a reasonable representation of the phenomenon of interest. CERQual provides a systematic and transparent framework for assessing confidence in individual review findings, based on consideration of four components: (1) methodological limitations, (2) coherence, (3) adequacy of data, and (4) relevance. A fifth component, dissemination (or publication) bias, may also be important and is being explored. As with the GRADE (Grading of Recommendations Assessment, Development, and Evaluation) approach for effectiveness evidence, CERQual suggests summarising evidence in succinct, transparent, and informative Summary of Qualitative Findings tables. These tables are designed to communicate the review findings and the CERQual assessment of confidence in each finding. This article is the first of a seven-part series providing guidance on how to apply the CERQual approach. In this paper, we describe the rationale and conceptual basis for CERQual, the aims of the approach, how the approach was developed, and its main components. We also outline the purpose and structure of this series and discuss the growing role for qualitative evidence in decision-making. Papers 3, 4, 5, 6, and 7 in this series discuss each CERQual component, including the rationale for including the component in the approach, how the component is conceptualised, and how it should be assessed. Paper 2 discusses how to make an overall assessment of confidence in a review finding and how to create a Summary of Qualitative Findings table. The series is intended primarily for those undertaking qualitative evidence syntheses or using their findings in decision-making processes but is also relevant to guideline development agencies, primary qualitative researchers, and implementation scientists and practitioners. Electronic supplementary material The online version of this article (10.1186/s13012-017-0688-3) contains supplementary material, which is available to authorized users. WHY AN APPROACH TO ASSESSING CONFIDENCE IN THE EVIDENCE FROM REVIEWS OF QUALITATIVE RESEARCH IS NEEDED Decisions on health, social care, and other interventions, programmes, and policies need to be based on the best available evidence [1]. While different stakeholders may attach different importance to different types of evidence [2, 3], there is a wide agreement that a broad range of evidence is needed to inform decisions. This is particularly so for more complex interventions or policies as well as for programmes or policies whose implementation may impact across institutions and systems, such as across schools or across the education, health, or social care system. For example, evidence may be needed on the values that people attach to different outcomes, on effects of an intervention on health or social outcomes, on the acceptability and feasibility of the intervention, on resource use and cost-effectiveness, on equity impacts, on ethics, and on implementation and scale-up considerations at different levels [1, 4, 5]. Diverse evidence may also be needed to understand why evidence-informed policies are not adopted in specific jurisdictions or are not implemented successfully [6–8]. This is an important consideration across all settings, but particularly in low- and middle-income countries where resources are limited and need to be used effectively [1, 9]. Data from qualitative research contributes critical information to addressing this need. Qualitative research aims to explore people’s perceptions and experiences of the world around them, including their perspectives on health and illness, health and social care services, and wider health and social system policies and processes. In recent years, systematic reviews of qualitative research (also known as qualitative evidence syntheses) have become more common and the methods for undertaking these reviews are now well developed [10–12]. Evidence from qualitative evidence syntheses is increasingly incorporated into decision-making processes, including in health technology assessments, guideline development [13], and policy formulation, to complement evidence on the effects of interventions and on resource use. Qualitative evidence is also now being used within decision support tools such as the DECIDE evidence-to-decision frameworks [4] and SURE evidence-based policy briefs [14] and to inform decisions on implementation strategies. This wider use of qualitative evidence, including by organisations such as the World Health Organization (WHO), the European Commission Initiative on Breast Cancer and the National Institute for Health and Care Excellence (NICE) in the UK, has highlighted the need for the development of approaches that help users in deciding how much emphasis to give to such evidence in their decisions [15]. However, prior to the development of the approach described in this paper, there was no accepted, structured method for assessing confidence in the evidence from qualitative evidence syntheses [16]. The lack of such methods may constrain the use of qualitative evidence to inform decision-making. The ‘Confidence in the Evidence from Reviews of Qualitative research’ (GRADE-CERQual) approach provides guidance for assessing how much confidence to place in findings from qualitative evidence syntheses. It complements other ‘Grading of Recommendations Assessment, Development, and Evaluation’ (GRADE) tools for assessing how much confidence to place in evidence on the effectiveness and harms of interventions and their resource use and in evidence about diagnostic tests [17, 18]. The guidance in this series has been developed in collaboration and agreement with the GRADE Working Group (www.gradeworkinggroup.org). AIMS OF THE CERQUAL APPROACH The GRADE-CERQual approach (hereafter referred to as CERQual) has been developed to support people using findings from qualitative evidence syntheses in decision-making processes. CERQual allows the user to make a transparent assessment of how much confidence decision-makers and other users can place in individual review findings from syntheses of qualitative evidence. We define a review finding as an analytic output from a qualitative evidence synthesis that, based on data from primary studies, describes a phenomenon or an aspect of a phenomenon [16]. Many involved in using the findings of qualitative evidence syntheses may already be making these assessments of confidence intuitively or informally. As we see it, there are two main concerns with this: firstly, such assessments are not transparent and it is therefore not possible for others to see how the assessments were made and decide whether they agree with these decisions. Secondly, different assessors may use different criteria for assessing confidence and so assessments are not systematised across assessors (or even from one assessment to another, for the same assessor). Combined with the lack of transparency, this makes it difficult to understand, and where necessary critique, the basis for assessments. Broadly speaking, CERQual seeks to systematise the process of assessing confidence in the evidence from qualitative evidence syntheses and make these assessments explicit and transparent. In developing CERQual, we were informed by the principles and methods of qualitative research and have also sought to apply lessons learned from the GRADE Working Group’s development of similar tools for other