Establishing confidence in the output of qualitative research synthesis: the ConQual approach.
Munn Z, Porritt K, Lockwood C, Aromataris E, Pearson A. · 2014
Read Establishing confidence in the output of qualitative research synthesis: the ConQual approach. by Munn Z, Porritt K, Lockwood C, Aromataris E, Pearson A. (2014) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/europmc-pmc4190351.txt.
Introduction
Zachary Munn, Alan Pearson, and three co-authors proposed a confidence rating for qualitative research summaries in BMC Medical Research Methodology in 2014. Health decisions increasingly draw on syntheses of interview and observation studies, not just trials. Readers of such syntheses had no standard way to judge how much trust a finding deserves.
Their approach, named ConQual, rates each finding on two grounds. Dependability asks whether the studies behind it were done soundly, judged by a set of appraisal questions. Credibility asks how closely the summary's claims fit the original data, from clearly supported to unsupported. The two ratings combine into one overall confidence grade, presented in a summary table. The authors offer ConQual as a practical aid for clinicians and policy makers weighing qualitative evidence.
Catalog record
| CREATOR | Munn Z, Porritt K, Lockwood C, Aromataris E, Pearson A. |
|---|---|
| YEAR | 2014 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 33 KB |
| LICENSE | CC BY 4.0 |
| RIGHTS | CC BY |
| SOURCE | Europe PMC |
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Establishing confidence in the output of qualitative research synthesis: the ConQual approach By Zachary Munn, Kylie Porritt, Craig Lockwood, Edoardo Aromataris, Alan Pearson Published in: BMC Medical Research Methodology DOI: 10.1186/1471-2288-14-108 ABSTRACT Background The importance of findings derived from syntheses of qualitative research has been increasingly acknowledged. Findings that arise from qualitative syntheses inform questions of practice and policy in their own right and are commonly used to complement findings from quantitative research syntheses. The GRADE approach has been widely adopted by international organisations to rate the quality and confidence of the findings of quantitative systematic reviews. To date, there has been no widely accepted corresponding approach to assist health care professionals and policy makers in establishing confidence in the synthesised findings of qualitative systematic reviews. Methods A methodological group was formed develop a process to assess the confidence in synthesised qualitative research findings and develop a Summary of Findings tables for meta-aggregative qualitative systematic reviews. Results Dependability and credibility are two elements considered by the methodological group to influence the confidence of qualitative synthesised findings. A set of critical appraisal questions are proposed to establish dependability, whilst credibility can be ranked according to the goodness of fit between the author’s interpretation and the original data. By following the processes outlined in this article, an overall ranking can be assigned to rate the confidence of synthesised qualitative findings, a system we have labelled ConQual. Conclusions The development and use of the ConQual approach will assist users of qualitative systematic reviews to establish confidence in the evidence produced in these types of reviews and can serve as a practical tool to assist in decision making. BACKGROUND Across the health professions, the impetus to practice evidence-based healthcare has increased exponentially since the term ‘Evidence-Based Medicine’ was first coined in 1992 [1]. Evidence-based practice has been defined as ‘…the conscientious, explicit, and judicious use of current best evidence in making decisions about the care of individual patients,…’ [2]. Rigorously conducted systematic reviews of the evidence are viewed as the pillar on which evidence-based healthcare rests and uniquely provide this foundation role by presenting health professionals with a comprehensive synthesis of the extant literature on a certain healthcare topic [2–4]. Evidence-based organisations such as the Cochrane Collaboration and the Joanna Briggs Institute (both established in the 1990s) were formed to develop methodologies and standards for the conduct of systematic reviews to inform decision making in healthcare [5–8]. Historically, systematic reviews have predominantly been undertaken to address questions regarding the effectiveness of interventions used in healthcare and therefore have required the analysis and synthesis of quantitative evidence. However, qualitative systematic reviews that bring together the findings of multiple, original qualitative studies, also have an important role in evidence-based healthcare. Qualitative systematic reviews can address questions to inform healthcare professionals about issues that cannot be answered with quantitative research and data [6, 8, 9]. Findings derived from qualitative research are increasingly acknowledged as important not only to accompany and support quantitative research findings to inform questions of practice and policy, but also to answer questions in their own right [10]. Qualitative systematic reviews aim to maximise the understanding of a wide range of healthcare issues that cannot be measured quantitatively; for example, they can inform understandings of how individuals and communities perceive health, manage their health and make decisions related to health service usage. Furthermore, syntheses of qualitative research can increase our understandings of the culture of communities, explore how service users experience illness and the health system, and evaluate components and activities of health services such as health promotion and community development. Despite the increasing recognition of the importance of qualitative research to inform decision making in healthcare, historically the systematic review of qualitative research (or qualitative evidence/research synthesis) has been a highly contested topic. The debate regarding whether or not qualitative research can and should be synthesised has largely sided in support of synthesis. Despite this, there is still no international consensus to approach the combination of the findings of qualitative studies. This is evidenced by the numerous methodologies now available to incorporate and synthesise findings from qualitative research, [10] including for example meta-aggregation, meta-ethnography, realist synthesis, qualitative research synthesis and grounded theory, amongst others [5, 8, 11, 12]. Meta-aggregation has been established as a methodology for qualitative research synthesis for over a decade and was initially developed by a group led by Pearson in the early 2000s [6, 7, 13]. An underlying premise adopted by this meta-aggregative development group was that regardless of the type of evidence being synthesised, systematic reviews should be conducted in the same fashion, regardless of the type of evidence the question posed demanded. The well-established steps in the systematic review process were then tailored to qualitative evidence to develop meta-aggregation as a method of synthesis following the same principles of systematic reviews of effectiveness, whilst being sensitive to the contextual nature of qualitative research and its traditions. The meta-aggregative method has been explicitly aligned with the philosophy of pragmatism in order to deliver readily usable synthesised findings to inform decision making at the clinical or policy level [10]. As a result, the meta-aggregative approach to qualitative synthesis is particularly suited for reviewers attempting to answer a specific question about healthcare practice or summarising a range of views regarding interventions or health issues [12]. This is in contrast to other recognised approaches to qualitative synthesis, such as meta-ethnography for example, which aim to develop explanatory theories or models [12]. There are now numerous examples of meta-aggregative systematic reviews available along with detailed guidance on how to conduct this type of systematic review [6–8, 14, 15]. There have been many methodological developments aimed at improving the conduct and reporting of systematic reviews since they were first introduced. Recently, multiple international organisations that conduct systematic reviews have endorsed the recommendations from the GRADE (Grading of Recommendations Assessment, Development and Evaluation) working group. The GRADE working group has developed a systematic process to establish and present the confidence in the synthesised results of quantitative research through considering issues related to study design, risk of bias, publication bias, inconsistency, indirectness, imprecision of evidence, effect sizes, dose–response relationships and confounders of findings [16]. The outcome of this approach is a GRADE score, labelled as High, Moderate, Low or Very Low, which represents the level of confidence in the synthesised findings. This score is then applied to the major results of a quantitative systematic review. Key findings and important supporting information are presented in a ‘Summary of Findings’ table (or evidence profile). The ‘Summary of Findings’ table has been shown to improve the understanding and the accessibility of results of systematic reviews [17–19]. The GRADE approach has been widely adopted by international organisations in the conduct of quantitative systematic reviews. However, to date, there has been no widely accepted approach to assist health care professionals and policy makers in establishing confidence in the synthesised findings of qualitative systematic reviews. In light of these developments to the quantitative systematic review process, at the beginning of 2013 a methodological group was formed to consider the meta-aggregative review process specifically with the directive to detail means of establishing confidence in the findings of qualitative systematic reviews and presentation