Core Outcome Set-STAndards for Development: The COS-STAD recommendations.

Kirkham JJ, Davis K, Davis K, Altman DG, Blazeby JM, Clarke M, Tunis S, Williamson PR. · 2017

Read Core Outcome Set-STAndards for Development: The COS-STAD recommendations. by Kirkham JJ, Davis K, Davis K, Altman DG, Blazeby JM, Clarke M, Tunis S, Williamson PR. (2017) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/europmc-pmc5689835.txt.

Introduction

Kirkham and co-authors present a standards paper in PLoS Medicine. It sets minimum rules for building core outcome sets. A core outcome set lists outcomes every trial should report. Hundreds of such projects exist, with no quality check. The COS-STAD project aimed to fix that gap. An open survey first generated candidate items. A two-round Delphi survey then refined the list. Nearly 250 experts from key stakeholder groups took part.

Consensus needed strong support in every stakeholder group. A final discussion settled the agreed standards. The result is 11 minimum standards for all projects. They cover three domains: scope, stakeholders, and consensus process. Developers use them when planning new outcome sets.

Catalog record

CREATORKirkham JJ, Davis K, Davis K, Altman DG, Blazeby JM, Clarke M, Tunis S, Williamson PR.
YEAR2017
COLLECTIONPAPERS
FORMATTXT
FILE SIZE33 KB
LICENSECC BY 4.0
RIGHTSCC BY
SOURCEEurope PMC

Source: https://europepmc.org/articles/PMC5689835

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Core Outcome Set-STAndards for Development: The COS-STAD recommendations By Jamie J Kirkham, Katherine Davis, Douglas G Altman, Jane M Blazeby, Mike Clarke, Sean Tunis, Paula R Williamson Published in: PLoS Medicine DOI: 10.1371/journal.pmed.1002447 ABSTRACT Abstract Background The use of core outcome sets (COS) ensures that researchers measure and report those outcomes that are most likely to be relevant to users of their research. Several hundred COS projects have been systematically identified to date, but there has been no formal quality assessment of these studies. The Core Outcome Set-STAndards for Development (COS-STAD) project aimed to identify minimum standards for the design of a COS study agreed upon by an international group, while other specific guidance exists for the final reporting of COS development studies (Core Outcome Set-STAndards for Reporting [COS-STAR]). Methods and findings An international group of experienced COS developers, methodologists, journal editors, potential users of COS (clinical trialists, systematic reviewers, and clinical guideline developers), and patient representatives produced the COS-STAD recommendations to help improve the quality of COS development and support the assessment of whether a COS had been developed using a reasonable approach. An open survey of experts generated an initial list of items, which was refined by a 2-round Delphi survey involving nearly 250 participants representing key stakeholder groups. Participants assigned importance ratings for each item using a 1–9 scale. Consensus that an item should be included in the set of minimum standards was defined as at least 70% of the voting participants from each stakeholder group providing a score between 7 and 9. The Delphi survey was followed by a consensus discussion with the study management group representing multiple stakeholder groups. COS-STAD contains 11 minimum standards that are the minimum design recommendations for all COS development projects. The recommendations focus on 3 key domains: the scope, the stakeholders, and the consensus process. Conclusions The COS-STAD project has established 11 minimum standards to be followed by COS developers when planning their projects and by users when deciding whether a COS has been developed using reasonable methods. INTRODUCTION The selection of appropriate outcomes in clinical trials and systematic reviews needs greater attention from the scientific community, if study findings are to be useful, reliable, and relevant to patients, healthcare professionals, and others making decisions regarding healthcare provision. Core outcome sets (COS) are an agreed standard set of outcomes that should be measured and reported, as a minimum, in all clinical trials in specific areas of health or healthcare [1]. The main rationales for COS are the need to improve comparability across similar trials, reduce selective outcome reporting, and increase the relevance of results from trials and systematic reviews. The Core Outcome Measures in Effectiveness Trials (COMET) Initiative has systematically identified several hundred published COS [2–4] and registered more than 150 ongoing or planned studies in a free, publicly available, searchable database [5]. Issues to consider in COS development have been described [1], but the key elements for good-quality COS have not previously been identified through any systematic process involving all relevant stakeholders. The COMET systematic reviews [2–4] have identified variability in several aspects of COS development, including the scope, the stakeholders, and the consensus process. Defining the quality of a COS is not straightforward. In principle, a ‘good’ COS is one that is implemented and leads to improved outcomes for patients, but this impact will be far downstream of the development process and cannot be assessed from information on the project that developed the COS [6]. In this article, we present the results of a research project to identify a set of minimum standards for COS development. These standards will help COS developers to improve their methodological approach and help users to assess whether a particular COS has been well developed. Scope of COS-STAD recommendations No gold standard method for the development of a COS currently exists, although empirical evidence is starting to appear [6]. Given the number of new COS projects being registered in the COMET database, and the growing experience of COS development, it was timely to assess whether international agreement regarding design principles could be reached. The aim of the COS-STAD project was to identify those aspects of COS development for which minimum standards can be agreed upon and applied regardless of the specific consensus method chosen. The COS-STAD recommendations relate to the development process and assume that the need for a COS has already been established [6]. COS-STAD recommendations are relevant to all COS, regardless of the area of healthcare and whether the COS was developed for effectiveness trials, systematic reviews, or routine care. In parallel with the Core Outcome Set-STAndards for Reporting (COS-STAR) reporting guideline [7], the COS-STAD recommendations were developed to address the first stage of development, namely gaining agreement on what should be measured, recognising that a COS describes what should be measured in a particular research or practice setting, with subsequent work needed to determine how each outcome should be defined or measured. The distinction between COS-STAD and COS-STAR is that COS-STAD focusses on the principles of design associated with COS development, while COS-STAR relates to the reporting of COS development studies. Ethical approval Ethical approval was granted for COS-STAR under an expedited review agreement (Reference RETH000841). Since the process for identifying and approaching participants to take part in COS-STAD was the same as for COS-STAR, no separate research ethics approval was sought. Informed consent was assumed if a participant responded to the surveys. Development of the COS-STAD recommendations Study group members (COS-STAR authors and consensus meeting participants) were invited via an online survey to specify which aspects they considered most important when developing a COS. Participants were provided with a copy of the COS-STAR reporting guideline items as a framework for organizing possible suggestions. The survey question asked, ‘Please list the “minimum standards” that you think are important when developing a COS’. Each respondent could provide as many items as he or she wished. Responses to the survey were reviewed independently by 2 experienced COS developers (JJK and PRW), duplicate suggestions were removed, and the remaining responses were grouped into domains. Respondents were asked to clarify suggestions that were unclear or ambiguous. An explanation of the process for converting participant suggestions into domains and a preliminary list of items are provided in S1 Text. The preliminary list of 16 items was agreed upon after discussion with the other core members of the COS-STAD management group (DGA, JMB, MC, and ST). These items covered 3 domains: scope (4 items), stakeholders (4 items), and the consensus process (8 items). This preliminary list was included in a Delphi survey of 4 key stakeholder groups, details of which are listed in Table 1. Participants were sent a personalised email outlining the project, together with a link to the survey, a copy of the COS-STAR reporting guideline [7], and the first update of a systematic review of COS studies [3]. All Delphi survey text was reviewed by the COMET PoPPIE (Patient Participation, Involvement and Engagement) coordinator in order to confirm the readability of the language prior to launching the survey. [Table: Stakeholder groups and participants involved in the Core Outcome Set-STAndards for Development (COS-STAD) Delphi survey.] Delphi participants rated the importance of each candidate item

Read the complete text