Improving Transparency and Relevance of the Clinical Practice Guidelines in Nephrology Authors: David J Tunnicliffe, Martin Howell, Vincent Lee, Jonathan C Craig Published: 2024 See Clinical Research on Page 396 Typically, evidence-based guidelines are methodologically transparent and rigorous in all elements except the process of topic selection and prioritization. Significant resources are required for the development of evidence-based guidelines to the highest methodological standards to ensure validity and reliability; however, it is often unclear if the topics being covered meet the needs of the community, particularly consumers with lived experience. Harrison et al.1 outline a multistakeholder prioritization Delphi study, undertaken by the Canadian Society of Nephrology, to identify topics for guidelines and commentaries. Their study makes a valuable contribution to the field of prioritization by outlining a methodological approach and a list of prioritized topics for guidelines. It also includes the priorities of consumers with lived experience, a critical perspective often overlooked in guideline selection and development. The Canadian Society of Nephrology Clinical Practice Guideline Committee undertook a multistakeholder prioritization process from July to September 2023, to identify topics to be addressed in Canadian clinical practice guidelines.1 The prioritization process with a published protocol available adhered to reporting the standards of consensus methods, namely ACCORD.2 Initially, participants, clinicians and researchers (n = 67), and people with lived experience of disease (n = 18), identified the guidelines to be developed by suggesting new topics, international guidelines that should be contextualized to Canada, and other nonnephrology Canadian guidelines relevant to kidney disease. The suggested topics were supplemented by a MEDLINE search of kidney guidelines in the last 3 years. Round 1 of the survey included 100 topics where participants ranked their importance using a 9-point Likert Scale. Prespecified criteria were used to include topics in subsequent survey rounds: a median score of ≥7 and ≥75% of participants ranked 7 or above on the Likert scale. The median scores of the included topics were provided to the participants in the 2 subsequent rounds to help inform their choices. The Delphi survey, with a participation rate of about 90% across the 3 rounds, resulted in 30 topics being included and rated in round 2 and 18 in round 3. After 3 rounds, 4 topics were identified as high priority for commentaries for the Canadian context, whereas 8 new guidelines, with a patient focus were highlighted, including self-management for dialysis recipients and mental health care for chronic kidney disease. Including consumers with lived experience of kidney disease in guideline development is not commonly undertaken. Consequently, the large list of topics included in the Delphi survey is diverse, with many aligned with patient preferences. The study was designed to reduce barriers to involvement by providing the survey in both English and French, and providing a small incentive to participants with lived experience. The provision of compensation to consumers with lived experience is usually a nominal amount, demonstrates respect and adheres to national standards, and complements the work of the researchers. In addition, all the surveys were piloted with clinical experts and patient-research partners who are authors of the article, highlighting their valued input. Multiround prioritization surveys aim to achieve consensus, and aggregated median rankings of suggested guideline topics were provided to participants during rounds 2 and 3. The data could have also been stratified by stakeholder type, that is, health care professionals and consumers with lived experience, noting there were about 4 times the number of health care professionals as consumers. In addition, the option of providing comments from participants indicating the rationale for their choices would have been informative. These 2 elements, together, would have allowed participants to consider a perspective different from theirs.3 Despite the number of people with lived experience who participated being close to the prespecified target, the relatively small sample size does mean the priorities of marginalized voices may not be identified. In the context of Canada’s colonial history and the overrepresentation of chronic kidney disease burden among First Nations, Mètis, and Inuit Peoples, their perspective is critically important. However, indigenous health and kidney disease has been identified as a priority guideline. Identifying the topics included in the Delphi had limitations; supplementing the suggested topics by searching only 1 medical literature database is not comprehensive, and many guidelines are not published in medical journals. The prioritization process was undertaken with a protocol, with prespecified criteria to be met for inclusion in subsequent survey rounds. A prespecified threshold with a high-level agreement is commonly used in Delphi surveys.4 However, selected cutoffs are arbitrary, which can result in near-miss topics being excluded from subsequent rounds. Further rounds, with other participants’ comments provided, would allow for reflection, and those topics may be considered a priority. Participants can, and often do, rate everything high on a Likert scale, that is, 7 to 9 on a 9-point Likert scale. Therefore, there needs to be flexibility in applying the criteria to ascertain importance based on the distribution of the data, like that used by the SONG initiative.3 Using preference elicitation methods, such as best-worst scale, also allows for better discrimination of topics particularly when Likert scores show little variation between topics.5 The survey resulted in 12 priority topics identified to be addressed by the Canadian Society of Nephrology. The scope of the guidelines is yet to be determined; however, some are quite broad, for example, guidelines for primary care setting. The relevance of the clinical questions within these guidelines may also vary. Some clinical questions will be based on relatively stable evidence base, whereas other clinical questions require updated guidance because of ongoing uncertainty, driven by the rapid pace of research in the area.6 In addition, some clinical questions may have higher priority for consumers, depending on needs. Narrowing the scope of guidelines and providing rankings through best-worse scales may have better informed the Canadian Society on Nephrology work plans and ensured efficient use of their limited resources. This is one of the first studies to examine the priorities for kidney guidelines. The inclusion of people with lived experience of kidney disease is critically important. The priorities for health research in kidney disease between health care professionals and patients are often mismatched; however, many of the prioritized guidelines overlap with patient priorities for research.7 Kidney guidelines must move forward in transparency and relevance to the community. A select group of nephrologists has often-prioritized guidelines, which may differ from the communities’ needs. Their focus might lean toward niche areas driven by academic interest which could benefit from their research being incorporated into guidelines. In addition, unreported financial conflicts may influence these priorities.8 The Canadian Society of Nephrology Clinical Practice Guideline Committee has recognized a gap in its membership and highlighted its commitment to the involvement of consumers with lived experience, in line with the Australia and New Zealand Kidney Guideline Developers Steering Committee.9 The study by Harrison et al.1 marks a positive shift toward transparency, relevance, and inclusivity in nephology guideline development, incorporating consumers with lived experience. The prioritization process identified 12 important topics, many patient-centered, for Canadian guidelines to address. However, the reliance on Likert scales limits the differentiation, and future efforts would benefit from inclusion of ranking methods such as best-worst scaling. Nonetheless, this process is a vital step toward ensuring guidelines reflect the needs of both health care professionals and patients. Disclosure All authors have been involved in the development of kidney clinical practice guidelines in Australia and New Zealand. DJT is the Scientific Director of Caring for Australians and New Zealanders with Kidney Impairment (CARI) Guidelines. VL is the Chair of the CARI Guidelines Steering Committee, and JCC is a member of the CARI Guidelines Steering Committee. Acknowledgments DJT is supported by a National Health and Medical Research Council Emerging Leadership 1 Investigator Grant (APP1197337). The views presented in this report are those of the authors and do not necessarily represent the official position of the funding agency. References