Development, implementation, and evaluation of clinical practice guidelines, protocols, and pathways used in rural and remote Australia, Canada, and Aotearoa New Zealand: a scoping review Authors: Luke Arkapaw, Sonia Hines, Mary Byrne, Stefano Zaccagnini, Nimali Mani, Gillian Harvey, Anthea Brand, Oliver Black, James A. Smith Published: 2026 ABSTRACT Objective:This scoping review examines the extent and type of evidence describing the development, implementation, and evaluations of clinical practice guidelines, protocols, and pathways used in the rural and remote areas of Australia, Canada, and Aotearoa New Zealand (NZ).Introduction:Given the role that clinical guidance resources (CGRs) can play in reducing health disparities, it is useful to understand what resources are being utilized in rural and remote health contexts and the robustness of the processes that underpin them.Eligibility criteria:Records were included from 3 high-income countries with rural or remote regions and First Nations populations. Eligible records clearly identified a CGR, demonstrated its endorsement or implementation in a rural or remote health service, and had the CGR as a primary focus of the evaluation. All health topics were considered.Methods:Following JBI methodology, searches were conducted in November 2024 with a research librarian across MEDLINE (Ovid), CINAHL (EBSCOhost), Emcare (Ovid), Scopus, ProQuest Dissertations and Theses, and Google for English-language records. Data were extracted using an author-developed charting tool and reported using descriptive statistics, tables, graphics, and a narrative summary.Results:Fifty-six studies met the eligibility criteria encompassing Australia (82%), Canada (13%), and NZ (5%). Publication types were journal articles (86%), conference proceedings (7%), institutional reports (5%), and 1 thesis (2%). The CGRs examined were clinical practice guidelines (50%), protocols (27%), pathways (21%), and 1 study examined both protocols and pathways (2%). Twenty-one studies (38%) evaluated CGR development, 52 (93%) evaluated implementation, and 17 (30%) evaluated both. Study approaches were mixed methods (32%), experimental or quasi-experimental (30%), qualitative (20%), descriptive observational (16%), and analytical observational (2%). The most common study designs were before-and-after studies (39%) and qualitative case studies (32%), which were often combined within mixed methods studies. CGRs were most commonly adopted from national guidelines (36%) and used without alteration. Other CGRs were newly developed (25%), adapted from other contexts (23%), or updated (16%) from previous versions, meaning 64% of studies contextualized CGRs for rural and remote areas prior to implementation. Among the 21 development studies, 14% used a recognized guideline development tool, 52% conducted a systematic review, and none reported a quality assessment of the resulting CGR. All 52 implementation studies employed more than 1 implementation strategy, 48% matched strategies to pre-identified determinants, and 44% were designed to address barriers at all levels considered (individual, organizational, and broader systems). The most common strategy categories were training and educating stakeholders (92%) and adapting and tailoring to context (85%). Implementation studies measured implementation outcomes (96%), health service outcomes (81%), and patient health outcomes (42%). The most common outcomes measured in each category were feasibility (52%), efficiency (90%), and clinical or health status (29%). Most implementation studies (88%) did not report using any theory, model, or framework.Conclusions:This is the first comprehensive review of CGR development, implementation, and evaluation in rural and remote regions of Australia, Canada, and NZ. Findings highlight the need for more rigorous CGR development and quality assessment, along with theory-informed implementation and evaluation to strengthen their design and utility.Review registration:OSF https://osf.io/6em32/overview Introduction Clinical practice guidelines (CPGs), protocols, and pathways are 3 different but related types of resources designed to guide practitioners toward evidence-based best practice. The terms are often poorly defined and used indiscriminately in academic literature.1 CPGs synthesize the best available evidence to inform clinical decision-making, typically offering graded recommendations based on the strength of evidence.2 Clinical protocols are more prescriptive, outlining specific actions for clinicians, rather than presenting alternative options as CPGs do.3 Clinical pathways, meanwhile, coordinate multidisciplinary care with a focus on the patient journey, including timing, sequencing, and referral processes.4 We employ the term clinical guidance resources (CGRs) throughout this review to refer to these 3 types of resources collectively. All CGRs aim to standardize care, contain costs, improve outcomes, and enhance efficiency. These objectives are especially important in rural and remote health care settings, which face unique challenges, including high staff turnover, limited access to diagnostic and therapeutic services, and infrastructure constraints.5 Health outcomes in these areas are generally poorer than in urban settings,6 and CGRs that are well-designed and effectively implemented can help mitigate the disparities. Creating trustworthy CPGs requires systematic evidence reviews and rigorous methodology, which can be difficult to achieve in rural and remote settings due to limited relevant literature and a scarcity of skilled personnel.7 As a result, it is not common for CPGs to be newly developed (de novo) specifically for these regions or for the First Nations populations who reside there. Instead, existing guidelines from urban, national, or international contexts are often adopted (no contextualization) or adapted (contextualized for the local setting). Adaptation—modifying a guideline to suit the local context—is generally preferred as it enhances relevance and feasibility.8 However, this process requires resources and expertise that may not be readily available. Simply adopting a CGR is more expedient if it can be legitimately deployed without alteration in the new environment.8 However, adopting CGRs risks inadvertently endorsing care that is culturally and contextually unsafe. Australia, Canada, and Aotearoa New Zealand (NZ) are grouped together in this review due to several shared characteristics. Each is a high-income country with a universal health care system, significant rural and remote populations, and a history of colonization. Importantly, all 3 have First Nations communities that are disproportionately represented in non-urban regions, where they experience significantly reduced health and well-being—challenges that are intensified by geographic remoteness.9-11All 3 countries use care standardization tools to organize their health sectors and alleviate these health inequities. Given the practical limitations of rural and remote practice, protocols and pathways are often more suitable than broad CPGs. Protocols and pathways can be tailored to exclude options that are impractical or unavailable, and to reflect the needs and preferences of local populations. When informed by high-quality foundational CPGs, adapted protocols and pathways can be considered as reformatted and contextualized versions of the foundational CPG. These adapted resources are easier to navigate and apply in practice, making them effective tools for delivering care in challenging environments.8 Evaluations may target either the development or implementation of CGRs, or both. For the purposes of this review, we use the term evaluation to encompass both informal and formal assessments of guideline development and implementation. Informal evaluations refer to descriptive or narrative accounts that lack a structured approach or appraisal, whereas formal evaluations employ validated tools or outcome measures to assess quality or effectiveness. Formal evaluations of CGRs ensure they are good quality and achieve intended outcomes. To ensure consistency and rigor, the use of appropriate theories, models, and frameworks is recommended to inform, structure, and guide evaluations of both development and implementation.12,13 Formal evaluations in the development phase typically assess the quality of published CGRs by examining the processes used in their creation and comparing them against established best-practice frameworks for guideline development and reporting (eg, Grading of Recommendations, Assessment, Development, and Evaluation [GRADE], Appraisal of Guidelines for Research and Evaluation [AGREE II], and ADAPTE).14 Formal evaluations in the implementation phase examine the processes and outcomes associated with the use of CGRs. Proctor et al.15 categorize the outcomes into 3 key domains (see Figure 1): implementation outcomeshealth service system outcomespatient health outcomes. Figure 1Implementation outcomes frameworkAdapted from Proctor et al.15 implementation outcomes implementation outcomes health service system outcomes health service system outcomes patient health outcomes. patient health outcomes. Implementation outcomes framework Adapted from Proctor et al.15 Implementation is more likely to succeed when it is tailored to the local context, incorporates more than 1 strategy, selects strategies to address specific pre-identified determinants (barriers and enablers), and ensures those strategies are coordinated to work across multiple levels: individuals, organizations, and broader systems.7,13,16,17 The Expert Recommendations for Implementing Change (ERIC) project compiled a list of all known implementation strategies. These 73 individual strategies were then grouped into the following 9 distinct categories using concept mapping techniques: i) adapt and tailor to context, ii) change infrastructure, iii) develop stakeholder interrelationships, iv) engage consumers, v) provide interactive assistance, vi) support clinicians, vii) train and educate stakeholders, viii) use evaluative and iterative strategies, and ix) utilize financial strategies.18 A preliminary search of MEDLINE, the Cochrane Database of Systematic Reviews, PROSPERO, OSF, and JBI Evidence Synthesis was conducted and no current or in-progress systematic reviews or scoping reviews on CGRs in rural and remote areas were identified. Although a number of reviews have examined methodological approaches and implementation strategies for clinical guidelines and pathways,13,14,19-21 none specifically focused on rural and remote regions within the countries included in this review. Considering the unique contextual characteristics of rural and remote regions and the populations residing within them, alongside the limited published evidence on how CGRs are evaluated in these settings, a scoping review is warranted to systematically map and describe the existing body of literature. Review questions How are CPGs, protocols, and pathways in use in the rural and remote areas of Australia, Canada, and Aotearoa NZ being developed, implemented, and evaluated? The review addressed this question with the following subquestions, which were updated from the published protocol to improve clarity and capture additional aspects observed in the included studies: What study approaches and designs have been used?What methodological characteristics have been employed?Have the CGRs been contextualized for use in rural and remote areas?Have consumers been actively involved in CGR development or implementation planning?Have the developed CGRs been quality assessed?What implementation strategies have been employed, and how were they selected and applied?What types of outcomes have been measured in the implementation studies?What theoretical frameworks have underpinned the evaluations? What study approaches and designs have been used? What study approaches and designs have been used? What methodological characteristics have been employed? What methodological characteristics have been employed? Have the CGRs been contextualized for use in rural and remote areas? Have the CGRs been contextualized for use in rural and remote areas? Have consumers been actively involved in CGR development or implementation planning? Have consumers been actively involved in CGR development or implementation planning? Have the developed CGRs been quality assessed? Have the developed CGRs been quality assessed? What implementation strategies have been employed, and how were they selected and applied? What implementation strategies have been employed, and how were they selected and applied? What types of outcomes have been measured in the implementation studies? What types of outcomes have been measured in the implementation studies? What theoretical frameworks have underpinned the evaluations? What theoretical frameworks have underpinned the evaluations? Eligibility criteria Population This scoping review included sources evaluating CGRs that were used for populations residing in the rural and remote areas of Australia, Canada, or Aotearoa NZ. All other countries were excluded. Concept All scientific evaluations of CPGs, protocols, or pathways implemented in any clinical health service located in the rural or remote areas of the included countries were included in the review. All other types of resources that provide clinical guidance were excluded. To be included, the CGRs under investigation had to be identified in the report and serve as a primary focus of the evaluation. Reports were excluded if they failed to adequately describe the CGRs or used them uncritically as a tool to evaluate some other aspect of a health system. Reports that did not describe the implementation or development processes were also excluded, as it could not be determined whether the CGRs had been endorsed or implemented in the rural or remote health services. Pre-implementation studies were excluded. Reports describing only a single audit round were excluded, as audits conducted in isolation often lack theoretical framing, contextual analysis, or outcome linkage, and, therefore, do not constitute formal evaluations of implementation. Exceptions were made in cases when the audit was part of a broader mixed methods study in which the qualitative component met the eligibility criteria. Evaluations of resources designed for point-of-care testing or diagnostic tools were excluded, as these are typically conducted in laboratory settings, often funded by manufacturers, and are technically different to evaluations of CGRs.22 These criteria were refined from those in the published protocol to provide clearer definitions of eligible evaluations and to exclude studies that lacked sufficient detail to address the review question. Context The evaluations had to be conducted within rural or remote health service settings in Australia, Canada, or Aotearoa NZ. Each of the included countries has different systems for determining levels of rurality or remoteness, and frequently updates and redefine their terminology. As a result, there are no consistent terms, definitions, or classification typologies used across all 3 nations.23 Therefore, we included all records that self-identified their setting as rural or remote, or used equivalent terminology relevant to their context (see Appendix I). Reports that included urban settings were only eligible if the rural or remote CGR was clearly identified, and the non-urban results were presented separately from the urban data. Primary, secondary, or tertiary health care services were all included, as were all health specialties including allied health disciplines. Including all levels of care ensured that the review captured the full range of CGRs used in these contexts, including hospitals located in rural towns that serve as critical access points for remote populations, alongside other services such as community clinics and pharmacies. Records from aged-care settings were excluded, as the care provided in those facilities does not generally represent the full scope of medical practice, and their CGRs are often designed for staff who are not health care professionals. Types of sources This scoping review considered both experimental and quasi-experimental study designs including randomized controlled trials, non-randomized controlled trials, before-and-after studies, and interrupted time-series studies. In addition, analytical observational studies including prospective and retrospective cohort studies, case-control studies, and analytical cross-sectional studies were considered for inclusion. This review also considered descriptive observational study designs including case series, individual case reports, and descriptive cross-sectional studies for inclusion. Qualitative study designs such as phenomenology, grounded theory, ethnography, qualitative description, action research, and feminist research were also considered, as well as mixed methods approaches and narrative descriptive studies. Methods This review was registered in OSF (https://osf.io/6em32/overview) and conducted in accordance with an a priori published protocol24 and following the JBI methodology for scoping reviews.25 The Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews (PRISMA-ScR) was followed for reporting purposes.26 Search strategy A master search strategy was developed to locate both published and unpublished records. We searched the medical literature using an initial structured strategy incorporating Medical Subject Headings (MeSH), keywords within titles and abstracts, and adjacency searching, as outlined in Appendix I. A multistep approach was used to develop the strategy, beginning with an initial search in MEDLINE and analysis of the results using the Ovid MEDLINE BETA tool “Analyze.” This process helped identify additional MeSH terms and keywords, which were incorporated into the final master strategy. The search syntax was then translated using the Polyglot tool (Institute for Evidence-Based Healthcare, Bond University, Australia) to ensure compatibility with Emcare, CINAHL (EBSCOhost), Scopus, and ProQuest Dissertations and Theses. MeSH terms were adjusted to reflect differences in subject headings across CINAHL and Scopus, as shown in Appendix I. Filters were applied to limit results to human studies published in English, with no restrictions on publication date. Studies published in languages other than English were excluded because English is the primary language of health service delivery and publications in Australia, Canada, and Aotearoa NZ, and the review team did not have the resources required for reliable translation. Gray literature was identified through customized Google searches targeting prominent rural and remote health professional associations in Australia, Canada, and Aotearoa NZ (Appendix II). Advanced Google searches were attempted for online records within the domains .gov, .org, and .edu for each country. The first 5 pages for each search were reviewed. No additional records were identified through this method. Throughout the search process, all strategies, results, and modifications were documented to ensure transparency and reproducibility. Source of evidence selection Following the searches, all identified records were collated and uploaded into Covidence (Veritas Health Innovation, Melbourne, Australia), where duplicates were removed. A pilot screening was conducted in which 2 reviewers (LA, MB) independently assessed 25 randomly selected records and discussed discrepancies until they achieved at least 80% agreement. Subsequently, titles and abstracts were screened by the same 2 reviewers against the eligibility criteria. Records that passed the screening stage were retrieved in full, and these reports were assessed in detail independently by 3 reviewers (LA, SZ, NM). During full-text screening, reports were merged into studies. Reasons for exclusion of studies at the full-text stage were documented and are reported in Appendix III. Disagreements at any stage of the selection process were resolved through discussion or, when necessary, with input from additional reviewers (SH, GH). Data extraction Data were independently extracted from the sources included in the scoping review by 3 reviewers (LA, SZ, NM) using a data charting tool developed by the team and constructed in Covidence. During the piloting phase, each reviewer processed 10 studies. This process revealed that determinants were not as consistently or explicitly reported across the included studies as we had anticipated at the protocol stage. As a result, the decision was made to discontinue extraction of determinant data and instead focus on implementation strategies and outcomes, which were more consistently available and aligned with the objectives of this review. Based on this and other similar challenges encountered during the piloting phase, the reviewers collaboratively revised the charting tool before full extraction commenced to minimize the risk of selection bias, resulting in the following modifications: i) the “implementation determinants” field was removed; ii) intervention strategies were categorized using 9 ERIC domains instead of the full list of 73 individual strategies; iii) the “total number of strategies used” was removed; and iv) analytical methods were grouped into 4 categories, as described in the results section. The data extracted included specific details about the characteristics of studies, CGRs, health topics addressed, settings, locations, concept, context, study methods, and key findings relevant to the review subquestions. Intervention strategies for implementing CGRs were categorized according to the 9 ERIC categories.18 Outcome measures related to implementation, health services, or patient health were categorized using Proctor et al.’s 2011 Implementation Outcomes Framework.15 The final version of the data extraction template is provided in Appendix IV. Disagreements between the reviewers were flagged by Covidence using a 100% agreement threshold and were resolved through discussion. Data analysis and presentation Data were analyzed using basic descriptive statistics, including frequencies and percentages. Findings are presented in tabular, graphical, and narrative formats to provide a comprehensive overview. A narrative synthesis was used to contextualize and interpret the results, addressing the research subquestions and highlighting key patterns and gaps across the included studies. Results Source of evidence inclusion The database searches identified 2801 records. Following the removal of 1194 duplicates, 1607 records were screened, of which 1437 did not meet the eligibility criteria. The remaining 170 records were retrieved as full-text reports. An additional 7 reports from rural and remote health professional websites were included. During the full-text review, 4 reports were merged into 3 studies. The 117 studies (including 119 reports) that were excluded during the full-text review are listed along with their reason for exclusion in Appendix III. A total of 56 studies (including 58 reports) were included for data extraction. The search process and results are illustrated in the PRISMA flow diagram (see Figure 2). Figure 2Search results and study selection and inclusion processCGR, clinical guidance resource Search results and study selection and inclusion process CGR, clinical guidance resource Characteristics of included studies The majority of the 56 included studies were journal articles (n = 48, 86%), with fewer contributions from conference proceedings (n = 4, 7%), institutional reports (n = 3, 5%), and 1 thesis (2%). The earliest study was a thesis published in Australia in 1993. As the timeline in Figure 3 shows, there was at least 1 study published each year from 2001 to 2024, when the search was conducted. The distribution of studies in decades were 3 from 1990–1999, 17 from 2000–2009, 24 from 2010–2019, and 12 from 2020 to November 2024. Figure 3Timeline of publication date of included studies (N=56) Timeline of publication date of included studies (N=56) The studies were predominantly conducted in Australia (n = 46, 82%), followed by Canada (n = 7, 13%), and then Aotearoa NZ (n = 3, 5%). They took place in primary health care (n = 27, 48%) more often than hospitals (n = 18, 32), with one-fifth of studies spanning both settings (n = 11, 20%). CPGs were the most frequently evaluated type of CGR, accounting for half of the included studies (n = 28). Protocols were examined in 15 (27%) studies, pathways in another 12 studies (21%), while 1 study examined both protocols and pathways (2%). Of the included studies, 4 (7%) focused exclusively on the development of the CGRs, while 35 (63%) focused solely on the implementation phase. There were 17 studies (30%) that examined both the development and implementation of their CGRs. In total, 21 studies (38%) evaluated development, and 52 studies (93%) evaluated implementation. Review findings Methodological characteristics of included studies Study approaches and designs The study approaches and designs of the 56 included studies are shown in Table 1.27-82Table 1:Study approaches and designs in included studies (N=56)Study approach (n, %)Study designStudies (n)Percentage (%)Mixed methods (18, 32%)Convergent parallel27-33713%Exploratory sequential design34-39611%Explanatory sequential design40-4459%Experimental/quasi-experimental (17, 30%)Before-and-after study45-591527%Cluster-randomized controlled trial6012%Non-randomized controlled trial6112%Qualitative (11, 20%)Action research62-6659%Qualitative case study67-7047%Narrative description71,7224%Descriptive observational (9, 16%)Longitudinal descriptive study73-78611%Case series79-8135%Analytical observational (1, 2%)Prospective cohort study8212% Table 1:Study approaches and designs in included studies (N=56)Study approach (n, %)Study designStudies (n)Percentage (%)Mixed methods (18, 32%)Convergent parallel27-33713%Exploratory sequential design34-39611%Explanatory sequential design40-4459%Experimental/quasi-experimental (17, 30%)Before-and-after study45-591527%Cluster-randomized controlled trial6012%Non-randomized controlled trial6112%Qualitative (11, 20%)Action research62-6659%Qualitative case study67-7047%Narrative description71,7224%Descriptive observational (9, 16%)Longitudinal descriptive study73-78611%Case series79-8135%Analytical observational (1, 2%)Prospective cohort study8212% Study approaches and designs in included studies (N=56) The quantitative and qualitative components of the mixed methods studies were identified and integrated with the non–mixed methods studies to enable a more comprehensive analysis of the research methodologies employed across the included studies. This deeper level of analysis revealed additional study designs and altered the frequencies of the others as presented in Table 2.Table 2:Study designs of included studies after mixed methods breakdown (N=56)Study designFrequency (n)Percentage (%)Before-and-after studies2341%Qualitative case studies1832%Action research916%Longitudinal descriptive studies713%Cross-sectional (descriptive) studies59%Case series35%Interrupted time series35%Narrative descriptive studies24%Non-randomized controlled trials12%Cluster-randomized controlled trials12%Prospective cohort studies12%Retrospective cohort studies12%Grounded theory studies12% Table 2:Study designs of included studies after mixed methods breakdown (N=56)Study designFrequency (n)Percentage (%)Before-and-after studies2341%Qualitative case studies1832%Action research916%Longitudinal descriptive studies713%Cross-sectional (descriptive) studies59%Case series35%Interrupted time series35%Narrative descriptive studies24%Non-randomized controlled trials12%Cluster-randomized controlled trials12%Prospective cohort studies12%Retrospective cohort studies12%Grounded theory studies12% Study designs of included studies after mixed methods breakdown (N=56) Participants The study participants were divided into 3 categories: practitioners, patients, and policymakers. Managerial practitioners were classified under the policymakers’ category if they contributed to one of the data sources and acted as decision-makers for their organizations rather than practitioners. Practitioners were participants in all 56 studies. Patients, or their data, were involved in 47 (84%) studies, and policymakers (managers) were involved in 22 (27%) studies. The combination of participants used in each study is provided as Supplemental Digital Content: http://links.lww.com/SRX/A183. Data collection Data were collected prospectively in 17 (30%) studies and retrospectively in 12 (21%) studies, with 27 (48%) studies collecting data both prospectively and retrospectively. Data sources varied across the included studies, with individual patient records (n = 40, 71%) being the most commonly used, followed by surveys (n = 20, 36%), facilitated workshops (n = 19, 34%), and interviews (n = 17, 30%). A range of other sources were also employed to a lesser extent. A complete list of data sources is shown in Figure 4. Figure 4Data sources in included studies (N=56) Data sources in included studies (N=56) Sample sizes were extracted and consolidated into 3 categories: number of sites included in the study, number of files audited, and number of participants involved in qualitative activities (eg, interviews, focus groups, workshops). The range of sites was 1 to 73, file audits 25 to 9322, and participants 3 to 308. Sample size information for each included study is available in the Supplemental Digital Content: http://links.lww.com/SRX/A183. Analytical methods Descriptive statistics were used in 47 (84%) of the included studies, 21 (38%) of which also performed inferential and/or advanced statistics. The exact types of statistical tests are shown the Supplemental Digital Content: http://links.lww.com/SRX/A183. Similarly, 39 (70%) studies used descriptive qualitative analysis, of which 11 (20%) also performed thematic analysis. One study was a realist evaluation that used context-mechanism-outcome analysis (n = 1, 2%). Main clinical guidance resources Location of use The locations of the CGRs being evaluated were extracted with as much detail as provided in the studies. Among the 46 Australian studies, CGRs were used in the rural and remote areas of the Northern Territory (n = 16, 35%), New South Wales (n = 14, 30%), Western Australia (n = 8, 17%), South Australia (n = 6, 13%), Queensland (n = 5, 11%), Victoria (n = 5, 11%), and Tasmania (n = 1, 2%). In the 7 Canadian studies, CGRs were used in the rural and remote areas of Ontario (n = 3, 43%), Manitoba (n = 3, 43%), Alberta (n = 2, 29%), Newfoundland and Labrador (2, 29%), Nova Scotia (n = 1, 14%), British Columbia (n = 1, 14%), and Quebec (n = 1, 14%). Of the 3 Aotearoa NZ studies, 1 CGR was used in the Hawke’s Bay district, 1 in Invercargill, and 1 was for use in all rural areas nationally. More detailed geographical information, such as the regions, towns, and communities, for Australia and Canada is available in the Supplemental Digital Content: http://links.lww.com/SRX/A183. Health topics A total of 36 unique MeSH terms were used to describe the health topics covered by the CGRs. The 3 most frequent topics were cardiology, respiratory tract diseases, and chronic disease. The 18 most frequently occurring MeSH terms are shown in Table 3. Another 18 MeSH terms occurred once and are listed in the Supplemental Digital Content: http://links.lww.com/SRX/A183.Table 3:Health topics covered by clinical guidance resources with multiple occurrences in included studies (N=56)Health topic (MeSH term)Frequency (n)%Cardiology814%Respiratory tract diseases713%Chronic disease713%Primary health care59%Rural health services59%Emergency medical services59%Mental health47%Child health35%Kidney diseases24%General surgery24%Substance-related disorders24%Hematologic diseases24%Communicable diseases24%Patient transfer24%Reproductive health24%Neoplasms24%Nervous system diseases24%Psychiatry24% Table 3:Health topics covered by clinical guidance resources with multiple occurrences in included studies (N=56)Health topic (MeSH term)Frequency (n)%Cardiology814%Respiratory tract diseases713%Chronic disease713%Primary health care59%Rural health services59%Emergency medical services59%Mental health47%Child health35%Kidney diseases24%General surgery24%Substance-related disorders24%Hematologic diseases24%Communicable diseases24%Patient transfer24%Reproductive health24%Neoplasms24%Nervous system diseases24%Psychiatry24% Health topics covered by clinical guidance resources with multiple occurrences in included studies (N=56) Generation The CGRs were most commonly adopted (n = 20, 36%) from other contexts and used unaltered in the rural or remote region. In 13 (23%) studies, CGRs were adapted from other contexts to better suit the rural or remote region before implementation. In 14 (25%) studies, CGRs were newly developed (de novo), and in 9 (16%) studies the CGRs were updated from previous versions or editions that were originally developed for rural or remote areas. Table 4 shows the name and type of the 20 CGRs that were adopted, along with the location where they were used and their original intended location. All CGRs were developed in the same country where they were implemented. One study that evaluated multiple guidelines also adopted a CGR that was developed by an international organization for global use. In 18 studies, the adopted guidelines were national guidelines that were applied locally without alteration. One study adopted a state-endorsed guideline from a different state of Australia, and another used a state-level guideline from the same state it was set in.Table 4:Details of adopted clinical guidance resources (N=20)Author, yearAdopted CGR: Name (year)Jurisdiction of useJurisdiction of originCGR typeAlcorn,45 2018Therapeutic Guidelines Antibiotic Version 14 (2010)AustraliaNew South Wales, northern regionAustraliaNationalGuidelinesBoyle,34 2017Evidence-Based Guidelines for the Assessment and Management of Polycystic Ovary Syndrome (2011)AustraliaQueensland, Cape York and Torres Strait regionsAustraliaNationalGuidelinesCashman,76 2021eviQ Chemotherapy Protocols (2017)AustraliaNew South Wales, GriffithAustraliaNationalProtocolsClifford,48 2013Alcohol Treatment Guidelines for Indigenous Australians (2007)AustraliaNew South WalesAustraliaNationalGuidelinesCurry,28 2011Canadian Association of Radiologists: Diagnostic Imaging Referral Guidelines (2005)CanadaManitobaCanadaNationalGuidelinesDaly,50 2009New South Wales Drug and Alcohol Withdrawal Clinical Practice Guidelines (2007)AustraliaNew South WalesAustraliaNew South WalesGuidelinesDoherty,51 2006National Asthma Council and Respiratory Therapeutic Guidelines Version 3 (2005)AustraliaNew South Wales, New England regionAustraliaNationalGuidelinesDoherty,52 2007National Asthma Council Asthma Management Handbook (2002)AustraliaNew South Wales, New England regionAustraliaNationalGuidelinesDoherty,53 2007National Asthma Council Asthma Management Handbook (2002)AustraliaNew South Wales, New England regionAustraliaNationalGuidelinesGaston,54 2013National Health and Medical Research Council: Clinical Practice Guideline for the Prevention of Venous Thromboembolism in Patients Admitted to Australian Hospitals (2009)AustraliaSouth AustraliaAustraliaNationalGuidelinesGorham,35 2024Kidney Disease: Improving Global Outcomes for Chronic Kidney Disease Guidelines (2012) and Heart Foundation Hypertension Guidelines (2016)AustraliaNorthern TerritoryInternational; AustraliaGlobal; NationalGuidelinesGott,79 2023Royal Australian and New Zealand College of Psychiatrists (RANZCP) Clinical Practice Guidelines for Schizophrenia and Related Disorders (2016)AustraliaNew South WalesAustralia and New ZealandNationalGuidelinesHayward,37 2020Diabetes Canada Clinical Practice Guidelines (2018)CanadaBritish Columbia, Alberta, Manitoba, Ontario, Quebec, Newfoundland and LabradorCanadaNationalGuidelinesRalph,29 2013Australian Guideline for Prevention, Diagnosis, and Management of Acute Rheumatic Fever and Rheumatic Heart Disease (2006)AustraliaNorthern TerritoryAustraliaNationalGuidelinesReddy,70 2008National Heart Foundation of Australia Guidelines for Depression Screening in Chronic Heart Disease (2004, updated 2007)AustraliaVictoria, western region; South Australia, south-east regionAustraliaNationalGuidelinesSaini,61 2008National Asthma Council Australia Asthma Management Handbook (2006)AustraliaNew South Wales, central west regionAustraliaNationalGuidelinesVirani,59 2006Canadian Diabetes Association Clinical Practice Guidelines (2003)CanadaAlbertaCanadaNationalGuidelinesWarner,43 2010Canadian Best Practice Recommendations for Stroke Care (2006)CanadaNova ScotiaCanadaNationalGuidelinesWright,33 2008Australian National Stroke Foundation Acute Care Guidelines (2002)AustraliaVictoria, rural regionsAustraliaNationalGuidelinesYoung,44 2022Queensland Smoking Cessation Clinical Pathway v5.00 (2012)AustraliaNew South WalesAustraliaQueenslandPathwaysCGR, clinical guidance resource Table 4:Details of adopted clinical guidance resources (N=20)Author, yearAdopted CGR: Name (year)Jurisdiction of useJurisdiction of originCGR typeAlcorn,45 2018Therapeutic Guidelines Antibiotic Version 14 (2010)AustraliaNew South Wales, northern regionAustraliaNationalGuidelinesBoyle,34 2017Evidence-Based Guidelines for the Assessment and Management of Polycystic Ovary Syndrome (2011)AustraliaQueensland, Cape York and Torres Strait regionsAustraliaNationalGuidelinesCashman,76 2021eviQ Chemotherapy Protocols (2017)AustraliaNew South Wales, GriffithAustraliaNationalProtocolsClifford,48 2013Alcohol Treatment Guidelines for Indigenous Australians (2007)AustraliaNew South WalesAustraliaNationalGuidelinesCurry,28 2011Canadian Association of Radiologists: Diagnostic Imaging Referral Guidelines (2005)CanadaManitobaCanadaNationalGuidelinesDaly,50 2009New South Wales Drug and Alcohol Withdrawal Clinical Practice Guidelines (2007)AustraliaNew South WalesAustraliaNew South WalesGuidelinesDoherty,51 2006National Asthma Council and Respiratory Therapeutic Guidelines Version 3 (2005)AustraliaNew South Wales, New England regionAustraliaNationalGuidelinesDoherty,52 2007National Asthma Council Asthma Management Handbook (2002)AustraliaNew South Wales, New England regionAustraliaNationalGuidelinesDoherty,53 2007National Asthma Council Asthma Management Handbook (2002)AustraliaNew South Wales, New England regionAustraliaNationalGuidelinesGaston,54 2013National Health and Medical Research Council: Clinical Practice Guideline for the Prevention of Venous Thromboembolism in Patients Admitted to Australian Hospitals (2009)AustraliaSouth AustraliaAustraliaNationalGuidelinesGorham,35 2024Kidney Disease: Improving Global Outcomes for Chronic Kidney Disease Guidelines (2012) and Heart Foundation Hypertension Guidelines (2016)AustraliaNorthern TerritoryInternational; AustraliaGlobal; NationalGuidelinesGott,79 2023Royal Australian and New Zealand College of Psychiatrists (RANZCP) Clinical Practice Guidelines for Schizophrenia and Related Disorders (2016)AustraliaNew South WalesAustralia and New ZealandNationalGuidelinesHayward,37 2020Diabetes Canada Clinical Practice Guidelines (2018)CanadaBritish Columbia, Alberta, Manitoba, Ontario, Quebec, Newfoundland and LabradorCanadaNationalGuidelinesRalph,29 2013Australian Guideline for Prevention, Diagnosis, and Management of Acute Rheumatic Fever and Rheumatic Heart Disease (2006)AustraliaNorthern TerritoryAustraliaNationalGuidelinesReddy,70 2008National Heart Foundation of Australia Guidelines for Depression Screening in Chronic Heart Disease (2004, updated 2007)AustraliaVictoria, western region; South Australia, south-east regionAustraliaNationalGuidelinesSaini,61 2008National Asthma Council Australia Asthma Management Handbook (2006)AustraliaNew South Wales, central west regionAustraliaNationalGuidelinesVirani,59 2006Canadian Diabetes Association Clinical Practice Guidelines (2003)CanadaAlbertaCanadaNationalGuidelinesWarner,43 2010Canadian Best Practice Recommendations for Stroke Care (2006)CanadaNova ScotiaCanadaNationalGuidelinesWright,33 2008Australian National Stroke Foundation Acute Care Guidelines (2002)AustraliaVictoria, rural regionsAustraliaNationalGuidelinesYoung,44 2022Queensland Smoking Cessation Clinical Pathway v5.00 (2012)AustraliaNew South WalesAustraliaQueenslandPathwaysCGR, clinical guidance resource Details of adopted clinical guidance resources (N=20) CGR, clinical guidance resource Table 5 shows the names, types, and location of use for the 13 CGRs that were adapted, and the names, types, and original intended locations of their corresponding base CGRs. Eleven (85%) studies adapted CGRs from their own country, 2 of which also used global CGRs in the adaption process. One (8%) study adapted a global CGR for the Aotearoa NZ context, and another adapted Aotearoa NZ pathways for an Australian context. The base CGRs were intended for global use in 3 (23%) studies, were national guidelines from the same countries in 7 (54%) studies, and originated from the same state in Australia in 4 (31%) studies. Five (38%) studies produced the same kind of CGR as the base CGR (2 guidelines, 2 pathways, 1 protocol). In the remaining 8 (62%) studies, CPGs served as the base CGR and were adapted into protocols in 4 (31%) and pathways in the other 4 (31%).Table 5:Details of adapted clinical guidance resources and their base resources (N=13)Author, yearAdapted clinical guidance resourceBase clinical guidance resourceName (year)CountryTypeName (year)CountryTypeCadilhac,47 2013New South Wales Local Hospital Rural Stroke Protocols and Pathways (2007)AustraliaProtocolsAustralian National Guidelines for Acute Stroke Management (2003)AustraliaGuidelinesCarruthers,75 1996Remote Area Continuous Ambulatory Peritoneal Dialysis Manual (1994)AustraliaProtocolsWestern Australia Remote Area Health Service: Continuous Ambulatory Peritoneal Dialysis Protocols (1988)AustraliaProtocolsHinton,65 2015Best Practice Pathway for Indigenous Mental Health (2015)AustraliaPathwaysBeyond Blue: Clinical Practice Guidelines for Depression and Related Disorders – Anxiety, Bipolar Disorder and Puerperal Psychosis – in the Perinatal Period (2011)AustraliaGuidelinesHourihan,71 2003Pharmacist-Administered Cardiovascular Risk Screening Protocol (1999)AustraliaProtocolsMultiple International, Australian and New South Wales Guidelines on Heart, Diabetes, Exercise, Smoking and Pharmacy (1986–2000)International; AustraliaGuidelinesKinsman,60 2012Local Acute Myocardial Infarction Clinical Pathway (2008)AustraliaPathwaysNational Heart Foundation of Australia Guidelines (2006)AustraliaGuidelinesLineker,55 2019The Getting a Grip on Arthritis Best Practice Guidelines for Osteoarthritis and Rheumatoid Arthritis (2012)CanadaGuidelinesMultiple International and Canadian Osteoarthritis and Rheumatoid Arthritis guidelines (2004–2011)International; CanadaGuidelinesMiller,82 2022Rural Accelerated Chest Pain Pathway (2018)New ZealandPathwaysNew Zealand Metropolitan-Based Accelerated Diagnostic Pathways (2018)New ZealandPathwaysMitchell,80 2020Local Protocol for Clonidine Use for Long-Acting benzathine Benzylpenicillin G Administration (2018)AustraliaProtocolsAustralian Guideline for the Prevention, Diagnosis, and Management of Acute Rheumatic Fever and Rheumatic Heart Disease - 2nd Edition (2012)AustraliaGuidelinesPhillips,69 2015Tasmanian HealthPathways (2014)AustraliaPathwaysNew Zealand HealthPathways (2008)New ZealandPathwaysReeve,57 2014Local Ear Health Pathway (2010)AustraliaPathwaysKimberley Ear Health Guidelines (2008)AustraliaGuidelinesSally,39 2024Queensland Government: Community Acquired Pneumonia Clinical Care Pathway (2021)AustraliaPathwaysAustralian Therapeutic Guidelines: Antibiotic Version 16 (2023)AustraliaGuidelinesTolmay,58 2024Southland Modified Rural Colorectal ERAS Protocol (2014)New ZealandProtocolsEnhanced Recovery After Surgery (ERAS) Society Guidelines for Perioperative Care in Elective Colorectal Surgery (2012)InternationalGuidelinesWest,66 2024The Remote Management of High Flow Nasal Cannula Therapy in Paediatric and Adolescent Patients (2021)AustraliaGuidelinesChildren’s Health Queensland Hospital and Health Service: Nasal High Flow Therapy – Management of the Paediatric Patient Receiving High Flow Therapy (2019)AustraliaGuidelines Table 5:Details of adapted clinical guidance resources and their base resources (N=13)Author, yearAdapted clinical guidance resourceBase clinical guidance resourceName (year)CountryTypeName (year)CountryTypeCadilhac,47 2013New South Wales Local Hospital Rural Stroke Protocols and Pathways (2007)AustraliaProtocolsAustralian National Guidelines for Acute Stroke Management (2003)AustraliaGuidelinesCarruthers,75 1996Remote Area Continuous Ambulatory Peritoneal Dialysis Manual (1994)AustraliaProtocolsWestern Australia Remote Area Health Service: Continuous Ambulatory Peritoneal Dialysis Protocols (1988)AustraliaProtocolsHinton,65 2015Best Practice Pathway for Indigenous Mental Health (2015)AustraliaPathwaysBeyond Blue: Clinical Practice Guidelines for Depression and Related Disorders – Anxiety, Bipolar Disorder and Puerperal Psychosis – in the Perinatal Period (2011)AustraliaGuidelinesHourihan,71 2003Pharmacist-Administered Cardiovascular Risk Screening Protocol (1999)AustraliaProtocolsMultiple International, Australian and New South Wales Guidelines on Heart, Diabetes, Exercise, Smoking and Pharmacy (1986–2000)International; AustraliaGuidelinesKinsman,60 2012Local Acute Myocardial Infarction Clinical Pathway (2008)AustraliaPathwaysNational Heart Foundation of Australia Guidelines (2006)AustraliaGuidelinesLineker,55 2019The Getting a Grip on Arthritis Best Practice Guidelines for Osteoarthritis and Rheumatoid Arthritis (2012)CanadaGuidelinesMultiple International and Canadian Osteoarthritis and Rheumatoid Arthritis guidelines (2004–2011)International; CanadaGuidelinesMiller,82 2022Rural Accelerated Chest Pain Pathway (2018)New ZealandPathwaysNew Zealand Metropolitan-Based Accelerated Diagnostic Pathways (2018)New ZealandPathwaysMitchell,80 2020Local Protocol for Clonidine Use for Long-Acting benzathine Benzylpenicillin G Administration (2018)AustraliaProtocolsAustralian Guideline for the Prevention, Diagnosis, and Management of Acute Rheumatic Fever and Rheumatic Heart Disease - 2nd Edition (2012)AustraliaGuidelinesPhillips,69 2015Tasmanian HealthPathways (2014)AustraliaPathwaysNew Zealand HealthPathways (2008)New ZealandPathwaysReeve,57 2014Local Ear Health Pathway (2010)AustraliaPathwaysKimberley Ear Health Guidelines (2008)AustraliaGuidelinesSally,39 2024Queensland Government: Community Acquired Pneumonia Clinical Care Pathway (2021)AustraliaPathwaysAustralian Therapeutic Guidelines: Antibiotic Version 16 (2023)AustraliaGuidelinesTolmay,58 2024Southland Modified Rural Colorectal ERAS Protocol (2014)New ZealandProtocolsEnhanced Recovery After Surgery (ERAS) Society Guidelines for Perioperative Care in Elective Colorectal Surgery (2012)InternationalGuidelinesWest,66 2024The Remote Management of High Flow Nasal Cannula Therapy in Paediatric and Adolescent Patients (2021)AustraliaGuidelinesChildren’s Health Queensland Hospital and Health Service: Nasal High Flow Therapy – Management of the Paediatric Patient Receiving High Flow Therapy (2019)AustraliaGuidelines Details of adapted clinical guidance resources and their base resources (N=13) Contextualization A total of 36 CGRs (64%) were contextualized for rural and remote settings. These included CGRs that were newly developed (de novo), adapted from other contexts, or updated from previous versions. The remaining 20 CGRs (36%) were not contextualized; they were all adopted directly from other contexts and implemented without modification. Consumer input There were 9 (16%) studies in which consumers and/or the community were directly engaged in the development of the CGRs or the planning of their implementation. They were involved in 2 (4%) development-only studies, 4 (5%) implementation-only studies, and 3 (7%) studies that evaluated both phases. Development studies Systematic evidence reviews and theoretical frameworks Among the 21 development studies, 11 (52%) described conducting a systematic review of the literature as part of the CGR development process. Only 3 (14%) reported using a recognized guideline development tool to support the planning or reporting of the CGR. Each of the following tools was used once: the Australian National Health and Medical Research Council’s Guide to the Development, Implementation and Evaluation of Clinical Practice Guidelines (1999), the End-of-Life Care First Nations Journey Mapping Tool, and a modified Delphi technique was used to reach consensus on a guideline.38,83 None of the development studies reported using a recognized tool to conduct a quality assessment of the CGRs they produced. Implementation studies Strategies employed All 52 implementation studies employed more than one implementation strategy. The most common rationale provided for selecting specific strategies was theory-based reasoning (n = 25, 48%), in which strategies are matched to pre-identified determinants of implementation, with 6 of these incorporating a literature review to inform their choices. One-third of the studies (n = 17, 33%) selected strategies based on stakeholder preferences. No rationale was provided in 19 studies (n = 37%). The applied strategies operated on 3 levels: individual (n = 52, 100%), organizational (n = 49, 94%), and broader systems (n = 23, 44%). Three studies (6%) focused solely on the individual level, 26 (50%) targeted both individual and organizational levels, and 23 (44%) addressed all 3 levels. The 9 ERIC implementation strategies categories (cluster groups) from most to least frequently used are described in the following paragraphs.18 The combinations of strategies used in each study are presented in Appendix V and in more detail in the Supplemental Digital Content: http://links.lww.com/SRX/A183. Four categories of implementation strategies were used in more than half of the studies: train and educate stakeholders (n = 48, 92%); adapt and tailor to context (n = 44, 85%); develop stakeholder interrelationships (n = 38, 73%); and use evaluative and iterative strategies (n = 38, 73%). These categories were frequently represented through specific strategies such as developing and distributing CGRs alongside educational materials; modifying CGRs and implementation approaches to suit local contexts; conducting centralized and outreach training sessions; forming multidisciplinary and multi-organizational teams to oversee CGR development and implementation; appointing local implementation leaders; providing feedback from file audits to health services; and using iterative processes in workshops and committee meetings. Three additional categories were used in at least one-third but fewer than half of the studies: change infrastructure (n = 23, 44%), provide interactive assistance (n = 22, 42%), and support clinicians (n = 17, 33%). Common strategies in these groups included modifying record-keeping systems, facilitating clinical supervision, and ensuring timely delivery of clinical data to providers. The final 2 categories, engage consumers (n = 11, 21%) and utilize financial strategies (n = 7, 13%), were used in fewer than one-fourth of the studies. These strategies typically involved consumers in project activities and securing new funding sources. Outcomes measured Of the 52 implementation studies, 42 (81%) measured implementation outcomes, 50 (96%) measured health service outcomes, and 22 (42%) measured patient health outcomes. Feasibility emerged as the most frequently assessed implementation outcome, appearing in over half of the studies (n = 27, 52%), followed by acceptability (n = 22, 42%), appropriateness (n = 14, 27%), and adoption or uptake (n = 13, 25%). Outcomes such as sustainability (n = 8, 15%), penetration or coverage (n = 3, 6%), costs (n = 2, 4%), and fidelity (n = 2, 4%) were reported less often. In terms of health service outcomes, efficiency dominated the reporting landscape (n = 47, 90%), while safety (n = 16, 31%), timeliness (n = 11, 21%), patient-centeredness (n = 7, 13%), equity (n = 5, 10%), and effectiveness (n = 1, 2%) were also measured. Patient health outcomes were less commonly measured, with clinical or health status (n = 15, 29%) and satisfaction (n = 10, 21%) being the most reported. Symptoms (n = 4, 8%) and function (n = 1, 2%) were rarely assessed. A breakdown of which individual outcomes from each category were measured in each of the included studies is presented in Appendix V and in more detail in the Supplemental Digital Content: http://links.lww.com/SRX/A183. Theoretical frameworks Most implementation studies (n = 46, 88%) did not report using any theory, model, or framework to guide their implementation evaluations. The Australian National Health and Medical Research Council guidelines (1999), which predate the formal development of the implementation science field, were used in 1 study to guide their implementation efforts.83 Another 5 studies (10%) employed a recognized tool from implementation science to support their evaluation processes: 3 (5%) used the Promoting Action on Research Implementation in Health Services (PARiHS) framework; 1 (2%) used the Reach, Effectiveness, Adoption, Implementation, and Maintenance (RE-AIM) framework; and 1 (2%) applied the Plan-Do-Study-Act (PDSA) cycle.84-86 Discussion The relatively small number of studies conducted in Canada (n = 7, 13%) compared to Australia (n = 46, 82%) was unexpected, particularly given Canada’s larger population and similarly extensive rural and remote land mass. This is especially puzzling given that the population is larger and less urbanized in Canada than in Australia.87,88 It suggests that this area of scientific inquiry is underrepresented in Canadian research. Aotearoa NZ (n = 3, 5%) has a significantly smaller population and land mass than the other countries, which may account for the limited number of included studies. Development of clinical guidance resources Generation and contextualization The CGRs used in rural and remote areas in this review were relatively evenly distributed across the 4 generation methods: adoption, adaption, de novo (new), and updated. However, adoption (36%) was the most common approach. This may suggest that many CGRs implemented in these settings are not specifically designed to be fit-for-purpose. Despite this, the review found that a higher proportion of CGRs had been contextualized—either through adaptation, de novo development for rural and remote use, or periodic updates. Collectively, these contextualized CGRs accounted for 64% of the total. Given the likelihood of publication bias, where studies involving unmodified CGRs may be underreported due to limited novelty or detail, it is probable that the actual proportion of contextualized CGRs in use in rural settings is lower than 64%. Quality assessment A clear finding from this review is that CGRs developed for use in rural and remote settings are not being subjected to formal quality assessment to establish validity, reliability, or usability. Numerous tools exist for this purpose, including those from the AGREE group; Grading of Recommendations Assessment, Development and Evaluation (GRADE); International Centre for Allied Health Evidence (iCAHE) Guideline Quality Checklist; Reporting Items for Practice Guidelines in Healthcare (RIGHT); or Checklist for the Reporting of Updated Guidelines (CheckUp).89-93 None of the included studies reported using any of these tools, nor did they provide a rationale for the absence of quality testing. The systematic survey conducted by Yao et al.19 found just 33 papers published internationally in the period from 2010 to 2020 that reported use of a tool for developing their CPGs, and only 13 studies that had used recognized tools for CPG reporting or assessment after development. It is, therefore, rare for developed CGRs to be quality tested in any context. In the rural and remote areas investigated in our review, it is not happening at all. Implementation of clinical guidance resources Implementation strategies The 4 ERIC categories of implementation strategies that were used in 70% or more of the included studies were train and educate stakeholders, adapt and tailor to context, develop stakeholder interrelationships, and use evaluative and iterative strategies. The most frequently reported implementation strategies from the umbrella review for all countries and contexts performed by Pereira et al.20 were educational materials, educational meetings, reminders, auditing and feedback, and academic detailing. They used a different taxonomy system for implementation strategies (EPOC)94 in which academic detailing is equivalent to outreach training sessions. As such, the only strategy that was not also present in the rural and remote setting from their list was reminders, which falls into the “support clinicians” ERIC category. This would indicate that, by and large, the same strategies are being used in rural and remote contexts compared to what is described in the broader context by academic literature. Efforts to identify and count individual implementation strategies using the ERIC taxonomy were ultimately abandoned due to the numerous, ambiguous, and overlapping definitions, as well as inconsistent terminology across studies. Nonetheless, it was evident that all studies employed more than 1 implementation strategy according to the ERIC list. For example, any study that developed and distributed a CGR would be classified as using 2 distinct strategies within the “train and educate” category. As a result, no comparison could be made between studies using single vs multiple strategies, as has been done in other systematic reviews. This may reflect the reality that implementing change in rural and remote settings often requires a broader range of strategies due to the increased complexity and resource limitations compared to urban areas. Similarly, all implementation plans included strategies targeting individual practitioners, which is essential for effecting change through CGRs. The 3 studies that focused exclusively on the individual level all provided training and education to practitioners for CGRs that were being adopted within health services. Nearly half of the studies selected strategies based on identified barriers and/or enablers—referred to here as theory-based approaches (n = 25, 48%). An updated scoping review of guideline implementation in all countries and contexts by Peters et al.13 found that 50% of their included studies used theory-based approaches and that 60% of those consulted literature, whereas we found that only 24% had used a literature review for this purpose. This could be explained by the smaller amount of literature conducted in rural and remote contexts that would be useful in identifying barriers and facilitators to implementation. None of the studies in our review clearly articulated the mechanisms of change by which the strategies were expected to address implementation determinants, nor did they investigate whether those mechanisms were realized. No studies employed logic models or tested proposed mechanisms of change. This is perhaps unsurprising, given that such investigations are uncommon even in urban settings where more resources are typically available.95 Theoretical frameworks Peters et al.13 found that 21% of their studies referred to theories or frameworks, compared to 12% of implementation studies in our review. The higher proportion reported in the study by Peters et al. is likely influenced by their search period (2014–2021), by which time implementation science had become more established, with a greater number of theories and frameworks available and increased awareness of their usefulness. Evaluation methodologies This review has shown that evaluations of CGRs that are used in rural and remote areas have employed both experimental and observational study designs. The 2 most frequently used designs were before-and-after studies and qualitative case studies, which were often combined in a mixed methods approach. Due to the inherent complexity of rural and remote contexts, and the relative lack of resources, conducting rigorous experimental research is often challenging. Notably, there were few studies that included control groups, particularly in the before-and-after studies, resulting in a limited body of empirical evidence. However, given the pragmatic and context-specific nature of CGRs, the use of observational, real-world evaluations is both appropriate and valuable. Descriptive studies play a crucial role in capturing and disseminating insights into what has worked well, or less well, in the development and implementation of CGRs. Strengths and limitations of the review This review deviated from the original protocol in several ways, which are acknowledged and explained in this paper. The review is strengthened by the absence of time restrictions in the search strategies, the inclusion of clinical practice protocols and pathways alongside guidelines, and the consideration of both development and implementation evaluations. An additional strength is the production and provision of an evidence map that shares all the extracted data in the form of a spreadsheet (see the Supplemental Digital Content: http://links.lww.com/SRX/A183). As with all scoping reviews, our search strategy may have failed to identify all relevant studies, especially from gray literature. A major limitation was the lack of consistent and standardized terminology across the sources. Only studies that explicitly used the search terms to describe their settings were captured, potentially excluding relevant studies or including those that used terms inappropriately. Such limitations may have contributed to the underrepresentation of Canadian studies in the review. A few studies were excluded because they did not describe the implementation effort anywhere in the published material or state that the resource was designed for rural and remote contexts within the article, despite the authors knowing that this was the case as they were from the Australian context where we work. Decisions such as these also serve to highlight the commitment of the authors to the objective application of the inclusion criteria. Many studies did not align clearly with the taxonomies used in our classifications, requiring the review team to interpret and assign categories based on their understanding of the descriptions provided. This was particularly important when classifying study designs, implementation strategies, and outcomes measured. Due to these inconsistencies, it was not feasible to count individual implementation strategies reliably. An additional limitation was the frequent lack of detail in the descriptions of intervention development and implementation processes. The inclusion of studies authored by self-described clinicians enriched the practical relevance of the evidence. However, their limited familiarity with rigorous study designs and academic taxonomies in some papers contributed to methodological and reporting limitations described previously. Limiting the review to Australia, Canada, and Aotearoa NZ may restrict the generalizability of findings to other rural and remote health contexts, as differences in health systems and policy environments in other countries were not captured. Recommendations for research Further investigations A systematic review of the included studies, incorporating quality appraisal, would provide valuable insights into the relative effectiveness of rural and remote CGRs, and whether their development or implementation approaches are associated with improved outcomes. Further research is also needed to explore exactly how national guidelines are adapted for, and used within, rural and remote contexts, as this remains an underexamined but critical area. It would be helpful to understand how clinicians use CGRs in practice, and the factors that encourage or discourage their use in these contexts. Additionally, similar scoping reviews could be conducted in other settings, either at the country level (eg, United States) or across broader regions (eg, low- and middle-income countries, the Global South) and compared to our findings. Investigating how international guidelines are adapted to suit rural and remote contexts in these locations would further enrich the global evidence base. Gaps The timeline shows that there has been no appreciable acceleration in research output in this area since studies first started to appear in 2001. This is unusual given the growing prominence of CGRs and the expansion of implementation science over the same period. This stagnation, particularly evident in the Canadian literature, suggests that the development and implementation of CGRs in rural and remote settings remains an under-researched area. This inevitably compromises health outcomes in rural and remote communities, and potentially perpetuates or even exacerbates health inequities. This review has shown that there is a notable gap in the use of best-practice tools for the development and quality assessment of guidelines, such as AGREE II, GRADE, or ADAPTE, in the evaluation of CGRs. Additionally, implementation science theories and frameworks are rarely applied, limiting the ability to systematically understand and improve implementation processes. Addressing these conceptual and methodological gaps could enhance the rigor and practical relevance of future evaluations. To address the challenge of missing control groups, study designs such as the stepped wedge design should be considered. Additionally, more hybrid implementation-effectiveness studies would be particularly useful, as they investigate both the implementation process and the outcomes together, providing insight not only into whether CGRs work, but also how and why they succeed or fail in real-world settings. Conclusions This scoping review provides the first comprehensive overview of how CPGs, protocols, and pathways used in the rural and remote areas of Australia, Canada, and Aotearoa NZ are developed, implemented, and evaluated. The findings reveal that CGRs in these settings are generated in various ways, with adoption from other contexts being the most common method of sourcing a CGR for use. However, nearly two-thirds were contextualized—either through adaptation, de novo development, or periodic updates—all of which reflect efforts to tailor CGRs to local needs. While slightly more than half the development studies reported using systematic reviews, few used recognized guideline development tools, and none employed widely accepted frameworks such as AGREE, GRADE, or ADAPTE. Formal quality assessments of CGRs were notably absent, with no studies reporting the use of recognized appraisal tools. Implementation strategies employed in this review were typically multi-level and non-singular, commonly combining strategies such as training, contextual adaptation, stakeholder engagement, and iterative feedback. The rationale for selecting implementation strategies was often unclear, with strategies only being matched to pre-identified barriers in half the studies. The implementation studies measured implementation, health service, and patient health outcomes, with feasibility, service efficiency, and health status being the most reported in each category. Theoretical frameworks were rarely used to guide implementation evaluations, and no studies tested or even articulated mechanisms of change. This review found that evaluations of CGRs in rural and remote settings primarily used before-and-after studies and qualitative case studies, often within mixed methods designs. While rigorous experimental research was rare due to contextual and resource constraints, observational and descriptive approaches provided valuable real-world insights into CGR implementation and effectiveness Overall, while CGRs are being actively contextualized and used in rural and remote contexts, there is a need for more rigorous CGR development, quality assessment, and theory-informed implementation and evaluation to strengthen their design and utility. Acknowledgments LA is a recipient of a Flinders University PhD scholarship through the College of Medicine and Public Health. The protocol and review will form part of the PhD thesis. Global priority and equity alignment This scoping review aligns with the United Nations Sustainable Development Goal 3 (Good Health and Well‑Being) by examining how CGRs are developed, implemented, and evaluated to support effective health care delivery in rural and remote settings. By focusing on contexts with significant geographic and health inequities, including areas with high proportions of First Nations populations, the review also aligns with Sustainable Development Goal 10 (Reduced Inequalities) through its attention to health system practices intended to address disparities in access, quality, and outcomes. Author contributions LA contributed to conceptualization, methodology, data curation, title and abstract screening, full-text screening, data extraction, translation, formal analysis, visualization, writing of the original draft, review and editing of the manuscript. SH and GH contributed to methodology, data curation, title and abstract screening, full-text screening, data extraction, formal analysis, review, and editing of the manuscript. MB contributed to methodology, data curation, title and abstract screening, full-text screening, review and editing of the manuscript. SZ and NM contributed to full-text screening, data extraction, review and editing of the manuscript. AB, OB and JAS contributed to methodology, formal analysis, review and editing of the manuscript.