Analysis of a Pilot Study Delivering Cancer Survivorship Education to Community Healthcare Professionals Utilizing the Project ECHO Model Authors: Ashley Pariser Davenport, Kevin Johns, Dena Champion, Andrea Roberts, Susan Fugett, Erin Holley, Candice Schreiber, Carolyn J Presley, Jalyn Todd, Andrew Honeychuck, Katherine Hunt, Yurong Lu, Bhuvaneswari Ramaswamy, Seuli Bose Brill Published: 2024 ABSTRACT ABSTRACTAs the number and needs of cancer survivors grow, innovative ways to enhance survivorship expertise are needed. This pilot study evaluated a 12-week cancer survivorship curriculum delivered to two cohorts of providers at affiliated sites within the Mercy Health System, utilising the Project ECHO® model, on provider self-efficacy (SE), knowledge (KN), and professional improvement (PI). Providers received six 1-hour sessions, informed by provider needs assessment, over 12 weeks. Participants completed pre- and post-session surveys evaluating SE, KN, and PI domains. The average score for survey items overall and within each domain was compared in pre- and post-session survey results. Twenty-six participants completed the baseline survey and 22 completed the post-session survey. For cohort 1, the overall score (0.94, 95% CI [0.45,1.42] p = 0.0023), SE (1.1, [95% CI [0.5,1.7] p = 0.003), and KN domain (1.03, 95% CI [0.45,1.62] p = 0.0036) scores significantly increased. For cohort 2, the overall score (0.617, 95% CI [0.042,1.193] p = 0.0378), SE (0.728, 95% CI [0.048,1.407] p = 0.0379), and KN domains (0.665, 95% CI [0.041,1.289] p = 0.0387) increased significantly. The PI score did not change for either cohort (PI −0.09, 95% CI [−0.67, 0.49] p = 0.726 and 0.000, 95% CI [−0.790,0.790] p > 0.999). This Cancer Survivorship ECHO pilot resulted in a statistically significant increase in provider self-efficacy and knowledge. All 22 participants rated the Cancer Survivorship ECHO pilot experience as having a positive (greater than neutral) result on their training. The Cancer Survivorship ECHO model may serve as a scalable strategy for building cancer survivorship care capacity in community-based oncology practices by equipping multidisciplinary teams to meet the needs of cancer survivors within their communities. Further research is needed to assess the implementation of this model in novel settings and evaluate its impact on patient outcomes and professional improvement.KEYWORDS: Cancer survivorship, project ECHO, community providers, telehealth, continuing medical education Introduction Approximately 2 million people in the United States (US) will receive a new diagnosis of cancer in 2023, with 1 in 2 men and 1 in 3 women expected to be diagnosed with invasive cancer within their lifetime. As therapeutic advances have extended life expectancy after cancer diagnosis, the oncology clinician workforce capacity has remained stagnant, creating major access gaps for cancer survivors seeking guideline-concordant survivorship care [1]. Unfortunately, multiple barriers to expanding cancer care capacity to address these gaps persist, including cost, workforce shortages, and increasing complexity of clinical care and care coordination [2]. These barriers disproportionately impact patients living in rural areas, who as a result have poorer short- and long-term health outcomes after cancer diagnosis compared to those living in urban areas. Limited access to healthcare infrastructure, oncologic support services, and education are just three known inequities facing patients living with cancer in rural areas [3]. Multiple models for survivorship care delivery exist, but the ideal survivorship model has yet to be elucidated. In academic settings, specialist-led post-treatment models remain predominant [4–7]. With only 21% of all oncology practices based in the academic setting and studies showing that upwards of 24% of all Medicare beneficiaries travel longer than 1 hour for their oncologic care, access to survivorship care in the US remains unequal [8,9]. A known barrier to the implementation of other survivorship models (for example, those led by primary care physicians or shared care) is a perceived lack of cancer-specific knowledge and skills [10]. Enhancing continuing education opportunities for non-academic oncology, non-oncology, and non-physician providers has been listed by multiple studies as well as professional societies as a potential strategy for improving survivorship care [4,10,11]. Project ECHO® is a hub-and-spoke model that utilises a web-based platform (Zoom) for content delivery through short didactics and case-based discussions. Project ECHO was initially developed to enhance access to hepatitis C treatment for patients living in New Mexico [12]. Since its inception, it has been adopted and modified to enhance the training of healthcare professionals in a diverse array of community settings. The Project ECHO Cancer website currently highlights 108 hubs in 27 countries utilising the model to engage community providers on topics related to cancer prevention, screening, or treatment [13]. Our pilot study’s objective was to assess the feasibility of a collaboration between an academic comprehensive cancer centre in Central Ohio and a multistate network (Bon Secours-Mercy Health) to deliver survivorship education to oncology providers. Materials and Methods This cohort pilot study evaluated a 12-week cancer survivorship curriculum, delivered utilising the Project ECHO model, on provider self-efficacy (SE), knowledge (KN), and professional improvement (PI). It was created in partnership with research leadership at Bon Secours-Mercy Health. This facilitated site identification and optimised recruitment of interested sites with the ability to provide protected time to participants. Community oncology providers were recruited from two community hospitals within a multistate network (Bon Secours-Mercy Health). As survivorship care requires a team-based approach, all providers involved in direct patient care were invited to participate [5]. This is in alignment with our previous work, as well as other Project ECHO sites, that enrolled participants with diverse professional backgrounds [14]. Enrolled participants included the following occupations: physicians, advanced practice providers, nurses, social workers, patient navigators, clinical research coordinators, pharmacists, and oncology quality supervisors. Informed consent was obtained from all individual participants in this study. A previously developed needs assessment based on American Society of Clinical Oncology (ASCO) and National Comprehensive Cancer Network (NCCN) guidelines and aligned with the four established tenets of survivorship care – surveillance, prevention, assessment and treatment of late effects, and care coordination – was utilised [15]. The needs assessment was delivered securely via REDCap to interested, eligible participants at each cohort site. The needs assessment invited participants to indicate their level of interest in 18 cancer survivorship topics on a 5-point Likert scale ranging from very uninterested to very interested. The following are examples of included topics: management of cancer-related fatigue, management of chemotherapy-induced neuropathy, and management of anxiety and depression in cancer survivors. The six topics of highest interest for each cohort were selected for the Cancer Survivorship ECHO curriculum. For each cohort, six 1-hour sessions were delivered via Zoom over 12 weeks. The format of each session was aligned with the Project ECHO model and consisted of a didactic lecture followed by a case discussion. Didactic lectures were presented, and case discussions were moderated by a multidisciplinary panel. All sessions were eligible for continuing medical education (CME) credit. The multidisciplinary panel consisted of experts in medical oncology, psychiatry, social work, nutrition, and physical therapy. As appropriate, additional specialists were recruited for individual sessions to enhance the panel’s expertise. All experts were involved in didactic content development. All consenting participants were invited to complete pre- and post-surveys. Our survey was adapted from surveys previously validated by the Project ECHO Institute. These surveys were amended to address provider knowledge and comfort in key survivorship competencies. Differences in participants’ pre- and post-intervention surveys determined changes in provider comfort with, and knowledge of, core cancer survivorship competencies. Areas assessed in the survey include professional satisfaction, patient access to survivorship care, provider ability to identify and counsel patients on survivorship care, and knowledge and ability to address the four core tenets of survivorship care with patients. This survey evaluated self-efficacy (SE) in cancer survivorship care, knowledge (KN) of cancer survivorship care, and professional improvement (PI). Each question consisted of a 5-point Likert scale, with 1 reflecting the lowest level of agreement, confidence, or knowledge and 5 reflecting the highest level of agreement, confidence, or knowledge. To optimise survey collection, REDCap was utilised for secure delivery and collection. A gift card was offered to all participants for completion of both the pre- and post-session surveys. In addition to the pre- and post-surveys, an optional formative feedback form was provided after each session with the CME survey. Likert scale characteristics were summarised using frequencies (proportions), and character ordinal categories for each survey question were recoded to numerical values. Linear mixed models were used for the average score comparisons between pre- and post-session surveys for SE, KN, PI, and overall comparison. A P-value ≤0.05 was considered statistically significant. The statistical analysis for this study was performed in Statistical Analysis System (version 9.4, SAS Institute Inc., Cary, NC) with the MIXED procedure. Comparison figures were created in RStudio (R version 4.2.1) (23 June 2022 ucrt). Results A total of 28 participants enrolled, with 14 consenting participants in each cohort. The first cohort included providers at a standalone, community oncology practice in Greenville, SC. The following occupations were represented in cohort 1: physician (1), advanced practice provider (3), nurse (4), social worker (2), dietitian (1), clinical research coordinator (1), pharmacist (1), and oncology quality supervisor (1). The second cohort included providers at a community oncology practice affiliated with a community hospital in Lima, OH. Cohort 2 had the following breakdown by occupation: advanced practice provider (3), nurse (8), dietitian (1), and patient navigator (2). Except for one session, all sessions had ≥ 85% attendance. Topics of highest interest on the needs assessment were prioritised and selected for curriculum development and delivery. Both cohorts prioritised the following topics: Adjusting to and Preparing Patients for Survivorship (Survivorship 101), Cancer-Related Fatigue, and Anxiety and Depression. Additional topics selected by cohort 1 included Chemo Brain, Neuropathy, and Sexual Health, while cohort 2 selected Risk of Recurrence, Nutrition Myths, and Bone Health. All participants were invited to provide formative feedback on CME surveys provided after each session. The multidisciplinary panel met periodically throughout the study to reflect on and assess programme development and implementation. In cohort 1, there was minimal active participation from participants. The bulk of the discussion and all cases were presented by members of the multidisciplinary panel. This resulted in the implementation of more active learning strategies for cohort 2’s curriculum. For example, the sign-in list was utilised to encourage and invite all participants of the session to provide feedback on didactics, case discussions, and embedded group think-share opportunities. In contrast to cohort 1, cohort 2 participants provided and presented all but one case discussion. Data from both pre- and post-session surveys was available for 22 of 28 enrolled participants (78.5%). For cohort 1, 13 participants completed the survey for this pilot study. One did not complete the pre-session survey and three did not complete the post-session survey. The average scores for the overall score and each domain (SE, KN, PI) are summarised in Table 1. The average overall score increased significantly (0.94, 95% CI [0.45, 1.42] p = 0.002). Additionally, the average score for the SE and KN domains increased significantly: SE (1.10, 95% CI [0.50,1.70] p = 0.003) and KN (1.03, 95% CI [0.45, 1.62] p = 0.004). PI did not change: PI (PI −0.09, 95% CI [−0.67, 0.49] p = 0.726. Table 1.Survey results for cohort 1: professional improvement (PI), self-efficacy (SE), knowledge (KN), and overall score. Pre-session SurveyPost-session SurveyChanges* NMeanSTDNMeanSTDMean (95% CI)P valuePI(2Qs)124.5420.582104.4500.599−0.09 (−0.67,0.49)0.726SE(8Qs)122.9170.679104.0130.5081.10 (0.50,1.70)0.003KN(8Qs)122.5310.681103.5630.4651.03 (0.45,1.62)0.004Overall(18Qs)122.9260.563103.8610.3990.94 (0.45,1.42)0.002Abbreviations: STD: standard deviation; CI: confidence interval.*based on linear mixed model for repeated data, SAS software (version 9.4, SAS Institute Inc., Cary, NC) MIXED procedure. Survey results for cohort 1: professional improvement (PI), self-efficacy (SE), knowledge (KN), and overall score. Abbreviations: STD: standard deviation; CI: confidence interval. *based on linear mixed model for repeated data, SAS software (version 9.4, SAS Institute Inc., Cary, NC) MIXED procedure. For cohort 2, 14 participants completed the pre-session survey for this study. Two participants did not complete the post-session survey. The average scores for each domain (SE, KN, PI) are summarised in Table 2. The overall average, SE, and KN scores all increased significantly from the pre- to post-session survey. Changes in mean score were (0.62, 95% CI [0.04, 1.19] p = 0.038), (0.73, 95% CI [0.05, 1.41] p = 0.038), and (0.67, 95% CI [0.04, 1.29] p = 0.039), respectively. The average PI score did not change from the pre- to post-session survey (0.00, 95% CI [−0.79, 0.79] p ≥ 0.999). Table 2.Survey results for cohort 2: professional improvement (PI), self-efficacy (SE), knowledge (KN), and overall score. Pre-session SurveyPost-session SurveyChanges* NMeanSTDNMeanSTDMean (95% CI)P valuePI(2Qs)144.0000.941124.0000.8790.00 (−0.79,0.79)>0.999SE(8Qs)143.3660.923124.0940.5790.73 (0.05,1.41)0.038KN(8Qs)142.9910.791123.6560.6260.67 (0.04,1.29)0.039Overall(18Qs)143.2720.735123.8890.5710.62 (0.04,1.19)0.038Abbreviations: STD: standard deviation; CI: confidence interval.*based on linear mixed model for repeated data, SAS software (version 9.4, SAS Institute Inc., Cary, NC) MIXED procedure. Survey results for cohort 2: professional improvement (PI), self-efficacy (SE), knowledge (KN), and overall score. Abbreviations: STD: standard deviation; CI: confidence interval. *based on linear mixed model for repeated data, SAS software (version 9.4, SAS Institute Inc., Cary, NC) MIXED procedure. The post-session survey included four questions that evaluated the impact of ECHO on participants’ professional isolation and satisfaction and patient access to care (Table 3). For cohort 1, a total of 10 participants completed the post-session survey; for cohort 2, a total of 12 completed it. All 22 participants agreed that the Cancer Survivorship ECHO had a positive effect (average score of 3.4 for cohort 1 and 3.8 for cohort 2) on their training. Table 3.Summary for post-session survey only questions. Cohort 1Cohort 2Post-session Survey Questions OnlyNMeanQ1MedianQ3NMeanQ1MedianQ3ECHO has diminished my professional isolation.103.73.04.04.0123.83.54.04.0My participation in ECHO has enhanced my professional satisfaction.103.93.84.04.3124.64.05.05.0My participation in ECHO is a benefit to my place of employment.104.13.84.05.0124.84.55.05.0ECHO has expanded access to cancer survivorship care for patients in our community.103.43.03.04.0123.83.04.04.0Abbreviations: Q1: quarter 1; Q3: quarter 3. Summary for post-session survey only questions. Abbreviations: Q1: quarter 1; Q3: quarter 3. Except for PI, all post-session survey scores were significantly higher than pre-session survey scores for both cohorts 1 and 2. Discussion The Project ECHO model utilises a low-cost, technology-based, hub-and-spoke model embedded in grounded and situated learning theory. It has the potential to rapidly disseminate knowledge and expertise to providers throughout the world [16–19]. Our pilot study is the first to highlight the potential of an academic-community healthcare provider collaboration to enhance cancer survivorship education utilising the Project ECHO model to meet the site-specific educational needs of community oncology providers. It highlights the successful implementation of a new Project ECHO hub in Central Ohio and builds upon the growing body of literature demonstrating the feasibility of the Project ECHO model to enhance provider knowledge in guideline-based cancer survivorship practices [14,15,20]. Furthermore, it highlights the potential of such partnerships to continue to enhance access to educational opportunities attuned to provider-, site-, and community-specific needs. Our study was able to demonstrate the successful implementation of levels 1 through 4 of Moore’s framework – participation, satisfaction, learning, and competence – as demonstrated. Furthermore, our pilot highlights the potential of academic-community partnerships to enhance recruitment and participation. A community co-design approach was utilised to align research and educational goals between the hub and community sites [21]. Research leadership at Bon Secours-Mercy Health and cohort site leaders were engaged and provided feedback from design through implementation of our study. This facilitated site identification, optimising the recruitment of interested sites with the ability to provide protected time to participants. Our Cancer Survivorship ECHO builds upon previous work developing a novel, multidisciplinary Project ECHO hub [15]. Several modifications were made to address the limitations of the previous study. These included enhanced protected time for participants, REDCap utilisation for secure delivery and collection of surveys, CME credit for each attended session, and gift card offerings to all participants for completion of both the pre- and post-session surveys. Because of these modifications, our results demonstrate enhanced session attendance (greater than 85% for 11 of the 12 sessions) and availability of data from both pre- and post-session surveys for enrolled participants (78.5%). Our study had several limitations. First, as a pilot study of a novel Project ECHO hub in cancer survivorship, only 2 cohort sites were enrolled with a small overall sample size. Although our study found similarities in findings between cohort sites, future work is needed to confirm these findings in additional community sites. Additionally, our study did not show a change in professional improvement (PI) in either cohort. As there were only two questions that assess PI on both the pre- and post-survey, this likely reflects a ceiling effect given the pre-session survey score of 4.542 ± 0.582; however, future research is needed to determine why no effect on PI was found. Ourcohort recruitment and the delivery of ECHO sessions were site-based, which required project administrators to become familiar with different delivery resources. However, this site-specific approach also had the potential advantages of team building and highlighting site- and community-specific resources. Furthermore, this approach allowed for buy-in from multiple key stakeholders including leadership and resulted in excellent session attendance. To our knowledge, no study has evaluated the efficacy of the site-specific versus multi-site ECHO spoke model. With multiple demands on providers’ time, this approach may reduce barriers to participation and presents an opportunity for ongoing academic-community collaborations for enhancing access to survivorship care. Enhancing access to guideline-based survivorship care remains an important, unmet need. As cancer survivors are a heterogeneous and growing population with distinct short- and long-term health needs, novel models and frameworks that allow for risk-based delivery of care that meet the individual needs of patients while also balancing known workforce shortages are needed [22,23]. Cancer survivorship education has not been included in formalised training. Thus, our research seeks to enhance patient access to cancer survivorship care through recruitment, training, and support of a diverse population of healthcare providers. Our Cancer Survivorship ECHO pilot demonstrated the feasibility of utilising a co-design approach to develop and implement a new Project ECHO programme with improvement in provider self-efficacy, knowledge, and overall scores on pre- and post-session surveys. While this pilot study recruited community oncology providers from two community sites, the cancer survivorship ECHO model has the potential to be a central strategy for addressing survivorship workforce issues by increasing capacity within all community oncology settings. Additionally, this model may have broad applicability to other settings (for instance, primary care) to enhance the capacity to meet the needs of all survivors including long-term and low-risk survivors. Future research to evaluate its replicability in expanded sites, as well as feasibility and patient outcomes, will advance understanding of the utility of this model for enhancing survivorship care delivery. Applying our community-based co-design approach will be critical in ensuring that future applications address the local needs of stakeholders and will be central to the implementation strategy [21]. Novel partnerships with a team-based approach are feasible to rapidly disseminate knowledge to all providers engaged in direct patient care. Additional research on the implementation of the Project ECHO platform in novel environments as well as ongoing assessments of the impact of these programmes on patient care outcomes are needed. Acknowledgments The authors would like to thank Angela Dahlberg, Editor in The Ohio State University Division of Medical Oncology, for editing the manuscript. Funding Statement This work was supported by The Ohio State University Office of Health Sciences and the Center for Clinical & Translational Science Path to K award under [Grant # GR123938]. The content is solely the responsibility of the authors and does not necessarily represent the official views of the university or the Center for Clinical and Translational Science. Disclosure Statement No potential conflict of interest was reported by the author(s). Author Contributions All authors contributed to the study’s conception and design. Material preparation, data collection, and analysis were performed by Ashley Pariser Davenport, Jalyn Todd, and Yurong Lu. The first draft of the manuscript was written by Ashley Pariser Davenport and all authors commented on previous versions of the manuscript. All authors read and approved the final manuscript. Ethics Approval This study was performed in line with the principles of the Declaration of Helsinki. Approval was granted by the Institutional Review Board of the Ohio State University (IRB #2021C0115). References