Improving access to specialist care in correctional facilities through Ontario eConsult Authors: Danica Goulet, Claire Sethuram, Erin Keely, Clare Liddy, Andrea K. Knittel, Andrea K. Knittel, Andrea K. Knittel Published: 2024 ABSTRACT ObjectivesTo evaluate the accessibility of multispecialty advice for primary care providers (PCPs) within correctional facilities, catering to the healthcare needs of individuals in federal custody in Ontario, Canada, through the utilization of electronic consultation (eConsult).DesignRetrospective, cross-sectional, descriptive analysis.SettingeConsults submitted by PCPs within federal correctional facilities through the Ontario eConsult Service between April 1st, 2019, and March 31st, 2023.Participants906 completed eConsults were submitted by 21 PCPs in correctional facilities.ResultsThe top three specialties sent to were cardiology (46%, N = 417), dermatology (14%, N = 128), and endocrinology and metabolism (8%, N = 68). The median specialist response time was 0.9 days. The median time specialists spent responding to each case was 15 minutes. PCPs received advice on a new or additional course of action in 34% of eConsult cases. In-person specialist appointments were avoided in 81% of cases.ConclusionsOntario eConsult provides an ideal venue to improve access to multispecialty advice for people who are incarcerated. This service reduces the need for face-to-face specialist visits, decreases cost-of-care, and avoids unnecessary transportation outside of correctional facilities with potential security issues. Introduction Every year, there are over 80,000 adult admissions to correctional facilities in Ontario, Canada [1], and on an average day, more than 10,000 persons are held in custody [2, 3]. Of those held in custody, approximately 68% serve sentences of less than two years under provincial/territorial custody, while the remaining 32% serve sentences of over two years under federal custody [4]. Compared to the general population, persons in custody within Canadian correctional facilities experience higher rates of mortality, suicide, and chronic health conditions, as well as increased utilization of ambulatory care, emergency departments, medical-surgical hospitalization, and psychiatric hospitalization [5, 6]. They also face significantly lower life expectancies and higher rates of latent tuberculosis, sexually transmitted infections, hepatitis C, HIV, and other blood-borne infections than the general population [5, 7]. Many of these diseases require specialist care; however, people who are incarcerated face significant challenges accessing it, including transportation to in-person appointments and the requirement for a minimum of two prison officers to accompany each incarcerated individual outside of the correctional facility [5, 8]. This not only results in additional costs for the department of corrections, but also leads to logistical challenges such as transfers between institutions, ultimately causing missed appointments and long wait times. Improving access to care for incarcerated individual is crucial, as it can significantly enhance their health outcomes and reduce the burden of disease. In June 2018, an approach to improve access to care was implemented in Ontario, which allows primary care providers (PCPs) to send questions to specialists regarding a patient’s care on a secure web-based application through the Ontario eConsult Service, facilitating asynchronous communication between clinicians [9]. Specialists respond in one day on average, and two-thirds of cases are resolved without the patient needing a face-to-face specialist appointment [10]. eConsult has the potential to address issues with access to care across a range of health system contexts including correctional settings [11–13]. A scoping review by Sethuram et al. (2022) identified 13 unique electronic consultation systems serving incarcerated individuals within correctional facilities across six countries, including Canada, with evidence that the use of electronic consultation in this setting is feasible, beneficial, cost-effective, increases access to care, has a positive impact on clinical care, and avoids unnecessary transportation of incarcerated individuals outside of the facilities and potential security issues [14]. While eConsult is currently operating in many correctional facilities worldwide, it is worth noting that more than half of them (7 out of the 13) provide access to a single specialty group exclusively, with dermatology and ophthalmology being the most common [14]. This contrasts with the Ontario eConsult Service described here, where PCPs in correctional facilities have access to over 120 specialties offered province-wide. In this study, we evaluated the utilization patterns and accessibility of multispecialty advice through Ontario eConsult for PCPs in correctional facilities and measured the impact of eConsult on the care of incarcerated populations across the province. The volume of eConsults sent, the range of accessed specialties, and the impact of the eConsult on the need for face-to-face referrals were examined to demonstrate the benefit of eConsult and serve as a template for broader implementation across Canada and in other jurisdictions. Methods Design We conducted a retrospective, cross-sectional descriptive analysis of eConsults sent by PCPs in federal correctional facilities across Ontario, Canada. This study was submitted to the Ottawa Health Science Network Research Ethics Board (OHSN-REB) as a Quality Improvement study. The OHSN-REB waived its review, thus exempting the project from requiring full ethics approval. The ethics committee determined that this study falls under program evaluation and waived the requirement for informed consent for this study as it is a secondary data analysis. Setting The Ontario eConsult Service operates within Canada’s most densely populated province, home to over 14 million individuals [15], representing nearly 40% of the entire Canadian population, and served by approximately 15,000 family physicians [16] and 5,000 nurse practitioners [17]. Identical to other provinces in Canada, Ontario administers a Medicare program that is federally funded but managed at the provincial level and offers healthcare services to residents without any cost. Ontario Health is connected to communities and provider partners through six regions: West, Central, Toronto, East, North East, and North West. These regions serve as administrative divisions to facilitate the coordination and delivery of healthcare services across the province. The Ontario eConsult Service is accessible to all PCPs in Ontario, including those working in institutionalized settings. In Canada, the administration of correctional services is a shared responsibility between the federal and the provincial/territorial governments [4]. The Correctional Service of Canada is responsible for the federal system and has jurisdiction over adults who are incarcerated serving custodial sentences of two or more years, whereas adults serving custodial sentences that are less than two years, or who are being held while awaiting trial or sentencing, fall under the authority of the provincial/territorial correctional service programs [4]. The province of Ontario is responsible for 8 federal institutions, seven for men and one for women, where the majority (6 out of 8) are located in the Ontario Health East region. It is also important to note the Coronavirus-19 (COVID-19) outbreak emerged during our study period, where the World Health Organization (WHO) declared it a pandemic on March 11, 2020, recognizing its widespread and severe impact on public health and economies worldwide. The Ontario eConsult Service The Ontario eConsult Service was implemented in Ontario in June 2018, enabling PCPs to communicate with specialists securely and asynchronously via an electronic platform. This service allows PCPs to consult specialists with clinical questions about their patients, providing timely advice on patient management and often eliminating the need for in-person specialist visits. The PCP submitting the eConsult has access to specialists in two models, through a managed specialty group model, where the case is assigned to a specialist from the chosen group, or direct-to-specialist (DTS). The Ontario eConsult Service is funded by the province’s Ministry of Health and is provided to PCPs across Ontario at no charge. In fact, PCPs are remunerated at a flat rate per case, and specialists are remunerated at an hourly rate prorated to their self-reported billing time. Data collection eConsult utilization data from the Ontario eConsult Service is routinely collected from the service. At the end of each eConsult case, PCPs complete a mandatory close-out survey to evaluate (1) whether the specialist response confirmed their original course of action or provided them with new or additional information, and (2) the eConsult’s impact on the need for a face-to-face referral. Data analysis Descriptive statistics were used to analyze the last four years of Ontario eConsult data (April 2019 to March 2023). Time stamps for each eConsult communication were assessed to examine the response interval for specialist responses, and self-reported time billed was used to determine the amount of time each specialist spent responding to the eConsult. Results During the study period, 906 completed eConsults were submitted by PCPs in federal correctional facilities. A total of 21 PCPs submitted at least 1 eConsult, with 12 being family physicians and 9 nurse practitioners. All 21 submitting PCPs practice in correctional facilities in the Ontario Health East region. Of the 21 PCPs, 67% submitted 10 or more eConsults and 33% sent more than 50 eConsults during the study period. In addition, 44% of eConsults (N = 397) were submitted by delegates (i.e., administrative support) on behalf of the PCP. The number of eConsults sent increased more than 2-fold from the initial 12 months to the last 12 months of the study period (Fig 1). Volume of eConsults sent by fiscal year (FY) (N = 906). PCPs were submitted directly to a specialist, through the DTS model (62%, N = 563), more frequently than to a managed specialty group (38%, N = 343). Of the 30 specialties accessed by PCPs, the top three specialties sent to were cardiology (46%, N = 417), dermatology (14%, N = 128), and endocrinology and metabolism (8%, N = 68). The most frequently accessed specialties are outlined in Fig 2. Speciality distribution of eConsults sent (N = 906). A total of 178 specialists answered at least 1 eConsult from the 906 completed eConsult cases during the study period. The median specialist self-reported billing time was 15 minutes per case (interquartile range (IQR): 10). Of the 906 completed eConsults, the median response time was 0.9 days (IQR: 1.8) with 95% answered within 7 days, and 100% of cases answered within 30 days or less. PCPs completed the close-out survey for 890 of the 906 closed cases. Survey results indicated PCPs were able to confirm a course of action they originally had in mind in 580 cases (65%) and received advice on a new or additional course of action in 304 cases (34%) (Fig 3). In addition, a referral for a face-to-face specialist visit was first contemplated but now avoided as a result of the eConsult in 485 cases (54%) and was still not needed in 27% of cases (N = 237) (Fig 4). Alternatively, PCPs stated they initially contemplated a referral and still found it necessary after the eConsult in 143 cases (16%) (Fig 4). Outcome of eConsult cases (N = 890). Referral outcome of eConsult cases (N = 890). Discussion Our study demonstrates the effective provision of prompt, multispecialty advice for PCPs within correctional facilities, catering to the healthcare needs of individuals in federal custody via the Ontario eConsult Service. Contrary to the majority of eConsult solutions serving incarcerated individuals worldwide [14], the Ontario eConsult Service provides PCPs access to over 120 specialties province-wide. Cardiology emerged as the most frequently accessed specialty in our study, accounting for 46% of all eConsults from correctional facilities. This contrasts dramatically with the most frequently accessed specialty by the general public at the provincial level during the same time period—dermatology—which accounted for 15% of all eConsults, whereas cardiology, which ranked at number 8, accounted for 4% of all eConsults. The high demand for access to cardiology in our study is believed to be due to PCPs in correctional facilities seeking cardiologists’ guidance regarding cardiac testing for people who are incarcerated undergoing opioid agonist treatment (OAT) for treating opioid use disorder. This is supported by the Centre of Addiction and Mental Health (CAMH) Opioid Agonist Therapy guidelines, where they recommend conducting a baseline ECG and consulting a cardiologist if a patient undergoing OAT exhibits a prolonged QTc interval [18]. Our hypothesis was also validated by a cardiologist who regularly responds to eConsults, in which they communicated that the predominant nature of eConsults originating from correctional facilities revolves around the adjustment of OAT dosages and calculations related to QT and QTc intervals, and the assessment of other medication lists such as stimulants and antipsychotics to ensure the risk of proarrhythmia remains low (A cardiologist, email communication, July 2023). As of March 2023, the Correctional Service of Canada has reported that 765 incarcerated individuals in federal prisons in Ontario are undergoing OAT, while an additional 11 remain on the waitlist [19]. With a median specialist turnaround time of less than one day, Ontario eConsult allows PCPs to confidently enroll people who are incarcerated in OAT, knowing that they have rapid and timely access to essential cardiology advice. This efficient specialist advice offered through the eConsult platform helps PCPs make well-informed decisions about the implementation and management of OAT for incarcerated individuals, improving care quality and promoting a safer and more effective approach to opioid-related issues in federal prisons. Poor access to specialist care, decreased patient safety, long wait times, and adverse patient outcomes due to unnecessary transfers and potentially missed referrals are amongst the many previously identified gaps in care within correctional facilities [5, 20]. eConsult not only brings incarcerated individuals the advantage of timely specialist advice, but also presents substantial benefits to the justice system. Approximately 81% of PCPs in our study agreed that a face-to-face referral was not needed following the eConsult, in which 54% had originally intended to refer the patient for an in-person specialist visit prior to the eConsult. Reducing the need for in-person referrals and providing specialist advice through eConsult relieves the department of corrections from escorting the patient, which typically requires at least two prison officers to accompany each incarcerated individual [8]. It also addresses the challenge of waiting for a specialist appointment, especially if the person who is incarcerated is frequently changing institutions. Furthermore, registration and utilization of Ontario eConsult demand minimal training. Start-up costs are virtually non-existent due to the presence of pre-existing technical infrastructure for the service, eliminating the need for additional equipment. This streamlined process mitigates potential security issues and logistical complexities that arise from an in-person specialist appointment, ultimately leading to cost savings for the correctional facilities. In addition, there are similarities between the environments of correctional facilities and long-term care homes, as both encounter obstacles transporting patients outside of their institutions. A previous study demonstrated the efficacy of eConsult in improving access to specialist advice for those living in long-term care [21]. eConsult not only averted unnecessary transfers and reduced costs, but also augmented PCPs’ capacity to deliver patient-centered care in accordance with individual care objectives. To our knowledge, Ontario eConsult is the only service in Canada that allows PCPs in correctional facilities to communicate asynchronously with specialists on behalf of their patients. With this service only available in correctional facilities in Ontario, there is potential to expand eConsult to federal and provincial/territorial correctional facilities in the country’s remaining nine provinces and three territories. Of the five countries outside of Canada offering an eConsult solution that serves incarcerated individuals, 511 eConsult requests were initiated in France for 450 adult patients across 8 prison health centers participating in the network of tele-expertise in dermatology between June 2014 and June 2015 [22]. The median response time was 5.0 days, and dermatologists spent less than 6 minutes in their response in 50% of cases. Following the tele-expertise in dermatology for incarcerated individuals, only 2.9% of patients later required a face-to-face appointment or hospitalization [22]. Tele-expertise was well accepted among physicians with the majority of responders (N = 9/10) willing to continue using it [22]. Additionally, a pilot study carried out in Western Australia assessed the effectiveness of their online eye care system within correctional facilities [23]. The study successfully transmitted data from 11 patients, and the consulting ophthalmologist provided advice within 24 hours [23]. This not only expedited the process but also resulted in a cost savings of A$440 per medical consultation [23]. Similarly, our study revealed that specialists dedicated a median of 15 minutes to address the eConsults, with a noteworthy median response time of 0.9 days from the moment the eConsult was submitted, underscoring the prompt accessibility of specialist advice for people who are incarcerated in federal custody. The potential expansion of multispecialty eConsult services beyond Canada’s borders holds the promise of enhancing the access to healthcare for incarcerated individuals. However, it is important to note that potential challenges for implementation have been identified, including regulatory issues, initial start-up costs, the need for administrative support, and addressing the demands of training and technical intricacies [24–26]. Nevertheless, the prevailing sentiment in the literature remains consistently positive, lending strong support for the use of eConsult in correctional settings. Lastly, there was a remarkable surge in the utilization of Ontario eConsult by PCPs in correctional facilities during the COVID-19 pandemic in Ontario (Fig 1). The volume of eConsults increased by 59% from the fiscal year 2019–2020 (pre-COVID-19) to 2020–2021 (post-onset of the COVID-19 pandemic). Interestingly, during the same two-year period, there was a simultaneous decrease of 9% in the average counts of incarcerated individuals in federal custody in Ontario [3]. An increase in the utilization of eConsult during the pandemic time frame was also observed outside of correctional facilities in Ontario, where case volumes in the community increased by 71% between February 2020 and November 2020 [10]. The COVID-19 pandemic led to the closure of numerous specialist offices during lockdown, or the restriction of outpatient services exclusively to essential visits. Consequently, there emerged a notable upsurge in the utilization of virtual tools such as eConsult by PCPs seeking specialist advice for their patients, both inside and outside of correctional facilities. Limitations Our eConsult data represents only one segment of the country and may not be fully generalizable to the national or international context. The study relied on valuable utilization data and survey results; however, future studies should incorporate additional data sources such as case logs, patient-level data, or electronic medical record surveys. Conclusions Ontario eConsult has a positive impact in correctional facilities and reduces the need for face-to-face referrals. This valuable tool is cost-effective, improves access to specialist care for people who are incarcerated, and eliminates unnecessary transportation with potential security concerns. Results of this study serve as a template for broader implementation, thereby supporting its uptake by additional correctional facilities in Ontario and across Canada. The results of this study will also aid in the implementation of eConsult in similar institutionalized settings, such as psychiatric hospitals and long-term care homes, where access to care and transportation of patients remains a challenge. Future studies should explore the types of questions being asked by PCPs in correctional facilities and include an economic analysis to evaluate the cost savings and benefits of eConsult in these institutions. This information would better support decision makers and advocates to implement eConsult in correctional facilities across Ontario and Canada. 6 Oct 2024 PONE-D-24-21042Improving access to specialist care in correctional facilities through Ontario eConsultPLOS ONE Dear Dr. Liddy, Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process. Of particular note, one of the reviewers highlights the importance of using humanizing language for people/patients who are incarcerated. The US Centers for Disease Control and Prevention offer a concise list of recommended language: https://www.cdc.gov/healthcommunication/Preferred_Terms.html. Please pay special attention to review for non-essentializing, humanizing language in addition to addressing the other concerns raised by the reviewers. Please submit your revised manuscript by Nov 20 2024 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file. Please include the following items when submitting your revised manuscript:A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'. A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'. A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'. A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'. A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'. An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'. An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'. If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter. If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols. We look forward to receiving your revised manuscript. Kind regards, Andrea Knittel Academic Editor PLOS ONE Journal requirements: When submitting your revision, we need you to address these additional requirements. 1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf 2. Please provide additional details regarding participant consent. In the ethics statement in the Methods and online submission information, please ensure that you have specified (1) whether consent was informed and (2) what type you obtained (for instance, written or verbal, and if verbal, how it was documented and witnessed). If your study included minors, state whether you obtained consent from parents or guardians. If the need for consent was waived by the ethics committee, please include this information. If you are reporting a retrospective study of medical records or archived samples, please ensure that you have discussed whether all data were fully anonymized before you accessed them and/or whether the IRB or ethics committee waived the requirement for informed consent. If patients provided informed written consent to have data from their medical records used in research, please include this information Once you have amended this/these statement(s) in the Methods section of the manuscript, please add the same text to the “Ethics Statement” field of the submission form (via “Edit Submission”). For additional information about PLOS ONE ethical requirements for human subjects research, please refer to http://journals.plos.org/plosone/s/submission-guidelines#loc-human-subjects-research. 3. Thank you for stating the following financial disclosure: “Funding for this project was provided by the Ontario Ministry of Health and Long-Term Care (MOHLTC). The opinions, results, and conclusions reported in this paper are those of the authors and are independent of the funding sources. No endorsement by the Ontario MOHLTC is intended or should be inferred.” Please state what role the funders took in the study. If the funders had no role, please state: "The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript." If this statement is not correct you must amend it as needed. Please include this amended Role of Funder statement in your cover letter; we will change the online submission form on your behalf. 4. Thank you for stating the following in the Acknowledgments Section of your manuscript: “Funding for this project was provided by the Ontario Ministry of Health and Long-Term Care (MOHLTC). The opinions, results, and conclusions reported in this paper are those of the authors and are independent of the funding sources. No endorsement by the Ontario MOHLTC is intended or should be inferred.” We note that you have provided funding information that is currently declared in your Funding Statement. However, funding information should not appear in the Acknowledgments section or other areas of your manuscript. We will only publish funding information present in the Funding Statement section of the online submission form. Please remove any funding-related text from the manuscript and let us know how you would like to update your Funding Statement. Currently, your Funding Statement reads as follows: “Funding for this project was provided by the Ontario Ministry of Health and Long-Term Care (MOHLTC). The opinions, results, and conclusions reported in this paper are those of the authors and are independent of the funding sources. No endorsement by the Ontario MOHLTC is intended or should be inferred.” Please include your amended statements within your cover letter; we will change the online submission form on your behalf. 5. Thank you for stating the following in the Competing Interests section: “EK is the Executive Director and CL is the Evaluation Lead of the Ontario eConsult Centre of Excellence, which is responsible for the Ontario eConsult program, with both receiving salary support from the Ontario Ministry of Health. EK answers occasional eConsults (less than 1 per month) as a specialist through the service, for which she is reimbursed.” Please confirm that this does not alter your adherence to all PLOS ONE policies on sharing data and materials, by including the following statement: "This does not alter our adherence to PLOS ONE policies on sharing data and materials.” (as detailed online in our guide for authors http://journals.plos.org/plosone/s/competing-interests). If there are restrictions on sharing of data and/or materials, please state these. Please note that we cannot proceed with consideration of your article until this information has been declared. Please include your updated Competing Interests statement in your cover letter; we will change the online submission form on your behalf. 6. We note that your Data Availability Statement is currently as follows: [All relevant data are within the manuscript and its Supporting Information files.] Please confirm at this time whether or not your submission contains all raw data required to replicate the results of your study. Authors must share the “minimal data set” for their submission. PLOS defines the minimal data set to consist of the data required to replicate all study findings reported in the article, as well as related metadata and methods (https://journals.plos.org/plosone/s/data-availability#loc-minimal-data-set-definition). For example, authors should submit the following data: - The values behind the means, standard deviations and other measures reported; - The values used to build graphs; - The points extracted from images for analysis. Authors do not need to submit their entire data set if only a portion of the data was used in the reported study. If your submission does not contain these data, please either upload them as Supporting Information files or deposit them to a stable, public repository and provide us with the relevant URLs, DOIs, or accession numbers. For a list of recommended repositories, please see https://journals.plos.org/plosone/s/recommended-repositories. If there are ethical or legal restrictions on sharing a de-identified data set, please explain them in detail (e.g., data contain potentially sensitive information, data are owned by a third-party organization, etc.) and who has imposed them (e.g., an ethics committee). Please also provide contact information for a data access committee, ethics committee, or other institutional body to which data requests may be sent. If data are owned by a third party, please indicate how others may request data access. [Note: HTML markup is below. Please do not edit.] Reviewers' comments: Reviewer's Responses to Questions Comments to the Author 1. Is the manuscript technically sound, and do the data support the conclusions? The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented. Reviewer #1: Yes Reviewer #2: Yes ********** 2. Has the statistical analysis been performed appropriately and rigorously? Reviewer #1: Yes Reviewer #2: Yes ********** 3. Have the authors made all data underlying the findings in their manuscript fully available? The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified. Reviewer #1: Yes Reviewer #2: Yes ********** 4. Is the manuscript presented in an intelligible fashion and written in standard English? PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here. Reviewer #1: Yes Reviewer #2: Yes ********** 5. Review Comments to the Author Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters) Reviewer #1: Thank you for the opportunity to review this paper, which adds to the important body of work demonstrating the value of provider-to-provider eConsult services, in this case for a particularly vulnerable group. I have a few comments the authors may consider for strengthening the work. Introduction 1. I was curious about the sentence acknowledging poorer health outcomes among offenders and the statement about latent TB, sexually transmitted infections, Hep C, HIV and other blood borne infections, does this sentence capture the poorer health outcomes experienced by offenders? I would have expected poorer physical health, mental health and premature mortality more broadly among the group. 2. Can you provide a couple of examples of the single speciality eConsult services operating in correctional facilities. Methods 1. It is not clear what the average number of eConsults sent per 1,000 offenders adds to the paper, especially considering the associated limitation outlined in the limitations section. Further clarification and explanation are needed in the methods and results sections about eConsults sent per 1,000 offenders, this would help clarify the statement in the discussion on page 13 that the “The volume of eConsults increased by 59% from the fiscal year 2019-2020 (pre-COVID-19) to 2020-2021…”. 2. I wondered if a table comparing the top 5 or so specialties for this setting with those at the provincial level would be of interest to readers. Minor typos On page 7. Two instances where “renumeration” should be “remuneration”. Reviewer #2: Thank you for allowing me to review this paper. The paper presents descriptive data on the use of eConsults in the Ontario Federal Bureau of Prisons. I appreciate that the authors realized that access to timely specialist care is important. (1) Although I appreciate that in the world of prisons, "offender" is the term used to describe people, this term has not been common in research literature for at least a decade. I found the overall approach to this paper as set up in the introduction to be related to cost-savings rather than actually giving people who are incarcerated what they deserve. (2) The actual research aspect of this paper is limited: it is a descriptive study showing before/after uptake of speciality consults. There is no discussion of the systems used to educate clinicians about the EConsult, or evaluations of how the use of econsult different between clinicians or institutions. (3) There is no discussion about the problems with eConsult for people in jail/prison or their opinions of it. My experience as a clinician specialist going to the jails/prisons is that people who are incarcerated prefer to see someone in person. They feel they get better care. It is more humanizing. I could find NO voice from the perspectives of any one incarcerated as a threat in this whole paper. (4) The first paragraph of the discussion iterates what was already reported in the introductions. It also takes up over a page and is incredibly dense. (5) The item "referral avoided" is in the Figure 4. What is "referral avoided"? (6) I cannot tell if the authors mean "eConsult" as a proprietary item? Does this mean sending a consult request electronically? Telehealth is going on all over the world for people who are in prison. Just one site I found describing this for 2021. https://csgjusticecenter.org/2021/04/12/three-things-to-know-about-implementing-telehealth-in-correctional-facilities/. It feels like the authors of the paper really did not investigate what is going on for telehealth in other setting before writing this paper. ********** 6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy. Reviewer #1: No Reviewer #2: No ********** [NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.] While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step. 12 Nov 2024 Editor Comment 1 Of particular note, one of the reviewers highlights the importance of using humanizing language for people/patients who are incarcerated. The US Centers for Disease Control and Prevention offer a concise list of recommended language: https://www.cdc.gov/healthcommunication/Preferred_Terms.html Response We have addressed the use of the term 'offender' throughout the manuscript, replacing it with ‘people who are incarcerated’ or 'incarcerated individuals' to align with the recommended non-stigmatizing language for this this population. Editor Comment 2 Please include the following items when submitting your revised manuscript: - A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'. - A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'. - An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'. Response - A rebuttal letter was uploaded and labeled “Response to Reviewers” - A marked-up copy of the manuscript was uploaded and labeled “Revised Manuscript with Track Changes” - An unmarked version of the revised manuscript without tracked changes was uploaded and labeled “Manuscript” Editor Comment 3 Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. Response The manuscript was revised to meet PLOS ONE’s style requirements. Editor Comment 4 Please provide additional details regarding participant consent. In the ethics statement in the Methods and online submission information, please ensure that you have specified (1) whether consent was informed and (2) what type you obtained (for instance, written or verbal, and if verbal, how it was documented and witnessed). If your study included minors, state whether you obtained consent from parents or guardians. If the need for consent was waived by the ethics committee, please include this information. If you are reporting a retrospective study of medical records or archived samples, please ensure that you have discussed whether all data were fully anonymized before you accessed them and/or whether the IRB or ethics committee waived the requirement for informed consent. If patients provided informed written consent to have data from their medical records used in research, please include this information. Once you have amended this/these statement(s) in the Methods section of the manuscript, please add the same text to the “Ethics Statement” field of the submission form (via “Edit Submission”). Response A statement on the specified consent was added to the methods section. The same text was added to the Ethics Statement field of the submission form. Editor Comment 5 In the financial disclosure, please state what role the funders took in the study. If the funders had no role, please state: "The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript." Please include this amended Role of Funder statement in your cover letter; we will change the online submission form on your behalf. If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter. Response The role of the funders was added to the Financial Disclosure, and the amended Role of Funder statement was added to our cover letter. Editor Comment 6 We note that you have provided funding information that is currently declared in your Funding Statement. However, funding information should not appear in the Acknowledgments section or other areas of your manuscript. We will only publish funding information present in the Funding Statement section of the online submission form. Please include your amended statements within your cover letter; we will change the online submission form on your behalf. Response Funding information was removed from the Acknowledgements section and was added to our cover letter. Editor Comment 7 In the Competing Interests section, please confirm that this does not alter your adherence to all PLOS ONE policies on sharing data and materials, by including the following statement: "This does not alter our adherence to PLOS ONE policies on sharing data and materials.” Please include your updated Competing Interests statement in your cover letter; we will change the online submission form on your behalf. Response The statement was added to the Competing Interests section and is updated in our cover letter. Editor Comment 8 Please confirm at this time whether or not your submission contains all raw data required to replicate the results of your study. Authors must share the “minimal data set” for their submission. PLOS defines the minimal data set to consist of the data required to replicate all study findings reported in the article, as well as related metadata and methods (https://journals.plos.org/plosone/s/data-availability#loc-minimal-data-set-definition). For example, authors should submit the following data: - The values behind the means, standard deviations and other measures reported; - The values used to build graphs; - The points extracted from images for analysis. Authors do not need to submit their entire data set if only a portion of the data was used in the reported study. If your submission does not contain these data, please either upload them as Supporting Information files or deposit them to a stable, public repository and provide us with the relevant URLs, DOIs, or accession numbers. For a list of recommended repositories, please see https://journals.plos.org/plosone/s/recommended-repositories. If there are ethical or legal restrictions on sharing a de-identified data set, please explain them in detail (e.g., data contain potentially sensitive information, data are owned by a third-party organization, etc.) and who has imposed them (e.g., an ethics committee). Please also provide contact information for a data access committee, ethics committee, or other institutional body to which data requests may be sent. If data are owned by a third party, please indicate how others may request data access. Response A minimal dataset cannot be provided due to the potential presence of identifiable information and because the data is owned by a third-party organization (Ontario Health). Data requests can be made through the following form: https://form.asana.com/?k=zmEBJuRNGb9_YLGOXyqYLg&d=423266023889752 Reviewer #1 Comment 1 I was curious about the sentence acknowledging poorer health outcomes among offenders and the statement about latent TB, sexually transmitted infections, Hep C, HIV and other blood borne infections, does this sentence capture the poorer health outcomes experienced by offenders? I would have expected poorer physical health, mental health and premature mortality more broadly among the group. Response We have revised the literature in the introduction to better capture the poorer health outcomes experienced by incarcerated individuals. This includes citations that compare their health outcomes—such as physical health, mental health, and premature mortality—with those of the general population. We appreciate your input in helping us provide a more comprehensive understanding of this important issue. Reviewer #1 Comment 2 Can you provide a couple of examples of the single speciality eConsult services operating in correctional facilities. Response We have included examples of single specialty eConsult services currently operating in correctional facilities in the introduction of the revised manuscript. Reviewer #1 Comment 3 It is not clear what the average number of eConsults sent per 1,000 offenders adds to the paper, especially considering the associated limitation outlined in the limitations section. Further clarification and explanation are needed in the methods and results sections about eConsults sent per 1,000 offenders, this would help clarify the statement in the discussion on page 13 that the “The volume of eConsults increased by 59% from the fiscal year 2019-2020 (pre-COVID-19) to 2020-2021…”. Response Upon further reflection, we agree that the comparison does not contribute meaningfully to the paper, and we have decided to remove it. Our study focuses solely on volume of eConsults in Ontario’s correctional facilities rather than a comparison with the general public. Therefore, presenting cases per 1,000 is not adding to the paper, especially given the associated limitations. Reviewer #1 Comment 4 I wondered if a table comparing the top 5 or so specialties for this setting with those at the provincial level would be of interest to readers. The top five specialties accessed by the general public are dermatology (15%), hematology (8%), obstetrics and gynecology (7%), endocrinology and metabolism (7%), and internal medicine (6%). Response We highlighted the only key differences from the general population in the discussion. Specifically, cardiology was the top specialty accessed in the correctional setting, accounting for half of all eConsults, while dermatology, the most frequently accessed specialty by the general public, accounted for 15%. And that cardiology ranks 8th among the general public. Reviewer #1 Comment 5 On page 7. Two instances where “renumeration” should be “remuneration”. Response We have corrected both instances of 'renumeration' to 'remuneration' on page 7. Reviewer #2 Comment 1 Although I appreciate that in the world of prisons, "offender" is the term used to describe people, this term has not been common in research literature for at least a decade. I found the overall approach to this paper as set up in the introduction to be related to cost-savings rather than actually giving people who are incarcerated what they deserve. Response We have addressed the use of the term 'offender' throughout the manuscript, replacing it with ‘people who are incarcerated’ or 'incarcerated individuals' to align with the recommended non-stigmatizing language for this this population. Additionally, we have highlighted the importance of access to care and its impact on improving outcomes for people who are incarcerated in the introduction. Reviewer #2 Comment 2 The actual research aspect of this paper is limited: it is a descriptive study showing before/after uptake of speciality consults. There is no discussion of the systems used to educate clinicians about the EConsult, or evaluations of how the use of econsult different between clinicians or institutions. Response The primary objective of this paper was to examine eConsult use within this specific setting (correctional facilities) and population (incarcerated individuals). However, we have published over 100 peer reviewed papers addressing the value of the eConsult service including educational value, its utilization, and its effects on access to specialist care across several Canadian jurisdictions. Additionally, we have also thoroughly explored the types of clinical questions posed through eConsult across various specialties. For a comprehensive list of our publications, please refer to our website: https://www.champlainbaseeconsult.com/publications Reviewer #2 Comment 3 There is no discussion about the problems with eConsult for people in jail/prison or their opinions of it. My experience as a clinician specialist going to the jails/prisons is that people who are incarcerated prefer to see someone in person. They feel they get better care. It is more humanizing. I could find NO voice from the perspectives of any one incarcerated as a threat in this whole paper. Response Thank you for your insightful comment. This is a great point and direction for future research. The acceptability of eConsults is indeed an important area to explore and would require different methodologies, such as surveys or interviews, followed by qualitative analysis. Understanding the perspectives of incarcerated individuals is crucial for providing patient-centered care and assessing patient experience. While this has not been done in the incarcerated population yet, a relevant study has been conducted by our team with the general population (https://www.champlainbaseeconsult.com/_files/ugd/ac5147_750c12a1d8184014a78f11b059f0d24f.pdf?index=true). Our current paper focuses on eConsult service utilization for people who are incarcerated, and as such focuses on the metrics of service utilization. Reviewer #2 Comment 4 The first paragraph of the discussion iterates what was already reported in the introductions. It also takes up over a page and is incredibly dense. Response We acknowledge that the first paragraph of the discussion was dense, and we have revised it to enhance clarity and readability. Additionally, we have removed any content that overlapped with the introduction. Reviewer #2 Comment 5 The item "referral avoided" is in the Figure 4. What is "referral avoided"? Response “Referral avoided” refers to instances where a primary care provider initially considered making a referral but ultimately decided against it due to the guidance provided by the eConsult. To clarify the survey responses, we have revised Fig 4 and expanded on each response in the figure for better understanding. Reviewer #2 Comment 6 I cannot tell if the authors mean "eConsult" as a proprietary item? Does this mean sending a consult request electronically? Telehealth is going on all over the world for people who are in prison. Just one site I found describing this for 2021. https://csgjusticecenter.org/2021/04/12/three-things-to-know-about-implementing-telehealth-in-correctional-facilities/. It feels like the authors of the paper really did not investigate what is going on for telehealth in other setting before writing this paper. Response Thank you for your inquiry. Some electronic consultation (eConsult) systems across the world are privatized/commercialized, however the Ontario eConsult Service described in this paper is not; it is a provincially available service offered through the Ontario Ministry of Health. It allows primary care providers (PCPs) to submit consult requests electronically to specialists across the province of Ontario. To clarify, eConsult is a type of telehealth that facilitates electronic asynchronous communication between clinicians over a secure, web-based platform. It enables PCPs to communicate and collaborate with specialists to get timely advice on how to manage their patients, often eliminating the need for an in-person visit with the specialist. We have added more detail in the introduction and methods section to better explain the eConsult process and its benefits. Submitted filename: Response to Reviewers.docx 18 Nov 2024 Improving access to specialist care in correctional facilities through Ontario eConsult PONE-D-24-21042R1 Dear Dr. Liddy, We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements. Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication. An invoice will be generated when your article is formally accepted. Please note, if your institution has a publishing partnership with PLOS and your article meets the relevant criteria, all or part of your publication costs will be covered. Please make sure your user information is up-to-date by logging into Editorial Manager at Editorial Manager® and clicking the ‘Update My Information' link at the top of the page. If you have any questions relating to publication charges, please contact our Author Billing department directly at authorbilling@plos.org. If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org. Kind regards, Andrea K. Knittel, MD PhD Academic Editor PLOS ONE 21 Nov 2024 PONE-D-24-21042R1 PLOS ONE Dear Dr. Liddy, I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now being handed over to our production team. At this stage, our production department will prepare your paper for publication. This includes ensuring the following: * All references, tables, and figures are properly cited * All relevant supporting information is included in the manuscript submission, * There are no issues that prevent the paper from being properly typeset If revisions are needed, the production department will contact you directly to resolve them. If no revisions are needed, you will receive an email when the publication date has been set. At this time, we do not offer pre-publication proofs to authors during production of the accepted work. Please keep in mind that we are working through a large volume of accepted articles, so please give us a few weeks to review your paper and let you know the next and final steps. Lastly, if your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org. If we can help with anything else, please email us at customercare@plos.org. Thank you for submitting your work to PLOS ONE and supporting open access. Kind regards, PLOS ONE Editorial Office Staff on behalf of Dr. Andrea K. Knittel Academic Editor PLOS ONE