Physician peer review: just culture and practical implementation in an emergency department Authors: Christian Fromm, Monica Colicino, Merle A Carter, Elizabeth M Datner Published: 2025 ABSTRACT AbstractBackgroundAlthough regulatory agencies require hospitals to engage in peer review to maintain accreditation, quality assurance review processes are not standardized, and well-structured peer review of clinical cases involving medical errors and adverse events governed by Just Culture principles is not widespread. We implemented such an emergency department (ED) physician peer review process and performed an analysis of cases that underwent review.MethodsWe formed an ED physician peer review committee at our institution guided by Just Culture principles, including promotion of a culture of safety to encourage open reporting of errors and near misses, and top-down leadership commitment to focus on identifying systemic factors contributing to human error, thereby creating opportunities for shared learning, rather than punishment and retribution. Using an existing database, we conducted a retrospective analysis of 282 clinical cases reviewed by the committee between July 2019 and June 2022, describing the sources of case referrals, case management attribution determinations, identified opportunities for improvement, post-review actions taken, and systems-related contributing factors.Results282 clinical cases were reviewed between July 2019 and June 2022. The most common sources of case referral were ED faculty (n = 108, 38.3%), external hospital departments (n = 51, 18.1%), event reporting system (n = 39, 13.8%), mortality chart reviews (n = 15, 5.3%), and ED nursing (n = 8, 2.8%). The committee determined that “most practitioners would have managed care similarly” in 142 cases (50.4%), “similarly, with opportunity to improve” in 99 cases (35.1%), and “differently” in 39 cases (13.8%). Attribution determinations and their distribution were similar between calendar years.ConclusionsThis study demonstrates that physicians can engage in a structured peer review process guided by Just Culture principles that promotes physician learning and faculty development, while also identifying competency and systems-related contributions to clinical care that enhance patient safety.Supplementary InformationThe online version contains supplementary material available at 10.1186/s12245-025-01060-6.Keywords: Physician peer review, Just culture, Medical errors, Patient safety, Quality assurance, Quality improvement, Emergency department Background The landmark 1999 Institute of Medicine report [1]. “To Err is Human” was instrumental in bringing public focus to bear on the issue of medical error occurrence in U.S. hospitals. It was a call to arms to break the cycle of inaction on identifying and preventing medical errors. Movements toward building cultures of patient safety and quality improvement ensued widely across the houses of medicine. The emergency department (ED) became a source of particular focus in these efforts, as the ED was specifically implicated in the report as being one of the hospital locations most associated with “high error rates with serious consequences” [2, 3]. In 2022, the Agency for Healthcare Research and Quality (AHRQ) published “Diagnostic Errors in the Emergency Department: A Systematic Review,” which reported nearly 6% of ED visits are misdiagnosed, with estimated 2.6 million harms from preventable errors, more than 100,000 permanent, high severity disabilities, and more than 250,000 deaths [4]. Quality improvement strategies for identifying medical errors and adverse events have included increased patient safety incident reporting [5–7] via electronic medical records and systems for anonymous reporting [8]. Commonly employed reports include systematic reviews of deaths, ED return visits, floor-to-ICU transfers, patient complaints, near misses, and internal referrals. Recent literature has questioned the utility of these measures, finding them to be poor identifiers of medical errors and adverse events [9–11]. However, there remains a paucity of quality original research in this area [12]. Despite regulatory requirements to engage in peer review activities, there is no single standard for how to conduct quality assurance review in U.S. EDs [13]. In many EDs, particularly community-based, this quality improvement work is carried out in relative isolation by an ED director or medical director [14]. Less commonly, departments have established clinical provider peer review committees to conduct reviews of clinical cases involving medical errors and adverse events using Just Culture principles [15]. We formed an ED Peer Review Committee (EDPRC), comprised of emergency medicine attending physicians, with ad hoc involvement of quality improvement staff, leadership representation from ED nursing and advanced practice providers [16], as well as senior residents during their administrative rotations [17–20]. The primary goal of the EDPRC process is to assess and improve patient care and safety. A secondary goal of the EDPRC is to identify areas for faculty development. Paramount to building the EDPRC process was promotion of Just Culture principles, as shown in Table 1, to provide reassurance to physicians that peer review is not a disciplinary process [21]. Clinicians whose cases are reviewed, as well as those performing the reviews, may be inclined to believe such a process is intended to find fault on the part of individual practitioners, engendering a culture of fear and defensiveness [22]. This can both distract the process from the crucial goal of identifying systems issues that caused or contributed to medical errors and adverse events, and inhibit the process from fostering an environment of learning and education [23, 24]. Table 1Principles of just culturePromote a culture of safetyEncourage open reporting of errors and near missesTop-down leadership commitment to open dialogue and shared learningDetermine underlying factors that contributed to errors, both systems and humanCommitment to physician anonymity in case reviewsTop-down leadership prioritization of non-punishment, non-retribution for human errorEncourage group discussion and consensus buildingFocus on identifying systemic issues and opportunities for shared learningProvide positive, constructive, educational feedback to physicians Principles of just culture We performed a retrospective analysis of cases reviewed by an EDPRC using an existing database of cases that underwent peer review, and we describe in detail implementation of a physician peer review process guided by Just Culture principles so that it may serve as a model for other EDs and hospital systems to employ. Methods We collected data for this observational study between July 2019 and June 2022 at our institution, which is comprised of three hospitals with EDs staffed by 50–55 attendings: a level 1 trauma center in an urban academic medical center, a suburban community teaching hospital, and a small suburban community hospital with approximately 90,000, 45,000, and 20,000 annual ED visits, respectively. The local Institutional Review Board determined this study does not constitute human subjects research and does not require approval or exemption. We formed an EDPRC comprised, by definition, of all emergency medicine faculty, with additional non-voting representation from ED nursing leadership, quality improvement staff, and advanced practice provider leadership, as well as rotating administrative senior resident physicians. This committee met for the first time in July 2019. The EDPRC process described here is summarized in Fig. 1. Flow chart: EDPRC process for case review The EDPRC convenes weekly at a time immediately following residency academic conference in order to maximize attendance by faculty. Additional meetings take place on an ad hoc basis during faculty meetings in order to accommodate faculty unable to attend the weekly noon meeting, such as the nocturnists. Committee meetings require a quorum of at least four faculty voting members in addition to the committee Chair and department quality and patient safety manager. Meetings are held virtually, with strict confidentiality rules provided at the beginning of each virtual meeting which includes disabling of the chat function. The proceedings, corresponding documents, reports, recommendations, and/or any associated communications made or taken are covered by the provisions of the Pennsylvania Peer Review Protection Act, the Health Care Quality Act of 1986, and any subsequent federal or state statute providing protection to peer review or related activities, and they are for confidential internal use only. Cases are reviewed to determine if the provider(s) did what a prudent provider would have done in similar circumstances. The committee was blinded to patient outcomes until after this determination was made guided by an internally developed attribution scale (Appendix 1). The EDPRC reviewed cases with adverse events, potential medical errors, and unanticipated deaths through a variety of mechanisms. The hospital electronic medical record system performs automated reporting to identify cases meeting criteria for EDPRC review, including ED return visits within 72 hours requiring hospital admission, and deaths, admissions with rapid response team activation, or ICU transfer occurring within 24 hours of arrival. All ED patient deaths are manually reviewed by rotating administrative senior resident physicians and the EDPRC Chair. Patient deaths deemed “possibly preventable” are referred for formal review. The EDPRC also reviews patient complaints via the hospital’s patient advocate office, referrals from risk management and other hospital departments, as well as cases referred by ED faculty, including self-referral. Another important source for referrals is the hospital’s patient safety incident reporting system, a web-based system (University HealthSystem Consortium Patient Safety Net – UHC PSN) that allows hospital employees to flag cases for patient safety concerns. Intrinsic to widespread utilization and success of this system is hospital and ED positive safety culture promotion, so that employees feel comfortable reporting safety incidents or medical errors. The web-based system allows them to do so anonymously. Cases referred to the EDPRC undergo evaluation guided by principles of collaboration and Just Culture. Cases are randomly assigned to reviewers to ensure equitable distribution amongst the faculty. All reviewers are educated in how to conduct reviews and must attend committee meetings prior to performing their initial case reviews. The department Chair requires faculty to conduct case reviews annually and embeds peer review participation in the “departmental engagement” component of their salary incentive plan. Faculty are assigned resident conference teaching days with required EDPRC meeting attendance to ensure consistent faculty participation, and Continuing Medical Education credits are offered. After both reviewer and practitioner are notified of an upcoming review, they must discuss the case prior to the meeting. Facilitated by the EDPRC Chair, case discussions seek to identify medical errors and adverse events, and to determine the presence or absence of practitioner-based errors, as well as system-, policy-, or process-related failures. Cases are presented to the committee from the time of patients’ arrival to the time of ED disposition. Reasons for referral, as well as patient care, events, and outcomes occurring after disposition, are withheld from attribution of care discussion in order to reduce bias. Reviewers maintain the provider’s anonymity by presenting de-identified data and documentation and by shielding their identity, pronouns, and date of patient presentation from the committee. Alternatively, during presentation of the case to the committee, the practitioner may choose to forgo anonymity and answer questions directly from committee members, then leave the meeting for the attribution determination. Anonymity facilitates the non-punitive, Just Culture environment by reducing bias during case and attribution discussions. To reduce the possibility of hindsight bias, reasons for referral, as well as subsequent patient care, events, and outcomes occurring after disposition are withheld from discussion until after the committee has reached consensus on attribution. Committee members determine practitioner attributions using our “Practitioner Peer Review Attribution Scale,” (Appendix) to decide if “most practitioners would have managed care similarly,” “most practitioners would have managed care similarly, with an opportunity to improve,” “most practitioners would have managed care differently,” or “the practitioner went above and beyond the expectation of most practitioners by providing exceptional patient care”. The rare cases in the “exceptional care” category are highlighted and communicated in departmental emails and during faculty meetings as a means to promote staff recognition and engagement. These attributions are intended to provide standardized wording to indicate the care that prudent fellow providers would be expected to provide when encountered with similar circumstances without the benefit of knowledge of subsequent patient outcomes. The attribution process is not intended to reach a legal “standard of care” determination. For determinations of “most practitioners would have managed care similarly, with an opportunity to improve” and “most practitioners would have managed care differently,” the committee also identifies specific aspects of care that contributed to the determination, such as choice of diagnostic tests, appropriateness of treatment to condition, timeliness of addressing abnormal findings or results, documentation of care, etc. Committee determinations of practitioner attribution are guided by Just Culture principles of collaboration and maintaining a non-punitive environment receptive to open discussion and thoughtful deliberation. In the rare cases consensus is not achieved through group discussion, committee members vote anonymously. The committee then assesses contribution of hospital and/or departmental operations, system, policy, and process failures, as well as opportunities for training or education of physicians and staff. The committee may also refer cases to other departmental committees (e.g. Operations Committee, Quality Council, Nursing Practice, etc.) and/or other hospital departments for their review. Where clinical or procedural proficiency is identified as a contributing factor, referrals are made to the department Chair and to those with oversight of graduate medical education and faculty development. We track trends and have found no trend which required provider remediation. We continue to track trends by type of issue and provider to identify need for intervention or remediation with individual providers. In addition to annual reporting at departmental meetings, individual faculty receive annual reports of their reviewed cases, the attributions, and how they compared against group means. The EDPRC maintains records in a secure quality assurance database that can be analyzed for patterns over time and serves as an adjunct to the Ongoing Professional Performance Evaluation (OPPE) program and as a source for Focused Practitioner Performance Evaluation (FPPE) where appropriate and at the department Chair’s discretion. During development of our EDPRC, we engaged the faculty in discussions around Just Culture, and we incorporated feedback from these discussions. During case attribution discussions, we emphasize and reinforce that the process is non-punitive and designed to identify systems, education, training, communication, and documentation issues that can be addressed for the entire faculty’s benefit through the department’s quality and professional development infrastructures. The EDPRC Chair communicates attribution determinations directly with practitioners verbally and through a standardized electronic follow-up form. This communication is structured and messaged to promote a positive culture around peer review by recognizing clinical excellence and highlighting educational opportunities in addition to identifying performance improvement opportunities. Lessons learned from case reviews are summarized and disseminated to the faculty, advanced practice providers, and resident physicians and fellows. These summaries provide de-identified information to enhance the department’s patient safety practices and quality improvement culture. The mechanisms by which these lessons are shared depends upon the urgency to disseminate them, the best context or environment to share or discuss them, as well as the appropriate dissemination vehicle. We have utilized a variety of education strategies, including faculty and staff meetings, resident and fellow meetings, email and electronic bulletin board communications, simulation workshops, faculty development sessions, as well as morbidity and mortality conferences, as shown in Table 2. Faculty members receive Continuing Medical Education credits for participating in EDPRC meetings, and they complete faculty development training sessions informed by the peer review process. Table 2Dissemination of lessons learnedLessons learnedMethod of dissemination to facultyReview of previous year data and identified opportunities for improvementEmailReview of previous year data and identified opportunities for improvementFaculty meeting (recorded)Review of previous year data and identified opportunities for improvementIncluded in faculty meeting minutes for asynchronous reviewExpectations of physician assistant supervision and documentationFaculty meeting discussion (recorded)Individual feedback regarding attribution decisionEmailIndividual communication for cases with opportunities for improvementEmail and In-personDocumentation of medical decision making and stroke careOnline learning moduleN-Acetyl Cysteine administration initiationFaculty meeting (recorded)Timely activation of catheterization laboratory resources for prehospital electrocardiogram transmissionFaculty meeting (recorded)Detection of soft tissue air and necrotizing fasciitisFaculty meeting (recorded)Faculty development session: a year in review and lessons learnedLecture (recorded) and emailMorbidity and mortality sessionsLecture − 15 sessionsEducation about newly implemented or modified process, policy or systemFaculty meetings (17)Emails Dissemination of lessons learned Faculty meetings (17) Emails Results A total of 227 cases were reviewed by the EDPRC between July 2019 and June 2022. As cases often involved multiple practitioners, the number of practitioner case attributions (282) exceeds the number of cases (227). Cases were referred to the EDPRC from multiple sources, as demonstrated in Table 3. Table 3Sources of case referralsTotal number of cases: 227ED Faculty10847.6%External Department5122.5%Event Reporting System3917.2%Mortality Chart Reviews156.6%ED Nursing83.5%ED Faculty Self-Referral41.8%ED Resident10.4%Patient Experience Survey Review10.4% Sources of case referrals 51 faculty members participated in physician peer review by serving the EDPRC as case reviewers. 61 faculty members were reviewed. The average number of cases reviewed for each faculty member was 5. Only 10 faculty had a single case reviewed. Case management attribution determinations were made in all 282 cases, as demonstrated in Fig. 2. Distribution of case management attributions In 142 cases (50.4%), the EDPRC determined that “most practitioners would have managed care similarly.” In 99 cases (35.1%), the EDPRC determined that “most practitioners would have managed care similarly, with opportunity to improve.” In 39 cases (13.8%), the EDPRC determined that “most practitioners would have managed care differently.” In 2 cases (0.7%), the EDPRC determined that “The practitioner went above and beyond the expectation of most practitioners by providing exceptional patient care.” Opportunities for improvement identified by the EDPRC, such as choice of diagnostic tests, appropriateness of treatment to condition, timeliness of addressing abnormal findings or results, and documentation of care, are listed in Table 4. Table 4Opportunities for improvementNumber of cases with opportunities for improvement: 138Choice of diagnostic tests2820.3Timeliness of addressing abnormal results of diagnostic tests139.4Timely performance of diagnostic testing1813.0Timely consultation2921.0Timeliness of diagnosis96.5Timeliness of treatment initiation1611.6Timely initiation of appropriate actions during period of clinical deterioration42.9Appropriateness of diagnosis based on evidence (i.e. H&P, diagnostic test results)2115.2Appropriateness of treatment to condition2115.2Adequacy of technique during procedure53.6Timely recognition of critical clues to patient’s condition during the period of clinical deterioration96.5Timely and adequate communication with health care team2417.4Inadequate documentation of care6244.9Adequacy of disclosure to patient/family10.7Other relevant aspects of care96.5Adequacy of supervision (resident, APC)42.9Professionalism10.7 Opportunities for improvement Actions taken by the EDPRC after reviews were completed, such as referral to other hospital departments, implementation of policy and process improvements, training and education of staff, are listed in Table 5. Table 5Post-review actionsTotal number of post-review actions: 331None102Documentation/communication with practitioner and monitor for trends46Refer to other department for intensified review and/or information108Implement or modify process, policy or system17Training & Education of staff35Other23 Post-review actions Systems-related factors contributing to case management attribution determinations are listed in Table 6. Table 6Systems-related contributing factorsNone115Transition of Care11Boarding5Other21Communication4Electronic Health Record4Equipment4Transfer Resources3Lack of Defined Process2Staffing2ED Volume Surge1Inpatient Unit Admission Criteria1 Systems-related contributing factors EDPRC case management attribution determinations were similarly distributed as compared year on year, as demonstrated in Fig. 3. Year on year comparison of case management attributions Discussion The 1999 publication of the Institute of Medicine report resulted in newfound attention and focus on medical error, identifying the ED as a hospital location with high error rates [25]. Recently, AHRQ published a report that estimated, out of 130 million U.S. ED visits, diagnostic error rates of 5.7% and rates of medical errors leading to serious harms of 0.3%, which translates to 350,000 patients with potentially preventable permanent disability or death [4]. Identification of errors is essential, and embracing errors as opportunities to learn is important for developing a supportive learning culture [26]. Physician peer review can serve as a rich environment for linking constructive individual feedback, group learning, process improvement, and patient safety. Historical models of physician peer review as a venue for performance evaluation will need to transition to Just Culture-informed models that foster continuous feedback, learning, and improvement [24]. Establishment of a deliberately non-punitive framework for peer review promotes physician engagement and enhances group learning. We report on implementing a physician peer review program that utilizes Just Culture to create opportunities for evaluating medical error and identifying areas for individual and systems improvement to enhance patient safety. Opportunities for improvement identified by the EDPRC during this period are summarized in Table 4. We designed educational conferences and faculty development sessions that prioritized the highest prevalence topics: documentation, diagnostic testing, team-based communication, and treatment strategies, embedding them within resident training and faculty development curricula, including evidence-based lectures, workshops, procedure labs, and simulation activities. The results of this study demonstrate that physicians can participate in a structured, non-punitive peer review process guided by principles of collaboration and Just Culture that can drive ongoing education and/or competency needs of the clinical care team. Continual promotion of a shared learning rather than justice-based approach ensures and preserves a healthy organizational culture that values physician peer review as an agent of educative processes that stimulate professional development, while also improving healthcare delivery in order to enhance patient safety and improve outcomes. Limitations The first limitation to this study was that this initiative, while taking place at three different hospitals, was limited in scope to one hospital network in which all three EDs were staffed by a single faculty group of attending physicians. Some systems-related factors identified by the EDPRC may be unique to the specific hospital location and not necessarily generalizable to others. A second limitation is that the EDPRC implementation process was fluid and underwent subtle revisions in response to feedback, which may have affected results over the three years after implementation. Hindsight bias is a third potential limitation of this study. However, to mitigate bias, attribution deliberations were carried out before revealing reason for referral or patient outcomes. A fourth potential limitation is that we did not prospectively measure faculty engagement in the process other than completion of assigned reviews and presentation, as well as attendance at committee meetings. Individuals were given the opportunity following each session to provide anonymous feedback on the review process and areas for improvement, as well as during faculty meetings and faculty development sessions. Future studies that focus on developing novel methods of identifying medical errors and adverse events would improve the ability of physician peer review to enhance quality improvement and patient safety. The next step in this current process would be to investigate if or how after-action activities (e.g. education, policy, or process changes, etc.) may reduce referrals or similar cases in the future. Conclusions This study demonstrates that departments can engage in a structured peer review process guided by non-punitive Just Culture principles that encourages and promotes physician learning and faculty development, while also identifying competency and systems-related contributions to clinical care that enhance patient safety. It further suggests that a structured peer review process can be implemented in EDs regardless of size or volume, or whether it is an academic or community-based ED. This process is straightforward to implement, provides feedback to practitioners for practice-based learning, and provides a collaborative learning environment for faculty groups. In addition, peer review has become an important and accepted vehicle for identifying faculty development needs as well as policy, process, or system changes needed across departments or institutions. Electronic supplementary material Below is the link to the electronic supplementary material. Supplementary Material 1 Acknowledgements Not applicable. Abbreviations Emergency Department Emergency Department Peer Review Committee Author contributions CF conceived this study. MC, MAC, and EMD contributed to the study design. MC performed the data collection and analysis. CF drafted the manuscript, and all authors contributed substantially to its content and finalization. All authors read and approved the final manuscript. Funding No funding was received for the submitted work and manuscript preparation. Data availability All data generated or analyzed during this study are included in the article. Declarations Ethics approval and consent to participate The Jefferson Institutional Review Board determined that this study does not constitute human subjects research and does not require approval or exemption. Consent for publication Not applicable. Competing interests The authors declare no competing interests. Footnotes Publisher’s Note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations. References Associated Data Supplementary Materials Supplementary Material 1 Data Availability Statement All data generated or analyzed during this study are included in the article.