Why do we need quality measures in emergency medicine? Authors: Shamie Das, Gregg Miller, Christopher Libby, Cameron J. Gettel, Elaine Rabin, Michelle Lin Published: 2024 ABSTRACT AbstractQuality measures increasingly influence the delivery and reimbursement of care provided in emergency departments. While emergency physicians are accustomed to using quality measures to improve care delivery, payors, including the Centers for Medicare and Medicaid Services (CMS), are increasingly adjusting reimbursement to measure performance as a means to bend the cost curve and improve the value of healthcare services. The American College of Emergency Physicians Quality and Patient Safety Committee presents this whitepaper to guide practicing emergency physicians through the policy context of implementing measures in emergency care and understanding its impact reimbursement. This paper summarizes current CMS programs such as the merit‐based incentive payment system (MIPS), MIPS value pathways, and alternative payment models and various reporting mechanisms. It is crucial for emergency physicians to understand the quality measure development process, the need for more emergency medicine‐specific quality measures, and the growing significance of measure performance in the payment of emergency care. OVERVIEW OF QUALITY MEASUREMENT IN EMERGENCY MEDICINE Emergency departments (EDs) in the United States provide acute, unscheduled healthcare for over 144 million patients annually at an estimated cost of over $76.3 billion. 1 Given the high incidence and cost of US ED visits, ensuring high‐quality emergency care is of critical consequence for public health. However, measuring quality in emergency medicine (EM) is a relatively recent development. Most emergency physicians intuitively understand the use of quality measures to improve patient outcomes; however, the relationship between measure performance and reimbursement for professional services is less clear. As payors increasingly move away from fee‐for‐service (FFS) payment models toward models that incorporate quality measure performance, it is crucial that emergency physicians understand how these measures are developed and chosen. Currently, a number of challenges exist in the implementation of value‐based payment models in EM in contrast to other specialties and practice models. Emergency physician participation is essential to ensure that the measures chosen are appropriate and used in a manner that improves alignment between quality and payment. The objective of this manuscript is to provide an overview of the policy context for implementing quality measures in emergency care; explain the quality measure development process, including challenges and barriers specific to EM; and understand how emergency physicians can contribute to the ongoing development of clinically relevant, patient‐centered quality measures. 2 , 3 BACKGROUND: QUALITY AND QUALITY MEASUREMENT Quality in healthcare is defined by the National Academies of Medicine as “the degree to which healthcare services increase the likelihood of desired health outcomes and are consistent with current professional knowledge” and is characterized by providing care that is safe, effective, patient‐centered, timely, efficient, and equitable. 4 Quality measures are standards for measuring and improving health outcomes by focusing on clinically important areas where there is a gap between care that is delivered and care that is supported by clinical evidence. Donabedian formalized the three pillars of quality in modern healthcare: structure, process, and outcome (Figure 1). 5 Quality measures evaluate different entities on these domains—for example, individual clinicians, clinician groups, hospitals, and health plans. Many emergency physicians are familiar with CMS’ severe sepsis/septic shock management bundle (SEP‐1) and readmissions measures, which are hospital, not clinician level, measures. This manuscript focuses on quality measures intended to quantify performance at the emergency physician and ED clinician level given increasing reliance on these measures in federal payment policy. Examples of structure, process, and outcome quality measures in emergency medicine. SHIFT TO VALUE‐BASED CARE: FROM MEASURE TO REIMBURSEMENT Healthcare has traditionally been reimbursed on a FFS basis. FFS is intuitively suited to the acute, episodic, unscheduled nature of emergency care. Under FFS, emergency physician work effort is billed based on volume of patients and procedures, with adjustments based on acuity and complexity. One of FFS's greatest criticisms has been the incentive for physicians to “do more” to increase revenue through increased volume, although it is unclear if this incentive impacts the delivery of care in the ED. 6 , 7 Healthcare is attempting to move away from FFS. Since passage of the Affordable Care Act in 2010 and the Medicare Access and CHIP Reauthorization Act (MACRA) in 2015, payors have adopted value‐based payment programs that aim to improve health outcomes while reducing costs. 8 , 9 MACRA established the mandatory quality payment program (QPP) to tie quality to payment for all clinicians receiving reimbursement from Medicare. The QPP requires clinicians to participate in either the merit‐based incentive payment system (MIPS) or alternative payment models (APMs) (see Figure 2). 10 , 11 Measure development lifecycle (CMS. Blueprint measure lifecycle. Measures Management System. 2022. https://mmshub.cms.gov/blueprint‐measure‐lifecycle‐overview). MIPS AND QUALITY MEASURES Emergency physicians’ participation in QPP is largely driven by the type of employment model. Because many emergency physicians are not traditionally employed by hospitals or accountable care organizations (ACOs), they are less likely to have opportunities to participate in QPP as part of an APM. Therefore, a majority of independent emergency physician groups participate in MIPS. 12 MIPS ties FFS Medicare reimbursement to quality measure reporting and performance, with penalties and bonuses as high as 9% of total Medicare reimbursement. In practice, adjustments have typically been more modest as the program is based on budget neutrality where the bonuses are funded by the penalties. The MIPS program scores physician performance in four categories: QualityCostImprovement activitiesPromoting interoperability (implementing and utilizing certified electronic health records [EHRs]). Quality Quality Cost Cost Improvement activities Improvement activities Promoting interoperability (implementing and utilizing certified electronic health records [EHRs]). Promoting interoperability (implementing and utilizing certified electronic health records [EHRs]). Improvement activities and promoting interoperability each account for 15% of the total MIPS score. The “promoting interoperability” domain does not apply to EM and other hospital‐based physicians because nearly all already use compliant EHR platforms. Subsequently, the other three categories have higher relative weight in EM. Over time, the relative weighting of quality in the overall score (60% in 2017, 50% in 2018, and 30% in 2022) has decreased inversely to the weight of cost and resource use (0% in 2017, 10% in 2018, and 30% in 2022). Measures currently in use for EM Approximately 200 quality measures are available to clinicians to report through the QPP. 13 While some of these measures such as MIPS 116 “Avoidance of antibiotic treatment in adults with acute bronchitis” are relevant to the practice of EM, the vast majority are not. Because only the six best performing measures are selected for scoring and reimbursement, specialties with the largest available selection of quality measures have an advantage. To perform well in MIPS, emergency physicians need a broad set of measures to report. Therefore, several EM‐focused entities have developed measures more relevant to the practice of EM. The American College of Emergency Physicians (ACEP) is one major developer of EM‐based measures. 14 Working through its Quality and Patient Safety Committee, ACEP has developed more than two dozen of EM‐focused measures such as ACEP 21 “Coagulation studies in patients presenting with chest pain with no coagulopathy or bleeding” and ACEP 52 “Appropriate emergency department utilization of lumbar spine imaging for atraumatic low back pain.” 14 Another organization involved in the creation of EM‐specific quality measures is the Emergency Care Quality Measure Consortium (ECQMC). The ECQMC unites various EM stakeholders, such as academic groups, private medical groups, and governmental entities in the development of EM quality measures. This group works with ACEP in the creation of measures such as ACEP 59 “Avoidance of admission for adult patients with low‐risk chest pain” and ACEP 61 “Avoidance of chest X‐ray in pediatric patients with asthma, bronchiolitis, or croup.” Finally, private groups are also involved in the development of EM‐focused quality measures. For example, the medical group Vituity has developed several EM‐focused measures such as Emergency Clinical Performance Registry (ECPR) 39 “Avoidance of head CT for patients with uncomplicated syncope” and ECPR 51 “Naloxone discharge prescription after opioid poisoning or overdose.” A broader menu of EM‐focused quality measures allows EPs more opportunity to select the most meaningful measures to report for their particular practice. Further examples of common quality measures used by EPs for MIPS are listed in Table 1. TABLE 1Top quality clinical data registry (QCDR) quality measures submitted 2019‒2021.S. no.Measure IDMeasure title1ACEP19Emergency department utilization of CT for minor blunt head trauma for patients aged 18 years and older2ACEP20Emergency department utilization of CT for minor blunt head trauma for patients aged 2‒17 years3ACEP21Coagulation studies in patients presenting with chest pain with no coagulopathy or bleeding4ACEP22Appropriate emergency department utilization of CT for pulmonary embolism5ACEP25Tobacco use: screening and cessation intervention for patients with asthma and COPD6ACEP30Sepsis management: septic shock: lactate clearance rate of ≥107ACEP31Appropriate Foley catheter use in the emergency department8ACEP48Sepsis management: septic shock: lactate level measurement, antibiotics ordered, and fluid resuscitation9ACEP50ED median time from ED arrival to ED departure for all adult patients10ACEP51ED median time from ED arrival to ED departure for all pediatric ED patients11ECPR45Avoidance of creatine kinase‐MB testing for non‐traumatic chest pain12ECPR46Avoidance of opiates for low back pain or migrainesAbbreviations: COPD, chronic obstructive pulmonary disease; CT, computed tomography; ED, emergency department.John Wiley & Sons, Ltd. Top quality clinical data registry (QCDR) quality measures submitted 2019‒2021. Abbreviations: COPD, chronic obstructive pulmonary disease; CT, computed tomography; ED, emergency department. Quality measure reporting and qualified clinical data registries Clinicians must report MIPS quality performance to CMS through either two classes of approved entities: quality registries (QRs) or qualified clinical data registries (QCDRs). 15 QRs report performance only on a limited group of approved MIPS measures. QCDRs also have the ability to develop and report as many as thirty additional quality measures tailored to a particular specialty or medical condition, which may not be accessible to non‐QCDR participants. The establishment of specialty‐specific QCDRs in dozens of medical specialties has facilitated the creation of more meaningful and pertinent quality measures that leverage real‐world data to enhance outcomes. Two large QCDRs in EM include ACEP's clinical emergency data registry (CEDR) and Vituity's ECPR. QCDRs gather data on individual and group clinical performance for up to 30 different pre‐defined quality measures. To optimize flexibility and the potential for financial rewards, MIPS permits clinicians and groups to submit their top six performing measures to CMS through the QCDR for quality assessment and payment purposes. They then submit quality measure performance scores annually for the prior year, for use by CMS in determining physician bonus and penalties. CMS applies those payment adjustments in the following year, 2 years after the actual performance. Example quality measures reported by QCDRs are listed in Table 1. APMs and quality measures Instead of MIPS, eligible emergency physician groups could choose to participate in advanced APMs. APMs focus on specific clinical conditions, care episodes, or populations, and they typically require coordination across multiple physician specialties. 15 , 16 Because most EPs belong to independent or contract management groups, a majority of have not traditionally been able to participate in APMs. 17 Despite the Physician‐Focused Payment Task Force's recommendation that ACEP's Acute Unscheduled Care Model be implemented, CMS has not approved any APMs exclusive to EM. 17 , 18 , 19 However, many emergency physicians—particularly those in academic settings—belong to multispecialty groups or practices that participate in APMs such as ACOs. 17 Given the lack of EM‐specific quality measures available, many quality measures utilized by APMs and their ACOs are not related to quality of care provided in the ED. Instead, emergency physicians are judged on quality measures reflecting quality of care during the admission as a whole, for example, quality measures related to rates of falls or catheter‐related infections, thereby foregoing these incentives to improve quality. PRACTICING EMERGENCY PHYSICIANS AND QUALITY MEASURES Emergency physicians must understand the impact of quality measures on their clinical practice and financial compensation. They should be aware of which value‐based model they are participating in, such as MIPS or an ACO, and which quality measures are being tracked within that model. Performance reports should be regularly shared with emergency physicians to identify gaps in performance and opportunities for improvement. Such reporting not only helps improve clinical care and reimbursement, but also can serve as practice improvement activity required by the American Board of Emergency Medicine for its diplomates. To ensure that quality measures are clinically relevant, practicing emergency physicians need to be active participants in the development of quality measures. Measure developers for ACEP, ECQMC, and Vituity consist of practicing emergency physician volunteers who have developed expertise in quality measure development, and each respective organization has pathways for emergency physicians to become active volunteers. For example, ACEP's quality measures are developed by members of the Quality and Patient Safety Committee, and nominations for new committee members are solicited annually in the spring. Quality measures are also increasingly being used for purposes other than compensation, such as credentialing and maintenance of certification. Medical directors and hospital administrators have traditionally been responsible for quality measure performance and selection, with others largely responsible for quality measure development. Additional training opportunities, such as ACEP's Emergency Medicine Data Institute and Clinical Informatics Fellowships, are available to train and prepare leaders in EM quality measure development. QUALITY MEASURE DEVELOPMENT LIFECYCLE Quality measure development is a complicated and expensive process, designed to generate a precisely specified, valid, and reliable quality measure that is meaningful to clinicians and patients. There are five stages in the measure lifecycle: conceptualization, development, testing, deployment, and maintenance (Figure 2). These stages are iterative and are not necessarily sequential. 20 Once measures are endorsed and rolled out, annual updates, comprehensive re‐evaluations, and ad hoc reviews are necessary to ensure the continued soundness of the quality measure. Eventually, measures are retired or replaced with updated measures as evidence‐based practice evolves. As an example, quality measures used by ACEP and CEDR are developed and maintained using a collaborative, multistep process overseen by the measure development lifecycle workgroup of the ACEP Quality and Patient Safety Committee (led by emergency physician experts and leaders in quality measurement) in collaboration with the ACEP CEDR Committee and CEDR staff (Figure 3). Overview of the Quality Payment Program (QPP). Most emergency physicians in group practice collectively report through the merit‐based incentive payment system (MIPS) utilizing a qualified clinical data registry (QCDR) or qualified registry (QR). Some physicians in large multispecialty practices, such as academic health centers will participate through alternative payment models (APMs) as accountable care organizations(ACOs). The MIPS value pathway (MVP) became available for submission in 2023 with possible payment adjustments as early as 2025. QUALITY MEASURE CHALLENGES Numerous challenges exist in the creation of EM‐specific quality measures, previously outlined by Schuur et al. and continue to persist more than 10 years later. 21 Meeting these challenges requires substantial investment by the specialty to ensure quality measures reflect high‐quality care and help emergency physicians avoid payment penalties. Challenges with quality measurement A key pillar of CMS's National Quality Strategy is to focus on measuring outcomes whenever possible. 22 However, most emergency care quality measures assess processes and not outcomes. Process measures focus on specific care actions and interventions, for example, timely administration of medications, ordering diagnostic tests, or adhering to clinical guidelines, and can be more directly influenced and controlled by healthcare providers. Because ED patients experience barriers to accessing care with limited follow‐up data across healthcare settings, assessing outcome measures (eg, mortality, revisits, and readmissions) in EM is challenging. Nonetheless, the specialty has made advances toward outcome measurement by focusing on low‐risk groups where quality gaps exist to avoid the need for complex risk adjustment (eg, avoidance of admission for low‐risk chest pain and syncope admissions [ACEP 59 and ACEP 60, respectively]). 14 Quality measures often simplify complex healthcare processes into numerical scores or binary outcomes, potentially overlooking nuances and variations in patient care. Quality measures also often focus on specific aspects of care, potentially missing broader aspects of patient well‐being, patient satisfaction, or the patient's experience of care. Comparing quality measures across different healthcare settings can be problematic due to variations in patient populations, resources, and care processes. In some cases, quality measures have been shown to disproportionately penalize providers in safety‐net institutions and lower resourced settings, who are more likely to care for patient populations with worse outcomes due to structural racism and inequity—not necessarily differences in the quality of healthcare delivered. 20 The overemphasis on clinical areas targeted by quality measures can have unintended consequences: providers may “game” quality measures to meet specific targets, potentially compromising the overall quality of care. Collecting and reporting data for quality measures can be resource‐intensive and divert provider attention to documentation, instead of direct patient care. Challenges with quality measure development Developing and maintaining clinically relevant quality measures requires significant investment. A quality measure may be considered “topped out” and retired by CMS if measure performance is almost uniformly high. Topped out measures fail to differentiate between providers, discourage further improvement efforts, and may lead to gaming or loss of focus on patient care, necessitating regular updates to maintain their effectiveness. Revising or replacing these measures is crucial to incentivize ongoing quality improvement and maintain the integrity of quality assessment programs; however, they require substantial resources and collaboration among clinicians, specialty societies, and QR/QCDRs. Several quality measures within the QPP Emergency Medicine Specialty Measure Set, such as quality measures assessing appropriate antibiotic usage for upper respiratory tract infections, are topped out or near topping out and in danger of being retired. 21 The rate at which measures top‐out can exceed the rate of new measure development, which limits measures available for EPs over time. This requires the specialty to continually invest in the development of new quality measures. Harmonization across quality measures is another challenge. When two separate entities develop similar quality measures, CMS might require them to be standardized, or “harmonized” into one unified measure. Calls for measure harmonization can be time and resource intensive, sometimes introducing confusion among reporting clinicians. 23 Implementation challenges exist, particularly given critical gaps in the EHR standardization. Variation in the accuracy and completeness of data can adversely impact the reliability of quality measures. The current heterogeneity in data capture adds risk to quality measure maintenance and requires measure developers to continually meet escalating standards established by CMS. Differences in data types, field nomenclature, data completeness, and codification standards require frequent refinement to ensure standards are met. While the classification of diagnoses continues to be refined through the ICD system, there remains a need for a standardized system of classifying chief complaints and presenting symptoms. The chief complaint—often in patients’ own words—is the initial reason for seeking emergency care, and is critical in guiding clinical decisions, assessment, and prioritization of care. In contrast, diagnoses are often applied retrospectively once the ED workup is complete. The lack of standardized chief complaint data across EDs is a barrier to assessing emergency care quality—particularly with respect to key quality domains such as diagnostic accuracy. 24 For example, it would not be feasible to assess rates of missed acute myocardial infarction diagnosis without systematically accounting for the myriad clinical manifestations of acute myocardial infarction. While various classification systems have been developed (eg, hierarchical presenting problem ontology or the reason for visit classification system), none has yet been universally been incorporated into clinical care or quality measurement. 25 , 26 Despite these limitations, quality measures play a crucial role in assessing and enhancing healthcare quality by providing a structured framework for evaluation and fostering accountability. Ongoing efforts aim to refine measures to better address the unique challenges of emergency care. THE FUTURE PROGRAMS FOR VBC: MIPS VALUE PATHWAYS AND QUALITY MEASURES As healthcare transitions toward value‐based care, EM quality measures will increasingly focus on care coordination, discharge planning, warm hand‐offs, and outcomes after emergency care. Other key quality gap areas include: diagnostic error, patient‐reported outcomes, care coordination, admissions, ED revisits, geriatrics, behavioral health, substance use, and health equity. Many of these have been discussed over 10 years ago, but many of these quality gaps still have not been addressed. 27 Improving access to large data registries will facilitate development of more meaningful measures. CMS recently approved MIPS Value Pathways (MVPs) as a new voluntary reporting option for physicians that began in 2023 to fulfill MIPS requirements. 2 , 11 MVPs are sets of quality measures built around a particular condition or medical specialty, unlike current MIPS quality measures which range across a broad range of disparate clinical issues. The option to participate in QPP using MVPs may increase participation in QRs because physician groups will have the option to report quality measures based on the various specialties within their group, rather than using measures that are not specific to any specialty. By 2026, multispecialty groups that choose to report using MVPs will be obligated to report specialty‐specific subgroups. This requirement may disproportionately impact academic EPs physicians who are more likely to participate in MIPS as multispecialty groups where non‐ED specialties report on behalf of ED clinicians. 16 CMS envisions making MVPs mandatory and eventually phasing out the traditional MIPS option. 11 CONCLUSION Quality measurement development is an evolving science, but contemporary quality measures for EM are limited in scope and impact when compared to other specialties. As quality measures increasingly influence the practice of EM from knowledge translation to reimbursement, it is essential that practicing emergency physicians become engaged in the quality measure development process. Ongoing investments in patient‐centered, clinically relevant EM quality measures have the potential to improve patient outcomes, promote safety, and advance the quality of emergency care delivery. CONFLICT OF INTEREST STATEMENT The authors declare no conflicts of interest in accordance with ICJME guidelines.