To Recommend or Not to Recommend: Designing and Evaluating AI-Enabled Decision Support for Time-Critical Medical Events
Angela Mastrianni, Mary Suhyun Kim, Travis M. Sullivan, Genevieve Jayne Sippel, Randall S. Burd, Krzysztof Z. Gajos, Aleksandra Sarcevic · 2025
Read To Recommend or Not to Recommend: Designing and Evaluating AI-Enabled Decision Support for Time-Critical Medical Events by Angela Mastrianni, Mary Suhyun Kim, Travis M. Sullivan, Genevieve Jayne Sippel, Randall S. Burd, Krzysztof Z. Gajos, Aleksandra Sarcevic (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-11996.txt.
Introduction
Angela Mastrianni and co-authors present a 2025 study of AI support in trauma care. Trauma teams decide fast with thin facts. AI tools aim to help, but staff need to read the output well under time pressure. The team first asked doctors what facts and AI outputs a display should show. They then tested two display styles online with 35 providers from six health systems.
One style gave a synthesis of facts alone. The other added direct recommendations. Providers reacted in distinct ways to the added advice. The choice shapes trust, speed, and who owns the final call. Hospital teams get design proof for a tense setting. A display that helps in a calm ward may mislead in a trauma bay. The study treats the human-AI handoff as the real product, which is where emergency tools often fail.
Catalog record
| CREATOR | Angela Mastrianni, Mary Suhyun Kim, Travis M. Sullivan, Genevieve Jayne Sippel, Randall S. Burd, Krzysztof Z. Gajos, Aleksandra Sarcevic |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 89 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-11996
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
To Recommend or Not to Recommend: Designing and Evaluating AI-Enabled Decision Support for Time-Critical Medical Events Angela Mastrianni, Mary Suhyun Kim, Travis M. Sullivan, Genevieve Jayne Sippel, Randall S. Burd, Krzysztof Z. Gajos, Aleksandra Sarcevic Abstract . AI-enabled decision-support systems aim to help medical providers rapidly make decisions with limited information during medical emergencies. A critical challenge in developing these systems is supporting providers in interpreting the system output to make optimal treatment decisions. In this study, we designed and evaluated an AI-enabled decision-support system to aid providers in treating patients with traumatic injuries. We first conducted user research with physicians to identify and design information types and AI outputs for a decision-support display. We then conducted an online experiment with 35 medical providers from six health systems to evaluate two human-AI interaction strategies: (1) AI information synthesis and (2) AI information and recommendations. We found that providers were more likely to make correct decisions when AI information and recommendations were provided compared to receiving no AI support. We also identified two socio-technical barriers to providing AI recommendations during time-critical medical events: (1) an accuracy-time trade-off in providing recommendations and (2) polarizing perceptions of recommendations between providers. We discuss three implications for developing AI-enabled decision support used in time-critical events, contributing to the limited research on human-AI interaction in this context. DOI: XXXXXXX.XXXXXXX CCS: Human-centered computing Empirical studies in HCI 1. Introduction Computational methods can diagnose medical diseases with high levels of accuracy in medical research, especially when using artificial intelligence (AI) ( Fatima et al., 2017 ) . A critical challenge in using these methods to improve diagnostic and decision-making processes is supporting medical providers in interpreting the outputs of AI-enabled systems ( Van Berkel et al., 2023 ) . Because providers are responsible for determining treatment plans, their interpretation of system output is more important than the output itself ( Vasey et al., 2021 ) . Many AI-enabled decision-support systems provide recommendations, adding explanations to support users in interpreting the recommendations ( Gunning et al., 2019 ) . However, recent research in human-AI interaction has proposed a paradigm shift from recommendation-driven support to information-driven support, which provides users with information synthesis to facilitate hypothesis testing ( Miller, 2023 ; Gajos and Mamykina, 2022 ; Zhang et al., 2024c ; Zhang et al., 2024b ) . Information-driven support could help providers evaluate potential diagnoses, while avoiding issues commonly found with recommendations, such as over-reliance and reduced agency ( Miller, 2023 ; Zhang et al., 2024c ; Zhang et al., 2024b ) . Although initial empirical studies suggest that this approach can improve decision making, knowledge about the effectiveness of information-driven support, especially during instances of time-critical clinical decision making, remains limited. In addition, the role of recommendations within the information-driven support paradigm is still an open research area. Some information-driven strategies provide only information and not recommendations ( Gajos and Mamykina, 2022 ) . Others provide recommendations toward the end of the decision-making process to confirm or challenge the initial ideas of users ( Zhang et al., 2024b ) . To examine the effectiveness of information-driven support for time-critical decision making and the role of recommendations, we designed and evaluated a decision-support system within the context of pediatric trauma resuscitation. During resuscitations, providers treat critically injured patients in the emergency department, assessing their need for life-saving interventions (LSIs). We focused on developing a system to support decisions about two LSIs: blood transfusion and neurosurgical intervention. These LSIs are administered when treating two of the most frequent causes of preventable deaths in pediatric trauma resuscitation, severe blood loss and traumatic brain injury ( Drake et al., 2020 ) . We started our study by surveying 19 physicians from emergency medicine and surgery to understand the types of information that could support decision making during resuscitations. Most physicians thought the decision-support system should communicate the recommended interventions, the patient’s probability of receiving an LSI, and the patient information used by the decision-support model. From these results, we focused on comparing two human-AI interaction strategies: AI information synthesis and AI information and recommendations. Based on interviews with nine physicians and prior literature, we designed two displays for the system: (1) a display with AI information synthesis and (2) a display with AI information and recommendations. To compare the effectiveness of the two human-AI interaction strategies on time-critical decision making, we conducted an online experiment with 35 surgeons, physicians, and advanced practice providers from six healthcare organizations. In the experiment, participants had a limited amount of time to make decisions about the need for LSIs in 12 simulated patient vignettes. Participants were exposed to three types of AI support: (1) no AI support, (2) AI information synthesis, and (3) AI information and recommendations. Because our focus was on evaluating the impacts of different human-AI interaction strategies on decision making rather than on assessing the accuracy of any specific computational model, we simulated an AI system to generate and control the recommendations and information synthesis. We had two research hypotheses: • H1: Providing AI information synthesis will improve providers’ decision making (compared to no AI support). • H2: Providing AI information and recommendations will improve providers’ decision making (compared to no AI support). We found evidence supporting our second hypothesis that providing AI information and recommendations improves decision making. Participants were more likely to make correct decisions when provided AI information and recommendations (compared to receiving no AI support), even though the recommendations were occasionally incorrect. We did not find evidence for the first hypothesis that providing AI information synthesis alone significantly improved decision making compared to no AI support. We also did not find a significant difference in decision making between AI information and AI information and recommendation. Findings from the experiment suggest that both strategies may have functioned as a type of process-oriented support ( Zhang et al., 2024b ) , with patient information synthesized on the display as it was being presented in the vignette. Participants often made initial decisions as information was being presented, with some participants highlighting that they used the information synthesis to identify abnormalities and check their logic. Because recommendations appeared at the end of the vignette, they often served as a cognitive forcing function ( Buçinca et al., 2021 ) . Receiving either type of AI support did not increase the time taken to make decisions. Although AI information and recommendations was the most preferred type of AI support, participants had polarizing perceptions and uses of the recommendations. Some providers appreciated the ability to use the recommendations to check their decisions, while others thought the recommendations lacked nuance and could bias their decision making. From our work, we make three contributions to CSCW: • We show that providing AI information and recommendations can improve decisions about life-saving interventions, even if the recommendations are occasionally incorrect. These results add new knowledge to the limited evidence that human-AI collaboration can enhance decision making of domain experts in time- and resource-constrained settings. • We highlight two socio-technical barriers to implementing AI recommendations in time-critical medical events: (1) determining when to present AI recommendations and (2) supporting multiple human-centric objectives in addition to improving decision making. Controlling the points when