Static Algorithm, Evolving Epidemic: Understanding the Potential of Human-AI Risk Assessment to Support Regional Overdose Prevention

Venkatesh Sivaraman, Yejun Kwak, Courtney Kuza, Qingnan Yang, Kayleigh Adamson, Katie Suda, Lu Tang, Walid Gellad, Adam Perer · 2025

Read Static Algorithm, Evolving Epidemic: Understanding the Potential of Human-AI Risk Assessment to Support Regional Overdose Prevention by Venkatesh Sivaraman, Yejun Kwak, Courtney Kuza, Qingnan Yang, Kayleigh Adamson, Katie Suda, Lu Tang, Walid Gellad, Adam Perer (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-10542.txt.

Introduction

Venkatesh Sivaraman and co-authors ask in 2025 whether AI risk scores for drug overdose could help local health teams plan their work. Such scores were first built to help doctors judge a single patient's risk. The team wanted to know if health officials could use the same kind of tool to decide where local aid should go.

They built a working test system and tried it with experts from three health departments of varied size and place. The experts were open to the gains that risk scores and AI-based charts might bring. The study also weighs the limits of a fixed model in a drug crisis that keeps changing shape over time. It points to care in how such tools are fit into real choices on staff, funds, and outreach.

Catalog record

CREATORVenkatesh Sivaraman, Yejun Kwak, Courtney Kuza, Qingnan Yang, Kayleigh Adamson, Katie Suda, Lu Tang, Walid Gellad, Adam Perer
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE72 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-10542

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Static Algorithm, Evolving Epidemic: Understanding the Potential of Human-AI Risk Assessment to Support Regional Overdose Prevention Venkatesh Sivaraman, Yejun Kwak, Courtney Kuza, Qingnan Yang, Kayleigh Adamson, Katie Suda, Lu Tang, Walid Gellad, Adam Perer Abstract . Drug overdose deaths, including those due to prescription opioids, represent a critical public health issue in the United States and worldwide. Artificial intelligence (AI) approaches have been developed and deployed to help prescribers assess a patient’s risk for overdose-related death, but it is unknown whether public health experts can leverage similar predictions to make local resource allocation decisions more effectively. In this work, we evaluated how AI-based overdose risk assessment could be used to inform local public health decisions using a working prototype system. Experts from three health departments, of varying locations and sizes with respect to staff and population served, were receptive to the potential benefits of algorithmic risk prediction and of using AI-augmented visualization to connect across data sources. However, they also expressed concerns about whether the risk prediction model’s formulation and underlying data would match the state of the overdose epidemic as it evolved in their specific locations. Our findings extend those of other studies on algorithmic systems in the public sector, and they present opportunities for future human-AI collaborative tools to support decision-making in local, time-varying contexts. Journal: PACMHCI Volume: 9 2 CSCW174 4 DOI: 10.1145/3711072 1357 CCS: Human-centered computing Visualization CCS: Human-centered computing Geographic visualization CCS: Applied computing Health informatics CCS: Computing methodologies Machine learning 1. Introduction Drug overdose is a deadly public health issue. Drug use was involved in over 600,000 deaths globally in 2019, including 125,000 due to opioids alone ( Organization, 2023 ) . In the United States, opioids prescribed legally by medical providers are of particular concern, claiming over 17,000 lives in 2021 ( Centers for Disease Control and Prevention, 2023 ) . The opioid crisis has prompted state- and national-level initiatives to create prescription databases that can track individuals at risk of overdose across fragmented medical systems ( for Disease Control and Prevention, 2021 ) . While these large-scale efforts to monitor and track prescriptions have led to meaningful change in the use of prescription opioids ( of Excellence at Brandeis, 2014 ; Brown et al., 2017 ) , local public health interventions can play a direct role in protecting at-risk individuals by ensuring that life-saving preventative measures are deployed in areas where they are most needed ( Albert et al., 2011 ) . But local health departments often face steep challenges in resource capacity, data access, and readiness for data-driven technologies ( Brownson et al., 2018 ) that have so far hindered their use of centralized prescription data ( for Disease Control and Prevention, 2021 ) . In all 50 U.S. states and the District of Columbia, Prescription Drug Monitoring Programs (PDMPs) have emerged as promising data sources for monitoring overdose risk. These databases, which record every controlled substance prescription made in the state, the prescriber, and who it was prescribed to, have been used to inform state policy and give individual prescribers insight into what other drugs a patient is receiving ( of Excellence at Brandeis, 2014 ; Brown et al., 2017 ) . To effectively use PDMP data, prescribers must synthesize many potentially informative variables and their trends over time for a given patient, taking valuable time and effort ( Ferris et al., 2019 ) . Recent literature offers prescribers a clear potential solution to streamline and standardize risk assessment: use artificial intelligence (AI) in combination with PDMP data to predict future risk of overdose ( Ferris et al., 2019 ; Lo-Ciganic et al., 2019 ; Ripperger et al., 2021 ; Gellad et al., 2023 ) . These studies have demonstrated potential utility for patient -level decision-making by clinicians, but the potential for use in a region -level context remains unexplored. Despite the impacts that public health agencies can have on the health and safety of communities, few studies in CSCW and HCI have explored how best to support local health departments’ work through technology. Technical efforts to use AI to inform public health decisions bear similarities to the increasing adoption of decision-support systems in other parts of the public sector, including criminal justice ( Angwin et al., 2016 ; Tan et al., 2018 ) , employment services ( Ammitzbøll Flügge et al., 2021 ; Scott et al., 2022 ) , and child welfare ( Allegheny County et al., 2019 ; Kawakami et al., 2022a ) . However, systems for public health decision-making face distinct challenges to those identified in other public-sector domains. The use of highly sensitive medical data, for example, limits organizations’ abilities to share data and algorithms in a transparent way ( for Disease Control and Prevention, 2021 ; Carroll et al., 2014 ) . Moreover, local health departments have limited capacity due to their numerous responsibilities and, particularly in the rural United States, insufficient funding ( Brownson et al., 2018 ; Leider et al., 2020 ) . This excess burden creates opportunities for large-scale data and algorithmic efforts to support under-resourced health departments, but it also places constraints on how and when stakeholders from these organizations can be engaged for design ( Backonja et al., 2022 ) . As a result, how local health departments might best leverage emerging algorithmic tools, such as overdose risk assessment models, has thus far been scarcely addressed. In the present work we aimed to bridge this gap through an exploratory qualitative evaluation embedded within an ongoing project to develop risk prediction algorithms. Other recent HCI work on designing decision support for experts has either engaged stakeholders after an algorithm has been deployed ( Kawakami et al., 2022a ; Kuo et al., 2023 ) or worked with potential system users from the very earliest stages of design ( Holten Møller et al., 2020 ; Sendak et al., 2020 ) . However, in domains such as health where deployment requires extensive validation and expert users are difficult to engage, these approaches are often either too high-risk or infeasible. Model development efforts instead most commonly focus on scoping out technological capabilities before soliciting user feedback ( Gu et al., 2020 ; Cai et al., 2019 ; Sivaraman et al., 2023 ) . By conducting our user evaluation within this relatively technology-centered design process ( Yang et al., 2020 ; Bly and Churchill, 1999 ) , we could elicit broad perspectives on algorithm-aided decision-making using a functional design probe, enabling more grounded insights. This approach also suggested ways that such design processes could be improved to better match user needs, particularly when developing AI under the constraints of medical data and the public sector. Our evaluation was guided by the following question: What opportunities and pitfalls do local public health officials perceive for AI-based regional risk assessment tools in overdose prevention? To address it, we built a design probe called Rx RiskMap to visualize predictions from a model which had been evaluated on historical data but not yet deployed or shown to potential users ( Gellad et al., 2023 ) . We conducted focus groups with the intended users of such a system: experts and administrators from three local health departments serving populations of varying

Read the complete text