A Risk Taxonomy and Reflection Tool for Large Language Model Adoption in Public Health

Jiawei Zhou, Amy Z. Chen, Darshi Shah, Laura M. Schwab-Reese, Munmun De Choudhury · 2024

Read A Risk Taxonomy and Reflection Tool for Large Language Model Adoption in Public Health by Jiawei Zhou, Amy Z. Chen, Darshi Shah, Laura M. Schwab-Reese, Munmun De Choudhury (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2411-02594.txt.

Description

Abstract . Recent breakthroughs in large language models (LLMs) have generated both interest and concern about their potential adoption as information sources or communication tools across different domains. In public health, where stakes are high and impacts extend across diverse populations, adopting LLMs poses unique challenges that require thorough evaluation.

Catalog record

CREATORJiawei Zhou, Amy Z. Chen, Darshi Shah, Laura M. Schwab-Reese, Munmun De Choudhury
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE107 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2411-02594

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

A Risk Taxonomy and Reflection Tool for Large Language Model Adoption in Public Health Jiawei Zhou, Amy Z. Chen, Darshi Shah, Laura M. Schwab-Reese, Munmun De Choudhury Abstract . Recent breakthroughs in large language models (LLMs) have generated both interest and concern about their potential adoption as information sources or communication tools across different domains. In public health, where stakes are high and impacts extend across diverse populations, adopting LLMs poses unique challenges that require thorough evaluation. However, structured approaches for assessing potential risks in public health remain under-explored. To address this gap, we conducted focus groups with public health professionals and individuals with lived experience to unpack their concerns, situated across three distinct and critical public health issues that demand high-quality information: infectious disease prevention (vaccines), chronic and well-being care (opioid use disorder), and community health and safety (intimate partner violence). We synthesize participants’ perspectives into a risk taxonomy, identifying and contextualizing the potential harms LLMs may introduce when positioned alongside traditional health communication. This taxonomy highlights four dimensions of risk to individuals, human-centered care, information ecosystems, and technology accountability. For each dimension, we unpack specific risks and offer example reflection questions to help practitioners adopt a risk-reflexive approach. By summarizing distinctive LLM characteristics and linking them to identified risks, we discuss the need to revisit prior mental models of information behaviors and complement evaluations with external validity and domain expertise through lived experience and real-world practices. Together, this work contributes a shared vocabulary and reflection tool for people in both computing and public health to collaboratively reflect and assess risks in deciding when to employ LLM capabilities (or not) and how to mitigate harm. Journal: PACMHCI Volume: 9 7 CSCW363 11 DOI: 10.1145/3757544 CCS: Human-centered computing Human computer interaction (HCI) CCS: Human-centered computing Natural language interfaces CCS: Applied computing Consumer health † † cc-license: by 1. Introduction “I love new technologies but this one has me scared. I myself wouldn’t feel like I know enough to ask the right questions and to evaluate the impact of it.” — E5 (public health director) Recent breakthroughs in large language models (LLMs) have spurred widespread attention and rapid adoption across different fields. With their abilities to generate persuasive human-like language on the basis of large sets of human-written content ( Brown et al., 2020 ; Vaswani et al., 2017 ) , LLMs hold the potential to influence how we interact with information. LLMs have quickly gathered hundreds of millions of active users ( Reuters, 2024 ) and made their way into everyday products, sometimes even without users’ full awareness. Accordingly, public discourse has shown excitement about LLM assistance in various informational tasks and even hype about the framing of LLMs as the “next-generation search engine” ( Office, [n. d.] ) or “alternative to human therapists” ( Lawrie, 2025 ) . This technology enthusiasm extends into public health, a public sector that aims to protect and improve the health of people and their communities by promoting healthy lifestyles, researching disease and injury prevention, and detecting, preventing and responding to infectious diseases ( for Disease Control and, CDC ; Turnock, 2009 ) . Studies have presented evidence of LLMs’ potential in assisting collection, analysis, and dissemination of public health information ( Xie et al., 2025 ; Karinshak et al., 2023 ; Joshi et al., 2024 ) , developing public health policies ( Espinosa and Salathé, 2024 ; Hou et al., 2025 ; Guevara et al., 2024 ) , scaling care to population ( Ayers et al., 2023 ; Jo et al., 2023 ) , and supporting community health workers ( Ramjee et al., 2024 ) . In practice, LLMs have already been implemented in community- or population-level systems or technologies, such as health record infrastructure ( Landi, 2024 ) , virtual agents for dealing with domestic violence ( McCall, 2023 ) , and public health monitoring instruments ( Jo et al., 2023 ) . At the same time, public-facing LLM products have become widely accessible to individuals to seek support, sometimes knowingly and other times embedded within existing platforms ( Al-Sibai, 2025 ; McMahon, 2024 ) . While this proliferation seems promising, experts and scholars caution against exaggerating LLM capabilities ( Drogt et al., 2024 ; Wornow et al., 2023 ) . Concerns have been raised about the potential of generating harmful content ( Zhou et al., 2023 ; Liang et al., 2022 ; Gehman et al., 2020 ) , perpetuating biases ( Omiye et al., 2023 ) , compromising data privacy ( Zhang et al., 2024 ) , limited generalizability of models ( Wornow et al., 2023 ) , and challenges in real-world implementation ( Wester et al., 2024 ; Jo et al., 2023 ) . Given the high-stakes nature and data sensitivity of population-level health, it deserves careful consideration of when it is appropriate to employ LLM capacities and how we can mitigate potential harm when we do. Yet, despite this recognized need for caution, evaluating the risks of LLM adoption in public health real practice remains a complex challenge. The first gap lies in the lack of domain understanding, as the majority of risk taxonomies lack granularity to be applied for specific uses ( Liao and Vaughan, 2023 ) or are created within the computer science community and tend to leave out domain experts and real users ( Shelby et al., 2023 ; Weidinger et al., 2022 ; Bender et al., 2021 ) . Second, when considering population-level impact, potential risks come in ecological “layers” from individuals to society, and conventional categorizations based on content types (e.g., misinformation, hate speech, and biases) are not sufficient to evaluate real-world cases ( Scheuerman et al., 2021 ; Zhou et al., 2025 ) . Identifying the presence of generated harmful content is only the first step; we also need to contextualize the documented possibility of low-quality information within specific public health issues and relevant populations to evaluate the consequences and mitigate potential harm. In response to these gaps, this paper examines risks associated with the use of LLMs to offer and seek health informational assistance within the public health domain. We ground our analysis in three distinct and critical public health issues, examining them through the perspectives of both public health professionals and individuals with lived experience who actively seek online health information. Specifically, we ask: What negative consequences might arise from adopting LLMs to meet informational needs in public health? We conducted focus group sessions with ten public health professionals and ten individuals with lived experience who have actively sought online health information, in order to jointly explore potential negative influences of using LLMs in public health. We selected vaccines, opioid use disorder, and intimate partner violence as topics for different sessions based on their significance across different dimensions of public health: infectious disease prevention, chronic and well-being care, and community health and safety — all demanding high-quality information with existing prevalent issues such as misinformation, biases, and sensitivity. The result is a risk taxonomy of potential adoption of LLM for public health. Our taxonomy consists of four dimensions of harm: risks to individuals, human-centered care, information ecosystems, and technology accountability (Fig 2 ). Within each area, we list specific risks and

Read the complete text