Red Teaming Large Language Models for Healthcare

Vahid Balazadeh, Michael Cooper, David Pellow, Atousa Assadi, Jennifer Bell, Mark Coastworth, Kaivalya Deshpande, Jim Fackler, Gabriel Funingana, Spencer Gable-Cook, Anirudh Gangadhar, Abhishek Jaiswal, Sumanth Kaja, Christopher Khoury, Amrit Krishnan, Randy Lin, Kaden McKeen, Sara Naimimohasses, Kh · 2025

Read Red Teaming Large Language Models for Healthcare by Vahid Balazadeh, Michael Cooper, David Pellow, Atousa Assadi, Jennifer Bell, Mark Coastworth, Kaivalya Deshpande, Jim Fackler, Gabriel Funingana, Spencer Gable-Cook, Anirudh Gangadhar, Abhishek Jaiswal, Sumanth Kaja, Christopher Khoury, Amrit Krishnan, Randy Lin, Kaden McKeen, Sara Naimimohasses, Kh (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-00467.txt.

Introduction

Balazadeh and co-authors report in 2025 on a workshop that tried to break large language models in health care settings, before a 2024 conference on machine learning for health. Clinicians and computing experts wrote realistic clinical prompts and looked for replies that could cause harm. Clinicians can spot risks that model builders, without clinical training, may miss.

The report shares the design of the exercise and sorts the flaws found into groups. A second study then checked whether those same flaws appeared across all the models provided. Readers get a practical account of how red teaming with clinicians can surface dangers before a model reaches patients.

Catalog record

CREATORVahid Balazadeh, Michael Cooper, David Pellow, Atousa Assadi, Jennifer Bell, Mark Coastworth, Kaivalya Deshpande, Jim Fackler, Gabriel Funingana, Spencer Gable-Cook, Anirudh Gangadhar, Abhishek Jaiswal, Sumanth Kaja, Christopher Khoury, Amrit Krishnan, Randy Lin, Kaden McKeen, Sara Naimimohasses, Kh
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE136 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-00467

Browse the full library · About the Tower of Babel