MedVoiceBias: A Controlled Study of Audio LLM Behavior in Clinical Decision-Making

Zhi Rui Tam, Yun-Nung Chen · 2025

Read MedVoiceBias: A Controlled Study of Audio LLM Behavior in Clinical Decision-Making by Zhi Rui Tam, Yun-Nung Chen (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-06592.txt.

Introduction

Zhi Rui Tam and Yun-Nung Chen test whether a patient's voice can sway a medical language model's judgment. Voice interfaces are entering clinics, and tone, age, or emotion in speech might tilt decisions away from the medical facts. One hundred seventy clinical cases were spoken aloud in thirty-six voice profiles varying age, gender, and emotion.

Surgical recommendations for spoken cases shifted by up to thirty-five percent versus identical written cases, and one model recommended surgery eighty percent less often by voice. Young and elderly voices drew recommendations differing by up to twelve percent, a gap that step-by-step prompting did not erase, though explicit reasoning removed the gender gap. The authors urge bias-aware designs before clinical use.

Catalog record

CREATORZhi Rui Tam, Yun-Nung Chen
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE23 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-06592

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

MedVoiceBias: A Controlled Study of Audio LLM Behavior in Clinical Decision-Making Zhi Rui Tam, Yun-Nung Chen Abstract As large language models transition from text-based interfaces to audio interactions in clinical settings, they might introduce new vulnerabilities through paralinguistic cues in audio. We evaluated these models on 170 clinical cases, each synthesized into speech from 36 distinct voice profiles spanning variations in age, gender, and emotion. Our findings reveal a severe modality bias: surgical recommendations for audio inputs varied by as much as 35% compared to identical text-based inputs, with one model providing 80% fewer recommendations. Further analysis uncovered age disparities of up to 12% between young and elderly voices, which persisted in most models despite chain-of-thought prompting. While explicit reasoning successfully eliminated gender bias, the impact of emotion was not detected due to poor recognition performance. These results demonstrate that audio LLMs are susceptible to making clinical decisions based on a patient’s voice characteristics rather than medical evidence, a flaw that risks perpetuating healthcare disparities. We conclude that bias-aware architectures are essential and urgently needed before the clinical deployment of these models. \DeclareFloatingEnvironment boxes 1 Introduction The rapid deployment of large language models (LLMs) in healthcare presents both a promising frontier and a critical concern. Among medical decisions, surgical recommendations are particularly challenging for bias assessment. While these decisions should be driven by clinical factors, research shows that implicit biases often lead to the substitution of demographic proxies, such as using a patient’s age instead of their frailty as a decisive factor [ 15 ] . Disentangling such biases from legitimate clinical variations, like the higher surgery rates for females due to conditions like cholecystitis [ 3 ] , requires controlled experimental designs that isolate demographic factors. Recent evidence has shown that LLMs exhibit similar patterns of bias. A large-scale analysis of nine models across 500 emergency department vignettes found that marginalized groups were significantly more likely to receive recommendations for urgent and invasive procedures [ 18 ] . This strong correlation suggests that surgical decisions serve as sensitive indicators for algorithmic bias, especially given the ambiguity inherent in the process. The emergence of audio LLMs introduces additional complexity. Unlike traditional text-based LLMs, audio LLMs handle continuous audio signals that carry paralinguistic information, including perceived demographics encoded in accent, pitch, and prosody. These voice characteristics could trigger similar substitution patterns, leading to biased recommendations based on how a patient sounds rather than what they say [ 16 ] . To address this gap, we present a comprehensive framework for assessing demographic bias in audio LLMs’ medical decision-making. Our approach focuses on surgical recommendation tasks, leveraging their documented susceptibility to demographic substitution effects. Through controlled experiments using synthesized speech, we isolate the effects of voice characteristics while holding clinical content constant. This methodology allows us to determine whether audio LLMs perpetuate the problematic pattern of using demographic proxies instead of clinical indicators. Our contributions are 3-fold: • We present the first systematic evaluation of voice-based bias in audio LLMs through binary surgery decisions, revealing how paralinguistic features influence high-stakes medical recommendations. • We create MedVoiceBias with 170 clinical cases from DDXPlus with 36 synthesized speaker profiles (age, gender, emotional expressions) to benchmark controlled bias assessment. 1 1 1 Dataset available at https://hf.co/datasets/theblackcat102/MedVoiceBias • We demonstrate severe modality-dependent biases (up to 34.9pp deviation between text/audio), with age disparities persisting under chain-of-thought (CoT) while gender bias is eliminated. 2 Related Work The intersection of speech AI and bias in healthcare is understudied but critical field. We categorize existing research into three key areas: automatic speech recognition (ASR) bias, behavioral bias in audio LLMs, and bias in medical AI systems. ASR and Audio LLM Bias. Speech recognition systems exhibit systematic performance disparities across demographic groups. Koenecke et al. [ 12 ] first documented significantly higher word error rates for Black speakers compared to White speakers. Harris et al. [ 9 ] demonstrated that intersectional bias patterns compound these disparities, with the Fair-Speech dataset [ 22 ] revealing performance gaps exceeding 40% across demographic groups. Beyond ASR performance, Spoken StereoSet [ 13 ] evaluated behavioral biases in speech language models, finding minimal bias scores close to 50% for general stereotype tasks involving gender and age demographics. However, domain-specific applications, particularly high-stakes medical contexts, may reveal different bias patterns as clinical decision-making involves complex reasoning beyond simple stereotype association. Bias in Medical AI Systems. Medical AI systems exhibit systematic demographic biases in clinical decision-making. Omar et al. [ 18 ] demonstrated that across 432,000 responses from nine language models on emergency department scenarios, marginalized groups were significantly more likely to receive recommendations for invasive procedures. This reflects demographic substitution patterns in human medical practice, where easily observable characteristics inappropriately influence clinical recommendations despite evidence-based guidelines. Figure 1: The framework for evaluating audio LLM bias. A patient’s text profile is converted to speech via a TTS model, with voices systematically varied by characteristics to assess for implicit bias. Research Gap and Contribution. To the best of our knowledge, no prior work has systematically investigated how voice characteristics influence medical reasoning in audio LLMs. Surgical recommendations are an especially suitable testbed for bias evaluation, as they involve binary, high-stakes decisions with documented demographic disparities [ 1 ] , are governed by clinical guidelines that should be demographic-agnostic, and contain inherent uncertainty that allows bias to surface [ 6 ] . Our work makes the first systematic contribution in this area by leveraging controlled speech synthesis to isolate the impact of voice characteristics on surgical decision-making. Through this design, we reveal how the speech modality can introduce previously overlooked bias vectors in medical AI systems. 3 Methodology 3.1 Motivation To investigate bias in medical reasoning, we focus on two fundamental components of clinical decision-making: structured diagnostic reasoning and binary treatment recommendations . For structured diagnostic reasoning, we employ the DDXPlus dataset [ 8 ] , which provides differential diagnoses: a list of 49 plausible conditions aligned with a patient’s symptoms and widely regarded as a cornerstone of physician reasoning. By prompting audio LLMs to generate differential diagnoses, we move beyond surface-level accuracy metrics and evaluate whether vocal characteristics systematically influence the quality and clinical soundness of reasoning. For treatment recommendations, we employ yes/no surgery decisions as clear, high-stakes binary classification tasks. 2 2 2 Our implementation allowed models to output “yes,” “maybe,” or “no,” but for analysis we treated only “yes” as a positive decision and grouped the others together. Binary classification provides a well-established framework for evaluating algorithmic bias, yielding unambiguous outcomes that facilitate straightforward fairness measurement [ 7 ] . Surgical decisions are particularly consequential, as historical evidence shows that human clinical judgment has been influenced by patient demographics, resulting in disparities in access to major surgery [ 4 , 11 ] . By requiring a definitive yes/no recommendation, we create a clear and interpretable signal for bias. This design enables precise quantification of how vocal profiles may skew audio LLMs’ recommendations, offering a critical mechanism to detect and mitigate potential harms before such systems are deployed in real-world clinical practice. 3.2 MedVoiceBias Dataset Construction To systematically evaluate the influence of audio characteristics, we constructed a dataset designed to benchmark bias assessment in audio LLMs. This dataset

Read the complete text