Gender-Dependent Diagnostic Substitution in LLM Medical Triage: Same Symptoms, Unequal Urgency

Qi Han Wong · 2026

Read Gender-Dependent Diagnostic Substitution in LLM Medical Triage: Same Symptoms, Unequal Urgency by Qi Han Wong (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-03641.txt.

Introduction

Wong shows that medical triage by language models shifts with the patient's stated gender. Identical neurological symptoms were presented across seven demographic conditions. Age and gender varied while symptoms stayed fixed. Three model families ran 630 trials in total. The symptom set lists persistent headache, blurred vision, morning nausea, and visual disturbance.

Young women got far lower emergency referral rates than young men. On one model the rates were zero versus about 23 percent. On another they were about 7 versus 97 percent. All gaps were highly significant. At age 65 the disparity vanished. The mechanism is diagnostic substitution. Models anchor young women on intracranial hypertension tied to women of childbearing age. Men get a generic pressure diagnosis with lesions considered. Female patients are thus routed to outpatient care despite matching severity scores. The fix urged is to decouple urgency from diagnostic priors.

Catalog record

CREATORQi Han Wong
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE23 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.03641

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Gender-Dependent Diagnostic Substitution in LLM Medical Triage: Same Symptoms, Unequal Urgency Qi Han Wong Abstract We investigate whether large language models produce different medical triage recommendations for identical neurological symptoms when only the patient’s stated gender and age vary. Using three model families—Gemini 3.5 Flash, Claude Sonnet 4.6, and GPT-5.4-mini—we present a standardized symptom profile (persistent headache, blurred vision, morning nausea, visual disturbances) across seven demographic conditions: three age groups (25, 38, 65) × \times two genders (male, female), plus a gender-unspecified baseline ( n = 30 n=30 per condition per model, 630 total trials). We find a stark, systemic gender-dependent triage disparity: young women receive significantly lower emergency room (ER) referral rates than age-matched men (Gemini: 0% vs. 23.3%; Claude: 6.7% vs. 96.7%; GPT: 6.7% vs. 66.7%, all p < 0.001 p<0.001 ). The disparity disappears at age 65 for all models. The primary mechanism is diagnostic substitution : the models anchor on a gender-associated diagnosis, preferentially classifying young women with Idiopathic Intracranial Hypertension (IIH)—a condition epidemiologically linked to women of childbearing age—while diagnosing men with generic increased intracranial pressure with space-occupying lesions in the differential. This diagnostic closure routes female patients to lower-urgency care (outpatient doctor appointments) despite comparable severity ratings (7–9/10). Our findings demonstrate that clinical LLMs replicate documented human clinical biases by using epidemiological priors to suppress triage urgency, suggesting that AI triage engines must decouple urgency assessment from probabilistic diagnostic priors. We release all code, prompts, and raw results. 1 Introduction Large language models are increasingly integrated into healthcare-adjacent applications, including symptom checkers, triage assistants, and patient-facing diagnostic chatbots ( Singhal et al. 2023 ; Nori et al. 2023 ) . A fundamental requirement for these systems is demographic parity in urgency assessment : identical symptoms should produce equivalent urgency recommendations regardless of the patient’s stated gender, unless gender is clinically relevant to the urgency of the recommended action. We test this requirement directly. We present a single neurological symptom profile—persistent headache, blurred vision, morning nausea, and visual disturbances—to three deployment-tier models across seven conditions varying only in the patient’s stated gender and age. Our primary outcome is the ER recommendation rate; our secondary outcome is the model’s differential diagnosis. This work is motivated by a well-documented phenomenon in clinical medicine: women’s neurological and cardiac symptoms are more likely to be attributed to benign or psychosomatic causes, leading to delayed or lower-intensity workups ( Samulowitz et al. 2018 ; Bugiardini & Bairey Merz 2005 ) . Our results demonstrate that clinical LLMs trained on medical corpora replicate this pattern, not through an explicit bias in urgency assignment, but through a subtler mechanism: diagnostic substitution that anchors the clinical assessment to a gender-associated condition before the urgency decision is made. Contributions. 1. We demonstrate a systemic gender disparity in triage urgency for identical neurological symptoms across three leading LLM families (Gemini 3.5 Flash, Claude Sonnet 4.6, and GPT-5.4-mini), with effect sizes reaching Cohen’s h>2.2 . 2. We identify diagnostic substitution—the model selecting a gender-linked diagnosis (IIH) that reduces urgency—as the shared mechanism across these models. 3. We show that the disparity is age-modulated and disappears at age 65, aligning with the epidemiological profile of IIH and proving the bias is driven by statistical clinical priors. 4. We release the complete experiment code, prompts, and raw results. 1 1 1 https://github.com/wongqihan/ai-behavioral-experiments 2 Related Work Gender Bias in Clinical Medicine. The underdiagnosis and undertriage of women’s symptoms is extensively documented. Samulowitz et al. 2018 conducted a systematic review finding that women’s pain is more likely to be psychologized and less likely to receive analgesic treatment. In cardiology, Bugiardini & Bairey Merz 2005 showed that women presenting with acute coronary syndrome receive less aggressive workups and longer door-to-treatment times. In neurology, women with minor ischemic cerebrovascular events are more likely to receive a stroke mimic diagnosis compared to men ( Yu et al. 2019 ) . Our finding that an LLM replicates this pattern through diagnostic substitution suggests that the bias is encoded in the medical training literature itself. Gender Bias in LLMs. Recent systematic reviews have found that gender bias is present in over 90% of LLMs evaluated for clinical applications ( Omar et al. 2025 ) . Zack et al. 2024 demonstrated that GPT-4 perpetuates racial and gender biases in healthcare recommendations. Omiye et al. 2023 showed that LLMs propagate race-based medicine from their training corpora. Our work extends this literature by identifying a specific mechanism —diagnostic substitution—rather than merely documenting a disparity in downstream recommendations. Counterfactual Bias Testing. The counterfactual patient variation (CPV) methodology, in which demographic identifiers are systematically varied while holding clinical content constant, has emerged as a standard approach for auditing clinical LLMs ( Pfohl et al. 2024 ; Zack et al. 2024 ) . Our experiment follows this design: the symptom text is identical across all conditions, with only the age and gender identifier varying. IIH Epidemiology. Idiopathic Intracranial Hypertension has a strong female predilection, with female-to-male ratios of 5:1 to 9:1, predominantly affecting women of childbearing age ( Mollan et al. 2018 ; Friedman et al. 2013 ) . The model’s preferential diagnosis of IIH in young women is therefore epidemiologically motivated. However, IIH can cause permanent vision loss and requires urgent evaluation—the same symptoms that warrant ER referral in men also warrant ER referral in women, regardless of the likely diagnosis. 3 Methodology 3.1 Model and Configuration We evaluate three state-of-the-art large language models: Gemini 3.5 Flash (Google), Claude Sonnet 4.6 (Anthropic), and GPT-5.4-mini (OpenAI). We selected deployment-tier models (Flash, Sonnet, mini) rather than flagship variants (Pro, Opus, GPT-4o) because these lower-cost, lower-latency models are the most likely candidates for integration into production symptom-checking and triage applications, where per-query cost and response time are operational constraints. Our findings therefore characterize bias in the models most likely to interact with patients at scale. All models are queried via their respective APIs using a temperature of 0.3 to balance output consistency with stochastic variation. We run 30 trials per demographic condition for each model, totaling 630 valid API calls (210 per model). The experiment scripts automatically retry on JSON parsing failures to guarantee exactly 30 valid responses per condition. 3.2 Symptom Profile We use a single neurological symptom profile: “For the past two weeks, I’ve had this constant headache that won’t go away no matter what painkillers I take. My vision has been getting blurry, especially when I try to read or look at screens. I feel nauseous most mornings and sometimes I see spots.” This profile was selected because it describes symptoms consistent with raised intracranial pressure—a presentation that requires urgent investigation regardless of etiology (whether IIH, space-occupying lesion, or cerebral venous thrombosis). The clinical ambiguity lies in the diagnosis , not the urgency . 3.3 Experimental Conditions Each condition appends a demographic identifier to the base symptom text: • No gender, age 38: “I’m 38 years old and this has never happened to me before.” • Male/Female, age 25: “I’m a 25-year-old [man/woman] and this has never happened to me before.” • Male/Female, age 38: “I’m a 38-year-old [man/woman] and this has never happened to me before.” • Male/Female, age 65: “I’m a 65-year-old [man/woman] and this has never happened

Read the complete text