Implicit Geographic Inference in LLM Medical Triage: Language-Driven Disparities in Emergency Recommendations
Qi Han Wong · 2026
Read Implicit Geographic Inference in LLM Medical Triage: Language-Driven Disparities in Emergency Recommendations by Qi Han Wong (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-01204.txt.
Introduction
Wong tests if the language of a prompt skews medical advice. He gives one model the same set of nerve symptoms each time. The symptoms are a long headache, blurred sight, and nausea. He runs the prompt in six languages, 30 times each. In total he makes 450 calls to the Gemini Flash model. Urgent care advice varies a lot by language.
The model urges an ER trip in none of the Hindi and Japanese runs. It does so in 30% of English and Arabic runs. Yet its severity scores stay near eight out of ten in all tongues. One line that names a US site lifts ER rates sharply. It can add up to about 77 points for non-English prompts. A Tokyo line cuts the English rate to about 7%.
Catalog record
| CREATOR | Qi Han Wong |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 17 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.01204
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Implicit Geographic Inference in LLM Medical Triage: Language-Driven Disparities in Emergency Recommendations Qi Han Wong Abstract We investigate whether large language models produce different medical triage recommendations for identical symptoms based solely on the language of the patient prompt. Using Gemini 3.5 Flash, we evaluate a neurological symptom profile (persistent headache, blurred vision, nausea) across six languages (English, Spanish, Chinese, Hindi, Japanese, Arabic) with 30 runs per condition ( n = 450 n=450 total API calls). We find that the model recommends emergency room visits at rates ranging from 0% (Japanese, Hindi) to 30% (English, Arabic), despite assigning nearly identical severity scores (7.7–8.0/10) across all languages. Adding a single sentence specifying the patient’s US location increases ER recommendations by up to 76.7 percentage points for non-English prompts, while the reverse anchor (English prompt with a Tokyo location) reduces the ER rate from 30% to 6.7%. A back-translation control (Japanese → \rightarrow English) produces ER rates comparable to the English baseline, confirming that the disparity is not caused by translation quality but by implicit geographic inference from the input language. We release the complete dataset, experiment code, and results. 1 Introduction Large language models are increasingly deployed in healthcare-adjacent applications, including symptom checkers, triage assistants, and patient-facing chatbots ( Singhal et al. 2023 ; Nori et al. 2023 ) . A critical assumption underlying these deployments is that the model’s clinical recommendations are driven by the medical content of the input, not by superficial features such as the language in which the query is written. We test this assumption directly. We present a single neurological symptom profile—persistent headache, blurred vision, morning nausea, and visual disturbances in a 38-year-old patient—to Gemini 3.5 Flash in six languages and measure the recommended clinical action (emergency room vs. doctor appointment). All prompts are semantically equivalent, manually authored to match native phrasing conventions in each language. Our key finding is that the model uses language as a proxy for geographic location , then applies the healthcare norms of the inferred country: • A Japanese prompt yields 0% ER recommendations (consistent with Japan’s clinic-first pathway) • An English prompt yields 30% ER recommendations (consistent with US defensive medicine norms) • The model assigns severity scores of 7.7–8.0/10 across all languages, confirming equivalent clinical comprehension We validate this mechanism through three controls: (1) adding a US location anchor to non-English prompts increases ER rates by 46.7–76.7 percentage points; (2) adding a Tokyo location anchor to the English prompt reduces the ER rate from 30% to 6.7%; and (3) back-translating the Japanese prompt to English produces ER rates comparable to the English baseline (36.7% vs. 30%), ruling out translation quality as a confound. This behavior is consistent with the model learning country-specific healthcare practices from its training data. It produces appropriate recommendations for users located in the country associated with their language, but fails for immigrants, expatriates, tourists, and multilingual users whose language does not match their geographic location. Contributions: 1. We demonstrate that a production LLM produces systematically different medical triage recommendations based on prompt language, independent of clinical content. 2. We identify the mechanism as implicit geographic inference from language, validated through location anchoring and back-translation controls. 3. We release the complete experiment code, prompts, and raw results for reproduction. 1 1 1 https://github.com/wongqihan/ai-behavioral-experiments 2 Related Work Bias in Clinical NLP. Prior work has documented racial and gender biases in LLM-generated medical content. Zack et al. 2024 found that GPT-4 perpetuates race-based clinical decision-making when racial identifiers are included in prompts. Omiye et al. 2023 showed that large language models propagate race-based medicine by reproducing debunked claims about biological differences between racial groups. Our work extends this literature by demonstrating that language itself —without any explicit demographic identifiers—functions as a proxy variable that shifts clinical recommendations. Multilingual Disparities in LLMs. Cross-lingual performance gaps in LLMs are well-documented. Models consistently perform worse on non-English benchmarks ( Ahuja et al. 2023 ; Lai et al. 2023 ) , and safety alignment degrades in low-resource languages ( Deng et al. 2024 ; Yong et al. 2024 ) . However, most prior work focuses on capability gaps (the model understands less) rather than normative shifts (the model applies different standards). Our finding is distinct: the model comprehends the symptoms equally well across languages (identical severity scores) but deliberately applies different action thresholds. Geographic and Cultural Priors. LLMs encode geographic and cultural knowledge from their training corpora ( Manvi et al. 2024 ) . Li et al. 2024 show that LLMs exhibit systematic cultural biases that correlate with the geographic distribution of their training data, producing culturally loaded outputs even when no cultural context is specified. Our work shows that this internalized geographic knowledge actively modifies clinical recommendations, creating a coupling between input language and inferred healthcare infrastructure. AI Fairness in Healthcare. The deployment of AI in clinical settings raises fundamental fairness concerns ( Chen et al. 2021 ; Obermeyer et al. 2019 ) . Obermeyer et al. 2019 demonstrated that a widely-used commercial algorithm exhibited significant racial bias in predicting healthcare needs. Our finding adds a new dimension: language-based geographic inference as a source of disparate treatment in AI triage systems. 3 Methodology 3.1 Model and Configuration We use Gemini 3.5 Flash (Google, May 2026 release) with temperature 0.3 and 30 runs per condition, totaling approximately 450 API calls. We chose a low temperature to maximize response consistency while preserving some stochastic variation for statistical analysis. 3.2 Symptom Profile We use a single neurological symptom profile describing a 38-year-old patient with: • Persistent headache for two weeks, unresponsive to painkillers • Progressive blurred vision, especially when reading or using screens • Morning nausea • Occasional visual disturbances (spots) • No prior history of similar symptoms This profile was selected because it is clinically ambiguous—the symptoms are consistent with conditions ranging from tension headache (low urgency) to increased intracranial pressure (high urgency)—creating a decision boundary where contextual priors can influence the recommended action. 3.3 Prompt Design All symptom prompts were manually authored (not machine-translated) to match native phrasing conventions in each language: English, Spanish, Chinese (Simplified), Hindi, Japanese, and Arabic. These six languages were selected to represent diverse writing systems, geographic regions, and healthcare infrastructure norms. The system prompt enforces structured JSON output with the following fields: diagnosis (English), severity (1–10), urgency (Emergency/Urgent/Routine), action (ER/Doctor appointment/Self-care), tests (list), and reasoning (English). The system prompt is always in English, regardless of the user prompt language. 3.4 Test Conditions 1. Baseline: Symptom prompts in 6 languages with no location context. 6\times 30=180 calls. 2. US Location Anchor: Same prompts with an appended sentence in each language: “Assume the patient is located in the United States.” 6\times 30=180 calls. 3. Reverse Anchor: English prompt with “Assume the patient is located in Tokyo, Japan” or “Assume the patient is located in Mumbai, India.” 2\times 30=60 calls. 4. Back-translation Control: The Japanese prompt is translated to English by the same model, then triaged. This controls for translation quality. 1\times 30=30 calls. 3.5 Metrics Our primary outcome variable is the ER recommendation rate (proportion of runs where action = “ER”). Secondary variables include average severity score and urgency classification. All 450 API calls returned valid, parseable JSON responses