Demographic prompt cues shift clinical recommendations in multimodal large language models: a multi-model audit of 25,380 dental radiograph assessments

Babak Saravi, Ingrid Winkler, Daman Deep Singh, Julian Lommen, Max Wilkat, Lara Schorn, Andreas Vollmer, Michael Vollmer, Norbert Kübler, Christoph Sproll, Felix Schrader · 2026

Read Demographic prompt cues shift clinical recommendations in multimodal large language models: a multi-model audit of 25,380 dental radiograph assessments by Babak Saravi, Ingrid Winkler, Daman Deep Singh, Julian Lommen, Max Wilkat, Lara Schorn, Andreas Vollmer, Michael Vollmer, Norbert Kübler, Christoph Sproll, Felix Schrader (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/pmc-13262511.txt.

Description

Babak Saravi and colleagues audited in 2026 whether demographic cues in a prompt can sway image-reading language models giving dental advice. They sent 705 panoramic dental X-rays from a public set to three commercial multimodal models. Each image arrived under twelve prompt conditions varying stated race, ethnicity, and sex, plus controls.

The audit totaled 25,380 model calls, each returning ten structured recommendation fields. All three models shifted their advice when demographic labels appeared. One model reacted most broadly, moving treatment invasiveness, outlook, and confidence across groups. The shifts were systematic yet small, each under six percent of a rating step. Agreement between models under plain prompts hovered near chance, a larger worry than the label effects. The authors ask for routine demographic audits before such tools reach clinics.

Catalog record

CREATORBabak Saravi, Ingrid Winkler, Daman Deep Singh, Julian Lommen, Max Wilkat, Lara Schorn, Andreas Vollmer, Michael Vollmer, Norbert Kübler, Christoph Sproll, Felix Schrader
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE87 KB
VERSION1.0
LICENSECC BY 4.0
RIGHTSCC BY
SOURCEEurope PMC

Source: https://europepmc.org/articles/PMC13262511

Browse the full library · About the Tower of Babel