Exploring Bias in Medical Applications of Large Language Models: Protocol for a Systematic Review

Shweta Rao, Carol Boutrous, Andrey Kormilitzin, Xin You Tai, Lewis Hotchkiss, Cen Cong, Edward Meinert, Huizhi Liang, Hang Dong, Judith R Harrison, Javad Sarvestan · 2026

Read Exploring Bias in Medical Applications of Large Language Models: Protocol for a Systematic Review by Shweta Rao, Carol Boutrous, Andrey Kormilitzin, Xin You Tai, Lewis Hotchkiss, Cen Cong, Edward Meinert, Huizhi Liang, Hang Dong, Judith R Harrison, Javad Sarvestan (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/pmc-13561442.txt.

Description

The authors present a 2026 protocol for a systematic review of bias in medical uses of large language models. Clinics now lean on these models for decisions, teaching, and patient messages, and biased output can deepen the very disparities medicine struggles with. How the field detects and fixes that bias had never been mapped.

The review will search nine databases for studies since 2017 that measure bias, fairness, or subgroup performance. Its design is staged and self-checking: papers from the first search were screened fully by hand, forming a gold standard. An updated search will then be screened by two independent language models using the same rules, and their agreement with the human standard will be measured. The protocol itself experiments on the reviewers it studies.

Catalog record

CREATORShweta Rao, Carol Boutrous, Andrey Kormilitzin, Xin You Tai, Lewis Hotchkiss, Cen Cong, Edward Meinert, Huizhi Liang, Hang Dong, Judith R Harrison, Javad Sarvestan
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE57 KB
VERSION1.0
LICENSECC BY 4.0
RIGHTSCC BY
SOURCEEurope PMC

Source: https://europepmc.org/articles/PMC13561442

Browse the full library · About the Tower of Babel