Critical appraisal of fairness metrics for artificial intelligence-based clinical prediction models: a scoping review

João Matos, Ben Van Calster, Leo Anthony Celi, Paula Dhiman, Judy Wawira Gichoya, Richard D Riley, Chris Russell, Sara Khalid, Gary S Collins · 2026

Read Critical appraisal of fairness metrics for artificial intelligence-based clinical prediction models: a scoping review by João Matos, Ben Van Calster, Leo Anthony Celi, Paula Dhiman, Judy Wawira Gichoya, Richard D Riley, Chris Russell, Sara Khalid, Gary S Collins (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/pmc-13479377.txt.

Description

João Matos and eight colleagues reviewed in 2026 how fairness is measured in AI-based clinical prediction models. Predictive AI can improve care but also entrench bias, and what fairness itself means in this setting remains unsettled.

They screened 820 records from five databases covering 2014 to 2024, kept 42 studies, and pulled out 63 fairness metrics. The metrics formed a fragmented field, leaning on threshold-based measures with thin clinical validation; only 19 were built for health care, and just one for clinical use. Gaps in uncertainty reporting, intersectionality, and real-world fit lead the authors to urge clinically meaningful metrics first.

Catalog record

CREATORJoão Matos, Ben Van Calster, Leo Anthony Celi, Paula Dhiman, Judy Wawira Gichoya, Richard D Riley, Chris Russell, Sara Khalid, Gary S Collins
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE37 KB
VERSION1.0
LICENSECC BY 4.0
RIGHTSCC BY
SOURCEEurope PMC

Source: https://europepmc.org/articles/PMC13479377

Browse the full library · About the Tower of Babel