AI Decision-Making Performance in Maternal–Fetal Medicine: Comparison of ChatGPT-4, Gemini, and Human Specialists in a Cross-Sectional Case-Based Study

Matan Friedman, Amit Slouk, Noa Gonen, Laura Guzy, Yael Ganor Paz, Kira Nahum Sacks, Amihai Rottenstreich, Eran Weiner, Ohad Gluck, Ilia Kleiner · 2025

Read AI Decision-Making Performance in Maternal–Fetal Medicine: Comparison of ChatGPT-4, Gemini, and Human Specialists in a Cross-Sectional Case-Based Study by Matan Friedman, Amit Slouk, Noa Gonen, Laura Guzy, Yael Ganor Paz, Kira Nahum Sacks, Amihai Rottenstreich, Eran Weiner, Ohad Gluck, Ilia Kleiner (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/pmc-12787038.txt.

Description

Two patients ride on every decision in pregnancy medicine, so testing AI there carries double weight. Matan Friedman and nine co-authors pit two chatbots against human specialists in this 2025 study. Twenty invented but realistic maternal-fetal cases went to ChatGPT-4, to Gemini, and to three specialists; twenty-two blinded experts then graded all the answers without knowing their source.

The graders scored accuracy and clinical fit on a ten-point scale, and the team measured how far the machines' judgments sat from the humans'. The design, run in late 2024, randomized case order and labels to keep the judges honest. Results speak to whether language models can be trusted as sounding boards in a field where a wrong call harms mother and child alike. The paper adds a careful data point to a fast-moving debate.

Catalog record

CREATORMatan Friedman, Amit Slouk, Noa Gonen, Laura Guzy, Yael Ganor Paz, Kira Nahum Sacks, Amihai Rottenstreich, Eran Weiner, Ohad Gluck, Ilia Kleiner
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE28 KB
VERSION1.0
LICENSECC BY 4.0
RIGHTSCC BY
SOURCEEurope PMC

Source: https://europepmc.org/articles/PMC12787038

Browse the full library · About the Tower of Babel