Multidimensional assessment of large language model responses to patient questions on gestational diabetes mellitus

Betul Yigit Yalcın, Ummu Mutlu, Ayse Merve Ok, Ozge Telci Caklili, Hulya Hacisahinogullari, Gulsah Yenidunya Yalin, Ozlem Soyluk Selcukbiricik, Ayse Kubat Uzum, Kubilay Karsidag · 2025

Read Multidimensional assessment of large language model responses to patient questions on gestational diabetes mellitus by Betul Yigit Yalcın, Ummu Mutlu, Ayse Merve Ok, Ozge Telci Caklili, Hulya Hacisahinogullari, Gulsah Yenidunya Yalin, Ozlem Soyluk Selcukbiricik, Ayse Kubat Uzum, Kubilay Karsidag (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/pmc-12705660.txt.

Description

Betul Yigit Yalcın and co-authors grade four chat models on answers to patient questions about diabetes in pregnancy in a 2025 study. The illness is common and needs clear teaching, yet model answers vary in truth and ease of reading.

Twenty five patient style questions were put to each model. Seven hormone doctors scored the replies for quality and trust, and standard tests scored reading ease. Two models led on quality, one trailed, and the most readable model was not the best rated. All fell short of the ease level urged for lay readers. Longer replies scored higher, which the team flags as a tradeoff to watch.

Catalog record

CREATORBetul Yigit Yalcın, Ummu Mutlu, Ayse Merve Ok, Ozge Telci Caklili, Hulya Hacisahinogullari, Gulsah Yenidunya Yalin, Ozlem Soyluk Selcukbiricik, Ayse Kubat Uzum, Kubilay Karsidag
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE49 KB
VERSION1.0
LICENSECC BY 4.0
RIGHTSCC BY
SOURCEEurope PMC

Source: https://europepmc.org/articles/PMC12705660

Browse the full library · About the Tower of Babel