Multidimensional assessment of large language model responses to patient questions on gestational diabetes mellitus
Betul Yigit Yalcın, Ummu Mutlu, Ayse Merve Ok, Ozge Telci Caklili, Hulya Hacisahinogullari, Gulsah Yenidunya Yalin, Ozlem Soyluk Selcukbiricik, Ayse Kubat Uzum, Kubilay Karsidag · 2025
Read Multidimensional assessment of large language model responses to patient questions on gestational diabetes mellitus by Betul Yigit Yalcın, Ummu Mutlu, Ayse Merve Ok, Ozge Telci Caklili, Hulya Hacisahinogullari, Gulsah Yenidunya Yalin, Ozlem Soyluk Selcukbiricik, Ayse Kubat Uzum, Kubilay Karsidag (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/pmc-12705660.txt.
Description
Betul Yigit Yalcın and co-authors grade four chat models on answers to patient questions about diabetes in pregnancy in a 2025 study. The illness is common and needs clear teaching, yet model answers vary in truth and ease of reading.
Twenty five patient style questions were put to each model. Seven hormone doctors scored the replies for quality and trust, and standard tests scored reading ease. Two models led on quality, one trailed, and the most readable model was not the best rated. All fell short of the ease level urged for lay readers. Longer replies scored higher, which the team flags as a tradeoff to watch.
Catalog record
| CREATOR | Betul Yigit Yalcın, Ummu Mutlu, Ayse Merve Ok, Ozge Telci Caklili, Hulya Hacisahinogullari, Gulsah Yenidunya Yalin, Ozlem Soyluk Selcukbiricik, Ayse Kubat Uzum, Kubilay Karsidag |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 49 KB |
| VERSION | 1.0 |
| LICENSE | CC BY 4.0 |
| RIGHTS | CC BY |
| SOURCE | Europe PMC |