Performance comparison of large language models on pediatric dentistry questions in the Turkish dentistry specialization examination

Hatice Kübra Başkan, Beyhan Başkan · 2025

Read Performance comparison of large language models on pediatric dentistry questions in the Turkish dentistry specialization examination by Hatice Kübra Başkan, Beyhan Başkan (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/pmc-12751958.txt.

Description

Hatice Kübra Başkan and Beyhan Başkan present an evaluation study, published in 2025, pitting seven leading chatbots against a real dental specialty exam. The questions came from a decade of Turkish dentistry specialization tests in pediatric dentistry. Experts split them into fact recall items and case based ones, and they were fed to the models in Turkish without edits.

Accuracy differed sharply across the models. The top system answered about nineteen of every twenty questions correctly, while the weakest managed under two thirds, and one search flavored model collapsed on case questions. Fact questions proved easier than cases for most systems. The authors offer the ranking as a reality check on using chatbots in specialist medical study.

Catalog record

CREATORHatice Kübra Başkan, Beyhan Başkan
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE36 KB
VERSION1.0
LICENSECC BY 4.0
RIGHTSCC BY
SOURCEEurope PMC

Source: https://europepmc.org/articles/PMC12751958

Browse the full library · About the Tower of Babel