A Women’s Health Benchmark for Large Language Models

Victoria-Elisabeth Gruber, Razvan Marinescu, Diego Fajardo, Amin H. Nassar, Christopher Arkfeld, Alexandria Ludlow, Shama Patel, Mehrnoosh Samaei, Valerie Klug, Anna Huber, Marcel Gühner, Albert Botta i Orfila, Irene Lagoja, Kimya Tarr, Haleigh Larson, Mary Beth Howard · 2025

Read A Women’s Health Benchmark for Large Language Models by Victoria-Elisabeth Gruber, Razvan Marinescu, Diego Fajardo, Amin H. Nassar, Christopher Arkfeld, Alexandria Ludlow, Shama Patel, Mehrnoosh Samaei, Valerie Klug, Anna Huber, Marcel Gühner, Albert Botta i Orfila, Irene Lagoja, Kimya Tarr, Haleigh Larson, Mary Beth Howard (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-17028.txt.

Introduction

Victoria-Elisabeth Gruber and a large team introduce the Women Health Benchmark, the first test set built to grade language models on women health alone. As chatbots become first stops for health questions, their accuracy in this area had gone unmeasured.

The bench holds 96 validated case stumps across five specialties, from obstetrics to neurology, three query types, and eight error types such as dosage slips and missed urgency. Thirteen top models were graded, and failure rates ran near 60 percent. All models struggled to flag urgent cases, while GPT-5 cut inappropriate advice sharply. The team warns that chatbots are not yet reliable guides in women health.

Catalog record

CREATORVictoria-Elisabeth Gruber, Razvan Marinescu, Diego Fajardo, Amin H. Nassar, Christopher Arkfeld, Alexandria Ludlow, Shama Patel, Mehrnoosh Samaei, Valerie Klug, Anna Huber, Marcel Gühner, Albert Botta i Orfila, Irene Lagoja, Kimya Tarr, Haleigh Larson, Mary Beth Howard
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE30 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2512-17028

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

A Women’s Health Benchmark for Large Language Models Victoria-Elisabeth Gruber, Razvan Marinescu, Diego Fajardo, Amin H. Nassar, Christopher Arkfeld, Alexandria Ludlow, Shama Patel, Mehrnoosh Samaei, Valerie Klug, Anna Huber, Marcel Gühner, Albert Botta i Orfila, Irene Lagoja, Kimya Tarr, Haleigh Larson, Mary Beth Howard Abstract As large language models (LLMs) become primary sources of health information for millions, their accuracy in women’s health remains critically unexamined. We introduce the Women’s Health Benchmark (WHB), the first benchmark evaluating LLM performance specifically in women’s health. Our benchmark comprises 96 rigorously validated model stumps covering five medical specialties (obstetrics and gynecology, emergency medicine, primary care, oncology, and neurology), three query types (patient query, clinician query, and evidence/policy query), and eight error types (dosage/medication errors, missing critical information, outdated guidelines/treatment recommendations, incorrect treatment advice, incorrect factual information, missing/incorrect differential diagnosis, missed urgency, and inappropriate recommendations). We evaluated 13 state-of-the-art LLMs and revealed alarming gaps: current models show approximately 60% failure rates on the women’s health benchmark, with performance varying dramatically across specialties and error types. Notably, models universally struggle with "missed urgency" indicators, while newer models like GPT-5 show significant improvements in avoiding inappropriate recommendations. Our findings underscore that AI chatbots are not yet fully able of providing reliable advice in women’s health. 1 Introduction Artificial intelligence (AI) has made significant progress in various domains, including healthcare, with the potential to significantly improve patient care and quality of life patil2023AI OLAWADE2024AI . Medical diagnosis is one application area where AI has already shown promising results, as algorithms are able to identify patterns in medical images and text that are not readily visible to the human eye pinto2023artificial . Another field where AI is making significant progress is personalized medicine, where algorithms are identifying patterns in vast volumes of patient data and providing personalized treatment plans taking into account the patient’s unique genetics, lifestyle and medical history johnson2021precision . AI is also being utilized to increase the effectiveness of clinical operations, through integration of chatbots and virtual assistants, to help with patient intake and triage alowais2023revolutionizing . Hence, it is not surprising that more and more patients and physicians are turning towards AI chatbots for health related questions and get help in clinical decision making everyday. Roughly one in six adults has used an AI chatbot for health related questions in the last year kff_ai_health_info_2024 . This gives rise to the question: How accurate are AI models when it comes to women’s health-related questions? Historically, women have been underrepresented in research and clinical trials, meaning that a majority of available data is biased toward male populations due to a myriad of reasons karpel2025missing rittenberg2025women . Some of the major reasons include biological sex differences (physiological differences driven by chromosomal, hormonal, and anatomical factors), gender effects (differences arising from socially constructed roles, behaviors, and identities) and inadequate research in women, such as excluding pregnant women and women of child-bearing age from participating in clinical studies for decades bartz2020clinical national2024advancing iom_sex_matter_2001 . Bias in the training data of large language models arises not only from the historical underrepresentation of women in research, but also from shortcut learning and spurious correlations present in imbalanced or noisy medical training datasets. As a result, models may rely on simplified patterns or stereotypes instead of true medical reasoning, leading to confident but incorrect responses that can worsen sex- and gender-related gaps in healthcare. dogra2024shortcut ye2024cleverhans geirhos2020shortcut A recent study examining online reproductive health misinformation across multiple social media platforms and websites found that 23% of the content included medical recommendations that do not align with professional guidelines john2025online . They further found that potentially misleading claims and narratives about reproductive topics like contraception, abortion, fertility, chronic disease, breast cancer, maternal health, and vaccines are abundant across several social media platforms and websites john2025online . While some benchmarks exist for general healthcare, to our knowledge, no specific benchmark currently exists that evaluates the credibility and safety of AI models in the domain of women’s health. In this paper, we investigate the accuracy of LLMs for women’s health-related questions. Our proposed benchmark consists of 5 specialties: obstetrics and gynecology, emergency medicine, primary care, oncology, and neurology. We run three types of queries: patient queries, clinician queries, and evidence/policy queries, as well as eight error types: (1) dosage/medication errors, (2) missing critical information, (3) outdated guidelines/treatment recommendations, (4) incorrect treatment advice, (5) incorrect factual information, (6) missing/incorrect differential diagnosis, (7) missed urgency, and (8) inappropriate recommendations. This is to ensure that the benchmark is comprehensive and covers a wide range of women’s health topics. We benchmarked the following models: Claude 4.0 Opus, Claude 4.0 Sonnet, Gemini 2.5 Flash, Gemini 2.5 Pro, Gemini 3 Pro, GPT-4o Mini, GPT-5, GPT-5.1, o3, o3 Mini, Grok 4, Ministral-8B, and Mistral Large. We found that the overall best performing model was GPT-5, followed by Gemini 3 Pro with best performance in obstetrics and gynecology. Importantly, no model demonstrated consistently high performance throughout all specialties, error types and query types. An overview of our contributions is as follows: • The Women’s Health Benchmark (WHB) which includes 96 realistic open-ended prompts across five medical specialties (obstetrics and gynecology, emergency medicine, primary care, oncology, and neurology). • It was produced with the help of 17 women’s health experts including clinicians, pharmacists, and researchers across the United States of America and Europe. • We measure the performance of the WHB across 13 LLMs. • Women’s health experts were asked to prompt from either a patient or doctor perspective or ask evidence-based questions. • We release the WHB data and code via The Lumos AI Labs Hugging Face repository. 2 Related Work A prime example of a field in which sex and gender differences have been extensively studied in recent years is cardiovascular disease. Cardiovascular disease has been perceived as a ’man’s disease’, and this misconception has led to under-diagnosis and treatment for women worldwide schenck2009risk . In a recent study Burgess et al. evaluated the representation of women in cardiovascular randomized controlled trials and reported that women are significantly under-represented in clinical trials both as participants and researchers burgess2025under . Another study observed that women are less likely than men to receive diagnostic tests, interventions, or appropriate preventive treatments, pointing to bias in diagnostic and care protocols al2024gender . Medical large language model benchmarks encompass a broad spectrum of tasks, including clinical knowledge representation, differential diagnosis generation, complex medical text summarization, and the emulation of clinical reasoning and empathy in patient interactions singhal2023expertlevelmedicalquestionanswering mcduff2023accuratedifferentialdiagnosislarge van_veen_2024 savage2023diagnosticreasoningpromptsreveal . Another recognized benchmark in the field, HealthBench, advances the field by assessing clinician–patient interactions through question-specific evaluation rubrics arora2025healthbenchevaluatinglargelanguage . One of the key challenges in AI in healthcare is the need to ensure that the AI systems are able to learn from data in a way that is not biased and that is able to generalize to new patients and new data. Figure 1 : Overview of WHB methodology. Top: Dataset collection workflow showing how the expert cohort generated women’s health-related clinical prompts, which were randomly assigned to one of the 13 LLMs to identify incorrect responses that became model stumps. Bottom: Model performance evaluation workflow showing how the 96 model stumps were used to

Read the complete text