A Scalable Framework for Evaluating Health Language Models

Neil Mallinar, A. Ali Heydari, Xin Liu, Anthony Z. Faranesh, Brent Winslow, Nova Hammerquist, Benjamin Graef, Cathy Speed, Mark Malhotra, Shwetak Patel, Javier L. Prieto, Daniel McDuff, Ahmed A. Metwally · 2025

Read A Scalable Framework for Evaluating Health Language Models by Neil Mallinar, A. Ali Heydari, Xin Liu, Anthony Z. Faranesh, Brent Winslow, Nova Hammerquist, Benjamin Graef, Cathy Speed, Mark Malhotra, Shwetak Patel, Javier L. Prieto, Daniel McDuff, Ahmed A. Metwally (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-23339.txt.

Introduction

Neil Mallinar and co-authors frame a scalable way to grade health chat models in a 2025 paper. Health chat tools give personal replies from patient data of many kinds. Open ended replies need grades on truth, fit, and safety at once.

Expert human grades are dear, slow, and hard to scale in medicine. Their frame uses tight yes no rubrics that flag gaps in a reply. Few rubrics per task keep the grade load lean. Both human and auto graders can run the same rubrics. Large health tools could thus be graded often and in depth sans vast expert teams.

Catalog record

CREATORNeil Mallinar, A. Ali Heydari, Xin Liu, Anthony Z. Faranesh, Brent Winslow, Nova Hammerquist, Benjamin Graef, Cathy Speed, Mark Malhotra, Shwetak Patel, Javier L. Prieto, Daniel McDuff, Ahmed A. Metwally
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE115 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-23339

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

A Scalable Framework for Evaluating Health Language Models Neil Mallinar, A. Ali Heydari, Xin Liu, Anthony Z. Faranesh, Brent Winslow, Nova Hammerquist, Benjamin Graef, Cathy Speed, Mark Malhotra, Shwetak Patel, Javier L. Prieto, Daniel McDuff, Ahmed A. Metwally Abstract Large language models (LLMs) have emerged as powerful tools for analyzing and interpreting complex datasets. Recent studies demonstrate their potential to generate useful, personalized responses when provided with patient-specific health information that encompasses lifestyle, biomarkers, and context. As LLM-driven health applications are increasingly adopted, rigorous and efficient one-sided evaluation methodologies are crucial to ensure response quality across multiple dimensions, including accuracy, personalization, relevance and safety. However, current evaluation practices, particularly for open-ended text responses, heavily rely on human experts. This approach introduces human factors (perspectives, potential biases, inconsistencies) and is often cost-prohibitive, labor-intensive, and hinders scalability, especially in complex domains like healthcare where response assessment necessitates domain expertise and considers multifaceted patient data, which is often nuanced and diverse. In this work, we introduce Adaptive Precise Boolean rubrics: an evaluation framework that aims to streamline human and automated evaluation of open-ended questions by identifying critical gaps in model responses using a minimal set of targeted rubrics questions. Our approach is based on recent work in more general evaluation settings that contrasts a smaller set of complex evaluation targets with a larger set of more precise, granular targets answerable with simple boolean responses. We validate this approach in metabolic health, a domain encompassing diabetes, cardiovascular disease, and obesity. Our results demonstrate that Adaptive Precise Boolean rubrics yield substantially higher inter-rater agreement among both expert and non-expert human evaluators, as well as in automated assessments, compared to traditional Likert scales, while requiring approximately half the evaluation time of Likert-based methods. This enhanced efficiency and scalability, particularly through automated evaluation and non-expert contributions, paves the way for more extensive and cost-effective evaluation of LLMs in health. \reportnumber † † footnotetext: ∗ Work done while at Google Research. Introduction The convergence of artificial intelligence and healthcare is being fundamentally reshaped by the use of language models (LMs) that can perform complex linguistic operations 4 . These models, capable of processing and reasoning multimodal health data, are not merely tools, but represent a potential paradigm shift in how medical knowledge and information is accessed, synthesized, and utilized, with applications such as medical question and answering 45 , differential diagnosis 33 , electronic health record reasoning 43 , and biomedical research discovery 20 . This potential of LLMs extends beyond traditional healthcare, with accelerating adoption observed across a wide spectrum of consumer health applications including sleep and fitness coaching 26 , wearable insights extraction 34 , personalized health coaching 23 , symptom checkers 16 , and clinical examination dialogues 49 . Figure 1 : A precision rubric for evaluating open-ended language responses to health queries. (A) A set of representative health queries and wearable data are used to construct inputs to the language model, which are then evaluated using our proposed evaluation rubric. (B) Our Results indicate that the proposed Precise Boolean rubric leads to higher agreement with humans (both experts and non-expert). Moreover, leveraging our proposed Adaptive Precise Boolean, the time being used in evaluation is halved compared to the traditional Likert scale, while maintaining high rater agreement and high quality evaluation. (C) An example of a query and response highlighting references to specific relevant parts of the response. (D) Examples of evaluation rubrics for assessing the generated response to input query Evaluation is a critical component in the development and validation of AI models. In safety-critical applications such as healthcare, this process must extend beyond standard benchmarks to assess model robustness. Techniques such as adversarial testing and red-teaming are essential to systematically probe for vulnerabilities and elicit unsafe or factually incorrect responses not typically observed in curated datasets 8 , 54 . However, these rigorous evaluations often rely on manual, creative human effort, which compounds the challenge of scalability and highlights the need for more efficient methodologies 7 . Unlike discriminative tasks (e.g., multiple choice questions/classification), open-ended generative language tasks are more complex to evaluate as there can be manifold answers with multiple properties (e.g., accuracy, comprehensiveness, relevance) - there is not a single “right answer" 29 . Questionnaires tend to fall into four categories: yes or no questions (binary choice), multiple choice (multichoice), open-ended text responses, and responses on ordinal scales of approval or disapproval 30 . The last of these can be used to capture additional nuance where there are degrees of “correctness” and no single correct category. Indeed, previous studies in the health domain have used Likert scales to grade open-ended LLM responses 45 , 33 , 26 , however, it was observed that rater agreement measures in such cases can be suboptimal. Where an objective correct answer is not present, it is necessary to assess the quality of a scoring rubric by measuring the agreement of qualified raters 27 . Identifying evaluation systems that improve on such agreement measures is of broad interest in the evaluation literature. Comprehensive evaluation of LLM-based systems requires a robust evaluation approach, encompassing a spectrum of methodologies ranging from unidimensional numerical scales (e.g. Likert) and categorical judgments to sophisticated statistical and model-based semantic assessments 27 , 56 , 30 . While numerical scales, such as Likert 30 , offer apparent simplicity for evaluating LLM-generated text, this very simplicity can lead to an oversimplification of complex response attributes, resulting in a loss of critical nuanced information 52 . Conversely, categorical scoring systems, while providing more distinct classifications, sacrifice granularity in assessment. Statistical and model-based metrics, while offering objectivity and scalability, may not fully capture the qualitative dimensions of LLM responses, such as creativity or nuanced understanding. Therefore, a balanced evaluation framework is crucial to accurately assess the diverse capabilities of LLMs. Currently for health evaluations, there is a strong reliance on extensive human expert review (e.g., Khasentino et al. 26 requiring hundreds of hours of expert time to evaluate 900 case studies). While these human evaluations may provide nuanced assessments, they inherently restrict scalability due to high costs and protracted timelines. Furthermore, the subjective nature of Likert scale ratings introduces substantial inter-rater inconsistencies, compromising result reliability 13 . Existing automated evaluation frameworks, while addressing scalability, struggle to replicate the comprehensive, context-aware judgments of human experts, often producing sub-optimal and incomplete evaluations 42 . On one hand, LLMs can be capable evaluators and provide evaluations on complex rubrics that align with human evaluators 10 . However, there is the need for specific verification and optimization in safety-critical domains such as health. The conventional paradigm of evaluating complex biomedical models, particularly those integrating blood biomarkers and wearable data with open-ended textual responses, faces critical limitations. This necessitates the development of a novel framework that bridges the gap between human expertise and computational efficiency. The various aspects of generative AI evaluation may be organized into a framework or taxonomy to facilitate their use. However, available frameworks have a limited focus on principles for evaluation and/or narrow scopes, such as focusing on what, where, and how to evaluate 9 , or providing disparate pathways for specific use 21 such as health conversations 1 . Others have suggested a more holistic evaluation,

Read the complete text