How to Evaluate Medical AI
Ilia Kopanichuk, Petr Anokhin, Vladimir Shaposhnikov, Vladimir Makharev, Ekaterina Tsapieva, Iaroslav Bespalov, Dmitry V. Dylov, Ivan Oseledets · 2025
Read How to Evaluate Medical AI by Ilia Kopanichuk, Petr Anokhin, Vladimir Shaposhnikov, Vladimir Makharev, Ekaterina Tsapieva, Iaroslav Bespalov, Dmitry V. Dylov, Ivan Oseledets (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-11941.txt.
Introduction
How should doctors and builders judge a medical AI system? Ilia Kopanichuk and 7 co-authors take up that question in a 2025 paper on evaluating diagnostic tools. Simple scores such as precision and recall can mislead, they argue, because expert doctors often disagree with each other on the same case.
The authors propose two new scores that compare an AI system against several expert opinions instead of one fixed answer. By adjusting for how much the experts disagree, the scores aim to give a steadier and more realistic picture of quality. The paper also reviews other diagnostic quality measures. Its approach lets both models and examiners give free-form diagnoses rather than picking from a short list.
Catalog record
| CREATOR | Ilia Kopanichuk, Petr Anokhin, Vladimir Shaposhnikov, Vladimir Makharev, Ekaterina Tsapieva, Iaroslav Bespalov, Dmitry V. Dylov, Ivan Oseledets |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 31 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-11941
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
How to Evaluate Medical AI Ilia Kopanichuk, Petr Anokhin, Vladimir Shaposhnikov, Vladimir Makharev, Ekaterina Tsapieva, Iaroslav Bespalov, Dmitry V. Dylov, Ivan Oseledets Abstract The integration of artificial intelligence (AI) into medical diagnostic workflows requires robust and consistent evaluation methods to ensure reliability, clinical relevance, and the inherent variability in expert judgments. Traditional metrics like precision and recall often fail to account for the inherent variability in expert judgments, leading to inconsistent assessments of AI performance. Inter-rater agreement statistics like Cohen’s Kappa are more reliable but they lack interpretability. We introduce Relative Precision and Recall of Algorithmic Diagnostics (RPAD and RRAD) - a new evaluation metrics that compare AI outputs against multiple expert opinions rather than a single reference. By normalizing performance against inter-expert disagreement, these metrics provide a more stable and realistic measure of the quality of predicted diagnosis. In addition to the comprehensive analysis of diagnostic quality measures, our study contains a very important side result. Our evaluation methodology allows us to avoid selecting diagnoses from a limited list when evaluating a given case. Instead, both the models being tested and the examiners verifying them arrive at a free-form diagnosis. In this automated methodology for establishing the identity of free-form clinical diagnoses, a remarkable 98% accuracy becomes attainable. We evaluate our approach using 360 medical dialogues, comparing multiple large language models (LLMs) against a panel of physicians. Large-scale study shows that top-performing models, such as DeepSeek-V3, achieve consistency on par with or exceeding expert consensus. Moreover, we demonstrate that expert judgments exhibit significant variability - often greater than that between AI and the humans. This finding underscores the limitations of any absolute metrics and supports the need to adopt relative metrics in medical AI. 1 Introduction The rapid advancement of artificial intelligence in healthcare has opened new frontiers in medical diagnostics, promising faster, more accurate, and more accessible disease detection Topol 2019 ; Yu et al. 2018 . As AI systems increasingly demonstrate their capability to analyze medical imaging, laboratory results, and patient data, their potential to revolutionize diagnostic processes has garnered significant attention from healthcare providers, researchers, and industry stakeholders Rajpurkar et al. 2022 ; McKinney et al. 2020 ; Liu et al. 2019 . Recent studies suggest that AI-powered diagnostic tools can match or even exceed human performance in specific areas, such as detecting certain types of cancer in radiological images or identifying pathological patterns in tissue samples. However, the implementation of AI diagnostics faces several critical challenges that demand careful examination. Questions about the reliability, reproducibility, and generalizability of AI diagnostic systems remain paramount concerns in the medical community Nagendran et al. 2020 ; He et al. 2019 ; Roberts et al. 2021 . The "black box" nature of many AI algorithms, combined with potential biases in training data and the variability in real-world clinical settings, raises important issues about the trustworthiness and clinical validity of these systems Chen et al. 2021 ; Obermeyer et al. 2019 ; Gianfrancesco et al. 2018 . Furthermore, the integration of AI diagnostics into existing healthcare workflows presents practical challenges related to regulatory compliance, liability considerations, and the need for standardized validation protocols Wiens et al. 2019 ; Panch et al. 2019 . The quality assessment of AI diagnostic systems represents a complex multifaceted problem that encompasses technical performance, clinical utility, and ethical considerations Liu et al. 2019 ; Kelly et al. 2019 ; Mongan et al. 2020 . While numerous studies have demonstrated promising results in controlled settings, there is a pressing need for comprehensive evaluation frameworks that can assess these systems’ performance across diverse patient populations and clinical environments . Understanding the limitations, failure modes, and potential biases of AI diagnostics is crucial for their safe and effective deployment in healthcare settings, where decisions can have profound implications for patient outcomes van der Laak et al. 2021 ; Cabitza et al. 2017 . 2 Related Work The application of artificial intelligence to medical diagnostics has evolved significantly, with each stage of development marked by key advancements and the emergence of new challenges. The history of diagnostic systems provides important context for understanding the current focus on robust quality metrics, as these metrics are now critical to ensuring the reliability and safety of AI in healthcare. 2.1 Evolution of Medical Diagnostic Systems Early diagnostic systems, such as the rule-based expert systems Mycin and DXplain, pioneered the use of AI to support clinical decision-making Shortliffe 1977 ; Barnett et al. 1987 . These systems relied on hand-crafted rules and knowledge bases, allowing them to provide interpretable recommendations. However, their static nature and inability to learn from new data limited their adaptability, particularly in the face of complex and varied patient presentations. The subsequent era introduced task-specific AI models driven by machine learning techniques. Platforms like Babylon Health and Ada Health demonstrated the potential for data-driven approaches to triage and symptom assessment Moramarco et al. 2021 ; Kühnel et al. 2023 . Although these models offered improvements in diagnostic speed and scalability, they often relied on narrow training datasets and single-turn interactions, which restricted their ability to engage in more comprehensive diagnostic reasoning. The advent of large language models (LLMs) marked a turning point in medical AI. Systems such as AMIE, DISC-MedLLM, MEDAGENTS and e.t.c have integrated structured multi-turn dialogue processing, advanced natural language understanding, and expansive medical knowledge bases Bao et al. 2023 ; Tang et al. 2024 ; Mukherjee et al. 2024 ; Yu et al. 2025 ; Tu et al. 2024 ; Sun et al. 2024 .By emulating more complex diagnostic pathways and incorporating domain-specific medical data, these LLMs have set a new benchmark for what AI-driven diagnostic systems can achieve. However, they also exposed persistent challenges, including the difficulty of maintaining consistent reasoning across multi-turn dialogues and struggles with the reliability and fairness of diagnostic outputs. Introducing metrics that provide a stable and clinically meaningful assessment can help address these issues by aligning system performance evaluations with the expectations of medical professionals. 2.2 The Importance of Quality Metrics As diagnostic systems have become more sophisticated, the role of quality metrics in evaluating their performance has taken center stage. Traditional accuracy measures, while informative, often fail to capture the complexity of real-world diagnostic tasks Zhou et al. 2024 ; Shi et al. 2024 . More nuanced metrics are needed to assess not only how often a system gets the correct answer, but also how well it handles ambiguous cases, rare conditions, and diverse patient populations. Recent research emphasizes the importance of metrics that reflect clinical relevance and safety Mehandru et al. 2024 ; Meng et al. 2024 ; Nazi and Peng 2024 ; Bedi et al. 2024 . For example, studies have proposed using metrics aligned with physician judgments or derived from simulation-based evaluations that mimic real-world clinical workflows Mehandru et al. 2024 ; Ahsan et al. 2024 . These approaches help ensure that AI systems are evaluated in contexts that closely mirror the environments in which they will be used. Additionally, stratified metrics—such as those that measure performance across different demographic groups—are becoming essential tools for identifying and mitigating biases Yang et al. 2024 ; Simmons et al. 2024 . Another critical aspect is the assessment of