CardAIc-Agents: A Multimodal Framework with Hierarchical Adaptation for Cardiac Care Support

Yuting Zhang, Karina V. Bunting, Asgher Champsi, Xiaoxia Wang, Wenqi Lu, Alexander Thorley, Sandeep S Hothi, Zhaowen Qiu, Dipak Kotecha, Jinming Duan · 2025

Read CardAIc-Agents: A Multimodal Framework with Hierarchical Adaptation for Cardiac Care Support by Yuting Zhang, Karina V. Bunting, Asgher Champsi, Xiaoxia Wang, Wenqi Lu, Alexander Thorley, Sandeep S Hothi, Zhaowen Qiu, Dipak Kotecha, Jinming Duan (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-13256.txt.

Introduction

Yuting Zhang, Karina Bunting, and colleagues built an artificial intelligence framework to support heart care in a 2025 medical study. Heart disease kills more people than any other cause, and a shortage of health workers leaves gaps in screening and follow-up. Earlier AI agents followed rigid step-by-step workflows, unlike real care, where test results redirect the next move.

Their system adapts in a hierarchy, choosing specific tests and personalizing later steps from earlier results. Multiple data types feed the agents, matching how clinicians combine scans, records, and history. The design aims at automated detection and proactive screening that still behaves like adaptive clinical reasoning.

Catalog record

CREATORYuting Zhang, Karina V. Bunting, Asgher Champsi, Xiaoxia Wang, Wenqi Lu, Alexander Thorley, Sandeep S Hothi, Zhaowen Qiu, Dipak Kotecha, Jinming Duan
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE35 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-13256

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

CardAIc-Agents: A Multimodal Framework with Hierarchical Adaptation for Cardiac Care Support Yuting Zhang, Karina V. Bunting, Asgher Champsi, Xiaoxia Wang, Wenqi Lu, Alexander Thorley, Sandeep S Hothi, Zhaowen Qiu, Dipak Kotecha, Jinming Duan Abstract Cardiovascular diseases (CVDs) remain the foremost cause of mortality worldwide, a burden worsened by a severe deficit of healthcare workers. Artificial intelligence (AI) agents have shown potential to alleviate this gap via automated early detection and proactive screening, yet their clinical application remains limited by: 1) prompt-based clinical role assignment that relies on intrinsic model capabilities without domain-specific tool support; or 2) rigid sequential workflows, whereas clinical care often requires adaptive reasoning that orders specific tests and, based on their results, guides personalised next steps; 3) general and static knowledge bases without continuous learning capability; and 4) fixed unimodal or bimodal inputs and lack of on-demand visual outputs when further clarification is needed. In response, a multimodal framework, CardAIc-Agents, was proposed to augment models with external tools and adaptively support diverse cardiac tasks. Specifically, a CardiacRAG agent generated general plans from updatable cardiac knowledge, while the chief agent integrated tools to autonomously execute these plans and deliver decisions. To enable adaptive and case-specific customization, a stepwise update strategy was proposed to dynamically refine plans based on preceding execution results, once the task was assessed as complex. In addition, a multidisciplinary discussion tool was introduced to interpret challenging cases, thereby supporting further adaptation. When clinicians raised concerns, visual review panels were provided to assist final validation. Experiments across three datasets showed the efficiency of CardAIc-Agents compared to mainstream Vision–Language Models (VLMs), state-of-the-art agentic systems, and fine-tuned VLMs. Introduction Cardiovascular diseases (CVD) are the leading cause of mortality worldwide, with 17.9 million people deaths each year ( Almeida et al. 2024 ) . Notably, up to 80% of these deaths occur in low- and middle-income countries, where specialised care is limited ( Bulto and Hendriks 2024 ) , and this, combined with a global shortage of over 4 million healthcare workers ( Vedanthan and Fuster 2011 ) , drives the demand for scalable and accessible cardiovascular care solutions. Recent advancements in large language models (LLMs) have achieved human-level performance; for instance, GPT-4o and Med-PaLM have outperformed clinicians on standardized assessments like the United States Medical Licensing Examination ( Brin et al. 2023 ; Singhal et al. 2025 ) . Despite these achievements, however, clinical practice, particularly for complex chronic conditions (e.g., heart failure, HF), often depends on multimodal data in diagnosis, prognosis, and treatment ( Weintraub 2019 ) . This underscores the importance of multimodal strategies that go beyond language to support clinical practice. While vision-language models (VLMs) such as LLaVA-Med ( Li et al. 2023 ) and MedGemma ( Sellergren et al. 2025 ) have fueled anticipation for medical multimodal artificial intelligence (AI), several challenges remain. For example, they are restricted to static images, whereas dynamic inputs such as echocardiograms are vital for cardiac function assessment. In addition, such generalist models retain static knowledge, which hinders their ability to assimilate evolving medical evidence. While Retrieve-Augmented Generation (RAG) mitigates this challenge to some extent, traditional retrieval methods like Term Frequency-Inverse Document Frequency (TF-IDF) and dense passage retrieval (DPR) might be limited in semantic comprehension and retrieval relevance ( Karpukhin et al. 2020 ; Mallen et al. 2023 ) . And most importantly, complex cardiovascular management often requires multi-step reasoning and a sequence of clinical actions, rather than a single-step response ( McDonagh et al. 2021 ) . Although prompt engineering techniques such as Chain-of-Thought (CoT) ( Wei et al. 2022 ) partially mitigate this constraint by decomposing problems into substeps, model performance remains bounded by their intrinsic capabilities. The introduction of function calling and the Model Context Protocol (MCP) ( Hou et al. 2025 ) provides solutions, which enables models to integrate external tools automatically and access standardized functions. These advances drive the development of AI agents ( Chang et al. 2024 ) capable of reasoning, planning, memory utilization, and action execution. However, most VLM-based agents in medicine still rely primarily on internal model knowledge and attempt to handle clinical tasks through one-hop question answering ( Li et al. 2024 ) or role assignment ( Kim et al. 2024 ) . Building upon recent efforts, MedAgent-Pro ( Wang et al. 2025 ) proposes a solution for disease-level plan generation and patient-level reasoning. Nevertheless, its planning is conducted prior to receiving patient-specific input, while effective in some tasks, may lead to misalignment with individualized clinical contexts. For example, tasks for echocardiogram view identification typically follows a fixed workflow (e.g., commercial software, manual view selection), whereas complex HF diagnosis involves diverse patient presentations that require tailored test orders (e.g., ECG, echocardiography) and subsequent personalised management based on results. These highlight the need for flexible frameworks capable of both task-level and case-level adaptation across diverse clinical contexts. Another limitation of current VLM agents is the absence of intermediate visual outputs, such as delineation of the left ventricular contour, which are critical for clinical verification in complex or uncertain cases. In this study, an adaptive framework, CardAIc-Agents, was introduced to augment models with external tools, enabling autonomous execution of cardiac tasks (e.g., diagnosis, echocardiogram view extraction, segmentation, detection of P, QRS, and T waves) across diverse modalities (e.g., tabular, textual, signal, image, and video). Specifically, the CardiacRAG agent was developed to formulate general plans based on the latest domain knowledge, whereas the chief agent enhanced its own capabilities through the integration and orchestration of external tools for plan execution and definitive decision-making. To support adaptive planning across tasks and patient-specific cases, the system initially assessed task complexity, executed the plan, and dynamically refined it as new evidence emerged. For more challenging cases, a multidisciplinary discussion tool was proposed to support further interpretation, where expertise across diverse modalities was integrated to fully explore information within the data. Finally, when clinicians raised concerns, visual review panels were provided for validation. Experiments were conducted to evaluate the CardAIc-Agents in three public datasets, and the results indicated that its performance outperformed mainstream VLMs, state-of-the-art baseline agents, and fine-tuned VLMs specifically designed for the task. In addition, ablation studies verified the impact of key components. Finally, additional functionalities, such as echocardiogram view identification, were assessed by two cardiologists to show its applicability. In summary, the key contributions can be articulated as follows: • A domain-specific framework, CardAIc-Agents, was developed to enhance the capabilities of large models through integration with specialized tools, facilitating autonomous execution of diverse cardiac tasks on multimodal data. • A CardiacRAG agent was introduced based on a novel hybrid retrieval method to extract relevant knowledge from an updated cardiac-specific resource base, enabling the formulation of clinical management plans and facilitation of adaptive clinical workflows. • Adaptive strategies were proposed to stratify task complexity, refine plans, trigger multidisciplinary discussions for complex cases, and visually validate disputed cases, thereby enabling hierarchical adaptation tailored to specific clinical tasks and patients. Related Work Retrieve-Augmented Generation (RAG) RAG is a technique that combines retrieval and generation to enhance text generation quality and relevance ( Lewis et al. 2020 ) . Unlike current LLMs such as GPT-3 ( Brown et al. 2020 ) , which possess strong generative capabilities but

Read the complete text