CARES: Collaborative Agentic Reasoning for Error Detection in Surgery
Chang Han Low, Zhu Zhuo, Ziyue Wang, Jialang Xu, Haofeng Liu, Nazir Sirajudeen, Matthew Boal, Philip J. Edwards, Danail Stoyanov, Nader Francis, Jiehui Zhong, Di Gu, Evangelos B. Mazomenos, Yueming Jin · 2025
Read CARES: Collaborative Agentic Reasoning for Error Detection in Surgery by Chang Han Low, Zhu Zhuo, Ziyue Wang, Jialang Xu, Haofeng Liu, Nazir Sirajudeen, Matthew Boal, Philip J. Edwards, Danail Stoyanov, Nader Francis, Jiehui Zhong, Di Gu, Evangelos B. Mazomenos, Yueming Jin (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-08764.txt.
Introduction
Low and co-authors present a system, published in 2025, for spotting errors in robot-assisted surgery as they happen. Surgical robots add precision but also new failure modes, and training detectors is hard when labeled error footage is scarce. The team first built a dataset from robotic prostate operations, with every frame annotated. It covers six clinically grounded error types. On top of that data they built their detector, which needs no prior training on the task.
Instead of one model judging alone, the detector uses cooperating AI agents that reason together. Their judgments are informed by clinical knowledge and weighted by risk, so dangerous errors matter most. Testing was done on the new dataset. A reliable error alarm could cue a surgeon mid-operation, before harm is done. The dataset itself gives the field shared material to build on.
Catalog record
| CREATOR | Chang Han Low, Zhu Zhuo, Ziyue Wang, Jialang Xu, Haofeng Liu, Nazir Sirajudeen, Matthew Boal, Philip J. Edwards, Danail Stoyanov, Nader Francis, Jiehui Zhong, Di Gu, Evangelos B. Mazomenos, Yueming Jin |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 34 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-08764
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
CARES: Collaborative Agentic Reasoning for Error Detection in Surgery Chang Han Low, Zhu Zhuo, Ziyue Wang, Jialang Xu, Haofeng Liu, Nazir Sirajudeen, Matthew Boal, Philip J. Edwards, Danail Stoyanov, Nader Francis, Jiehui Zhong, Di Gu, Evangelos B. Mazomenos, Yueming Jin Abstract Robotic-assisted surgery (RAS) introduces complex challenges that current surgical error detection methods struggle to address effectively due to limited training data and methodological constraints. Therefore, we construct MERP ( M ulti-class E rror in R obotic P rostatectomy), a comprehensive dataset for error detection in robotic prostatectomy with frame-level annotations featuring six clinically aligned error categories. In addition, we propose CARES ( C ollaborative A gentic R easoning for E rror Detection in S urgery), a novel zero-shot clinically-informed and risk-stratified agentic reasoning architecture for multi-class surgical error detection. CARES implements adaptive generation of medically informed, error-specific Chain-of-Thought (CoT) prompts across multiple expertise levels. The framework employs risk-aware routing to assign error task to expertise-matched reasoning pathways based on complexity and clinical impact. Subsequently, each pathway decomposes surgical error analysis into three specialized agents with temporal, spatial, and procedural analysis. Each agent analyzes using dynamically selected prompts tailored to the assigned expertise level and error type, generating detailed and transparent reasoning traces. By incorporating clinically informed reasoning from established surgical assessment guidelines, CARES enables zero-shot surgical error detection without prior training. Evaluation demonstrates superior performance with 54.3 mF1 on RARP and 52.0 mF1 on MERP datasets, outperforming existing zero-shot approaches by up to 14% while remaining competitive with trained models. Ablation studies demonstrate the effectiveness of our method. The dataset and code will be publicly available. Introduction Robotic-Assisted Surgical (RAS) systems enable precise instrument control through small incisions. These systems fundamentally transform surgical procedures by providing enhanced dexterity and superior visualization, resulting in reduced patient trauma, shorter recovery times, and expanded capabilities for complex procedures such as prostatectomies. While RAS enhances surgical precision, it simultaneously introduces challenges and failure modes that differ from traditional surgery, creating new categories of errors from human-machine interaction complexities. Current literature indicates surgical technical errors affect approximately 10% of RAS procedures worldwide ( Vincent, Neale, and Woloshynowych 2001 ; Alemzadeh et al. 2016 ) , contributing to broader surgical adverse event rates where 30% of patients experience at least one adverse event globally ( Duclos et al. 2024 ; Schwendimann et al. 2018 ) . Half of all adverse events are preventable ( Vincent, Neale, and Woloshynowych 2001 ; Healey et al. 2002 ) , yet existing error classification guidelines inadequately address RAS systems’ unique technological characteristics, creating a critical gap in patient safety infrastructure. This inadequacy is particularly concerning given the complexity of RAS-specific errors. Surgical errors inevitably manifest when surgeons struggle with suturing techniques, needle placement, tissue alignment, or grasping strength ( Tang and Cuschieri 2020 ; Gorard et al. 2024 ) . These errors also encompass a range of manifestations, including tremor, imprecise movements, or coordination difficulties between robotic arms that can cascade into severe complications during procedures requiring precision. Currently, surgical error detection relies on manual observation and retrospective analysis by experienced surgeons. This is a subjective, time-intensive process demanding comprehensive analysis of timing, spatial coordination, procedural adherence, and technical precision ( Xu et al. 2024b ) . While standardized assessments like Observational Clinical Human Reliability Assessment (OCHRA) offer systematic approaches to evaluate surgical performance by categorizing errors based on their origin and assessing severity ( Tang and Cuschieri 2020 ; Gorard et al. 2024 ; Eubanks et al. 1999 ; Curtis et al. 2021 ; Pei et al. 2025 ) , practical implementation remains challenging. Extensive time requirements for manual video analysis and annotation underscore the critical need for computer-assisted assessment solutions ( Boal et al. 2024 ; Maier-Hein et al. 2017 ) , highlighting scalability challenges in modern healthcare environments where the demand for surgical quality evaluation is growing. Existing AI-assisted surgical error detection systems, such as SEDMamba ( Xu et al. 2024b ) and Chain-of-Gesture (COG) ( Shao et al. 2024 ) prompting, demonstrate promising capabilities in binary classification. While these systems can effectively detect the presence of surgical errors, they struggle significantly with multi-class classification tasks that distinguish between specific error categories. This challenge is further complicated by the need to train on datasets from different institutions to capture nuanced variations in surgical techniques and error progression. The complexity of fine-grained surgical error classification requires sophisticated reasoning capabilities. Vision-language models (VLMs) demonstrate strong reasoning and multi-modal understanding across diverse domains. VLMs can process complex visual information with contextual guidance through structured prompting ( Xu et al. 2024a ; Wang et al. 2024 ) . Recent agentic AI systems further offer promising paradigms for complex reasoning tasks through role-playing and specialized analytical approaches ( Xu et al. 2023 ; Long et al. 2024 ) , with multi-agent frameworks showing improvements in medical image analysis by decomposing complex problems into focused perspectives ( BAO et al. 2025 ) . However, surgical procedures’ temporal complexity, where errors span multiple time scales, along with inherent domain gaps in surgical knowledge in current VLMs, creates complex analytical challenges that remain unaddressed. To address these limitations, we first develop, MERP, M ulti-class E rror in R obotic P rostatectomy, a comprehensive robotic prostatectomy dataset with frame-level annotations based on six clinically aligned fine-grained categories streamlined from SEDMamba ( Xu et al. 2024b ) . Building upon this foundation, we propose CARES ( C ollaborative A gentic R easoning framework for E rror Detection in S urgery), a novel zero-shot clinically-informed and risk-stratified agentic reasoning architecture for surgical error detection. CARES adaptively generates medically informed, error-specific Chain-of-Thought (CoT) prompts tailored to multiple expertise level, analytical perspectives and error types. Building on these prompts, CARES employs risk-aware routing to assign error tasks to appropriate expertise-matched analytical pathways, where each pathway decomposes error analysis into three specialized agents conducting temporal, spatial, and procedural analysis. Each agent infer using dynamically selected prompts customised to the assigned expertise level and error type, generating detailed reasoning traces which can be reviewed, contrasting with black-box approaches that offer limited insight. CARES enables zero-shot surgical error detection without prior training which alleviates the data scarcity challenge prevalent in surgical AI. The clinical knowledge integration through structured adaptive prompting ensures CARES align with established surgical assessment frameworks, enabling seamless integration with existing surgical training and quality assurance protocols. Our contributions include: • We present a novel dataset, MERP, Multi-class Error in Robotic Prostatectomy, with frame-level annotations to facilitate relevant community study. • We introduce an adaptive CoT generation pipeline that generates error-specific, medical-informed reasoning protocols across multiple expertise levels and analytical perspectives. • We propose the first clinically-informed and risk-stratified agentic reasoning architecture for zero-shot surgical error detection with a risk-aware routing mechanism for dynamic CoT selection and expertise-matched reasoning pathways. • We establish a comprehensive benchmark and demonstrate superior performance across two datasets, achieving 54.3 mF1 on RARP and 52.0 mF1 on MERP without fine-tuning, outperforming existing zero-shot approaches by up to 14% and remaining competitive with trained models. Related Work Surgical Error Detection and Assessment. Surgical error detection has evolved from manual observational methods to computational approaches, including kinematic analysis using robot telemetry data ( Gao et al. 2014