Explainable AI for Automated User-specific Feedback in Surgical Skill Acquisition

Catalina Gomez, Lalithkumar Seenivasan, Xinrui Zou, Jeewoo Yoon, Sirui Chu, Ariel Leong, Patrick Kramer, Yu-Chun Ku, Jose L. Porras, Alejandro Martin-Gomez, Masaru Ishii, Mathias Unberath · 2025

Read Explainable AI for Automated User-specific Feedback in Surgical Skill Acquisition by Catalina Gomez, Lalithkumar Seenivasan, Xinrui Zou, Jeewoo Yoon, Sirui Chu, Ariel Leong, Patrick Kramer, Yu-Chun Ku, Jose L. Porras, Alejandro Martin-Gomez, Masaru Ishii, Mathias Unberath (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-02593.txt.

Introduction

Catalina Gomez and co-authors test explainable AI feedback for surgical trainees in a 2025 study. Learning surgery leans on expert coaching, yet faculty time is scarce and judgments vary. Trainees practicing alone get little of the personal, measured feedback that speeds learning.

Their training system watches practice videos and pulls out skill markers tied to basic actions. Feedback then compares the trainee with expert benchmarks and names each gap in plain, actionable terms. Medical students trained under this feedback or under standard video coaching in a prospective study. Afterward, the AI-guided group reported lighter mental load and stronger confidence. Task score gaps, though, shrank no faster than with human-style coaching. The authors read the result as proof that clear machine feedback can support, not yet replace, the coach's eye.

Catalog record

CREATORCatalina Gomez, Lalithkumar Seenivasan, Xinrui Zou, Jeewoo Yoon, Sirui Chu, Ariel Leong, Patrick Kramer, Yu-Chun Ku, Jose L. Porras, Alejandro Martin-Gomez, Masaru Ishii, Mathias Unberath
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE22 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-02593

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Explainable AI for Automated User-specific Feedback in Surgical Skill Acquisition Catalina Gomez, Lalithkumar Seenivasan, Xinrui Zou, Jeewoo Yoon, Sirui Chu, Ariel Leong, Patrick Kramer, Yu-Chun Ku, Jose L. Porras, Alejandro Martin-Gomez, Masaru Ishii, Mathias Unberath Abstract Traditional surgical skill acquisition relies heavily on expert feedback, yet direct access is limited by faculty availability and variability in subjective assessments. While trainees can practice independently, the lack of personalized, objective, and quantitative feedback reduces the effectiveness of self-directed learning. Recent advances in computer vision and machine learning have enabled automated surgical skill assessment, demonstrating the feasibility of automatic competency evaluation. However, it is unclear whether such Artificial Intelligence (AI)-driven feedback can contribute to skill acquisition. Here, we examine the effectiveness of explainable AI (XAI)–generated feedback in surgical training through a human-AI study. We create a simulation-based training framework that utilizes XAI to analyze videos and extract surgical skill proxies related to primitive actions. Our intervention provides automated, user-specific feedback by comparing trainee performance to expert benchmarks and highlighting deviations from optimal execution through understandable proxies for actionable guidance. In a prospective user study with medical students, we compare the impact of XAI-guided feedback against traditional video-based coaching on task outcomes, cognitive load, and trainees’ perceptions of AI-assisted learning. Results showed improved cognitive load and confidence post-intervention. While no differences emerged between the two feedback types in reducing performance gaps or practice adjustments, trends in the XAI group revealed desirable effects where participants more closely mimicked expert practice. This work encourages the study of explainable AI in surgical education and the development of data-driven, adaptive feedback mechanisms that could transform learning experiences and competency assessment. 1 Introduction Surgical education faces critical constraints as limited faculty availability and persistent variability in subjective skill assessments undermine consistent, high-quality training [ 2 ] . The Accreditation Council for Graduate Medical Education’s 80-hour workweek restriction, while improving the work-life balance, has reduced the time available for hands-on skill development [ 15 ] . With fewer opportunities for deliberate practice, surgical education must become more efficient without compromising competency. These challenges highlight the urgent need for scalable, objective feedback mechanisms that provide trainees with timely and actionable insights [ 13 ] . Alternative to traditional expert-based evaluation, video-based assessment has emerged as a promising tool for objectively evaluating surgical skills [ 10 ] , with some programs using it to assess surgeons’ readiness for independent practice [ 11 ] . However, without structured guidance, video-based assessment alone is insufficient for effective skill acquisition. The use of artificial intelligence (AI) for automated skill assessment has shown great promise [ 12 , 7 ] . While AI-driven assessment offers better scalability, like video-based methods, it often lacks the actionable feedback necessary to support meaningful skill improvement. Most AI solutions function as black boxes, offering overall skill ratings without providing clear, interpretable guidance [ 9 , 5 , 14 , 8 , 4 ] . To fully harness AI’s potential in surgical education, it is crucial to develop systems that not only assess performance but also deliver structured, user-specific insights that facilitate skill acquisition. Explainable AI (XAI) can address this gap by generating interpretable feedback based on measurable skill proxies—such as motion efficiency, tool trajectory, and hand stability—allowing trainees to understand their performance in a clinically relevant way [ 3 ] . By breaking down complex assessments into intuitive, actionable insights, XAI has the potential to bridge the gap between automated evaluation and real-world skill improvement. Despite its potential, limited empirical studies exist regarding whether AI-generated feedback meaningfully enhances skill development [ 16 ] . A key question remains: Can XAI effectively accelerate the acquisition of surgical skills while maintaining trainee engagement and educational value? Furthermore, the impact of AI-driven feedback on human factors, such as how trainees perceive, interpret, and integrate automated assessments, continues to be an open area of research. In this study, we develop a simulation-based training framework that utilizes XAI to deliver user-specific, interpretable feedback for surgical skill acquisition. Through a prospective user study, we evaluate how XAI-driven feedback affects skill improvement, cognitive load, and trainees’ perceptions of AI-assisted learning. By comparing this method to traditional expert demonstrations, we aim to determine whether explainable feedback offers a meaningful advantage in skill acquisition and enhancing the training experience. By aligning AI-driven feedback with principles of deliberate practice, our approach represents a step toward integrating AI-driven coaching tools into surgical training at scale. 2 Methodology 2.1 Study design We design a two-arm randomized study to evaluate the effectiveness of different feedback types–XAI-generated vs traditional video-based–in teaching suturing skills in a simulation environment. XAI-generated intrinsic feedback was designed to provide user-specific guidance to improve their performance by comparing expert best practices and contrasting their execution with the maximally different primitive suturing actions. We compare this approach to traditional video-based coaching, where trainees learn through self-guided observation of expert demonstrations. We hypothesize that trainees provided with XAI feedback will show greater improvements in the targeted skill concepts and enhanced perceptions of AI-assisted learning. The experimental task emulated wound closure procedures with four interrupted instrument-tied sutures using a needle driver, surgical forceps, and suture scissors in incisions made on a skin suturing board [ 6 ] . Each suturing board was divided into quadrants. To standardize incision orientation and suture placement, participants always worked in the top-left quadrant and placed the first suture at the furthest end of the incision. Video recordings were captured using an Intel RealSense D435i RGBD sensor, though only RGB data was used for processing. We recruited 12 medical students with previous exposure to suturing and randomly assigned them to one of the two feedback interventions. In our study (Fig. 1 ), participants completed four trials across two sessions, with a feedback intervention between sessions. The first session was followed by the cognitive load assessment and a break. We randomly assigned participants to a feedback type and gave a fixed time for feedback interpretation. In the second session, the same feedback was presented again before the last trial to reinforce its effect. This session concluded with another cognitive load assessment and feedback on perceptions. Last, participants viewed two of their trial videos (the second of each session) and rated their skills using a condensed global average rating scale (OSATS). Figure 1: Steps in the execution of the user study. The purple panel corresponds to the automated skill assessment and the orange one to the feedback interventions. 2.2 Feedback generation Automated skill assessment: We employ automated skill assessment to analyze hand motion for fine-grained surgical performance analysis. Following the approach in [ 3 ] , we first perform gesture prediction based on the motion features extracted using object detection and 2D pose estimation. The YOLOX-S model detects hands and surgical tools. A pose estimation model predicts hand keypoints, which are then refined using post-processing techniques. These features serve as input for the MSTCN++ model, which classifies gestures into six categories: "No Gesture," "Needle Passing (G1)," "Pull The Suture (G2)," "Instrumental Tie (G3)," "Lay The Knot (G4)," and "Cut The Suture (G5)," based on the open surgery simulation dataset [ 6 ] . Here, we use the pre-trained models from [ 3 ] . We then calculate the proxies for

Read the complete text