Large language model-augmented implicit surgical video review

Zheyuan Zhang, Muhammad Ibtsaam Qadir, Rushil Ramchand, Medha Belwadi, Ryan Patrick Ball, Kali Konstantinopoulos, Evan Mark Abbey, Kathleen T. Ernsberger, Michael J. Guzman, Samantha Hendren, Bryan K. Holcomb, Bruce W. Robb, Trista Stankowski, Joshua A. Waters, Dimitrios Stefanidis, Karl Y. Bilimori · 2026

Read Large language model-augmented implicit surgical video review by Zheyuan Zhang, Muhammad Ibtsaam Qadir, Rushil Ramchand, Medha Belwadi, Ryan Patrick Ball, Kali Konstantinopoulos, Evan Mark Abbey, Kathleen T. Ernsberger, Michael J. Guzman, Samantha Hendren, Bryan K. Holcomb, Bruce W. Robb, Trista Stankowski, Joshua A. Waters, Dimitrios Stefanidis, Karl Y. Bilimori (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/pmc-13684614.txt.

Description

Surgery leaves a video record, but the surgeon's spoken reasoning during the case is usually lost. Zheyuan Zhang and co-authors built a method to keep it, reported in a 2026 paper. Their system turns transcribed commentary into structured, machine-readable notes tied to moments in the video.

A large language model slices the transcript into feedback chunks and classifies each one, while eye-gaze or cursor tracking pins the chunk to the spot in the scene it concerns. On full-length bowel operations, the chunking matched human work closely, and the classification of observations agreed well with people. A safety checklist task in gallbladder surgery also scored strong agreement with expert raters. Users rated the system easy to work with. The authors aim it at training and quality review at scale.

Catalog record

CREATORZheyuan Zhang, Muhammad Ibtsaam Qadir, Rushil Ramchand, Medha Belwadi, Ryan Patrick Ball, Kali Konstantinopoulos, Evan Mark Abbey, Kathleen T. Ernsberger, Michael J. Guzman, Samantha Hendren, Bryan K. Holcomb, Bruce W. Robb, Trista Stankowski, Joshua A. Waters, Dimitrios Stefanidis, Karl Y. Bilimori
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE2 KB
VERSION1.0
LICENSECC BY 4.0
RIGHTSCC BY
SOURCEEurope PMC

Source: https://europepmc.org/articles/PMC13684614

Browse the full library · About the Tower of Babel