Surgical Video Understanding with Label Interpolation

Garam Kim, Tae Kyeong Jeong, Juyoun ParkKorea Institute of Science and Technology, Seoul, South Korea · 2025

Read Surgical Video Understanding with Label Interpolation by Garam Kim, Tae Kyeong Jeong, Juyoun ParkKorea Institute of Science and Technology, Seoul, South Korea (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-18802.txt.

Description

Robot-assisted surgery gives patients smaller cuts and surgeons a lighter load, but the video it produces is hard to teach machines to read. Garam Kim, Tae Kyeong Jeong, and Juyoun Park present a framework for surgical video understanding in this 2025 paper. Real scenes mix phases, steps, tools, and actions over time. Training data is lopsided: long-term labels cover every frame, while fine labels exist only for key frames.

Their fix propagates the sparse fine labels to nearby frames. Optical flow, estimated from the labeled key frames, carries segment labels across the gaps. That richer supervision feeds a multi-task learning setup. The balance between long-term and short-term information improves. So do accuracy and training efficiency in their tests. Better scene understanding, the authors argue, raises the value of robot surgery data. The method targets the annotation bottleneck directly.

Catalog record

CREATORGaram Kim, Tae Kyeong Jeong, Juyoun ParkKorea Institute of Science and Technology, Seoul, South Korea
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE30 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-18802

Browse the full library · About the Tower of Babel