Where It Moves, It Matters: Referring Surgical Instrument Segmentation via Motion

Meng Wei, Kun Yuan, Shi Li, Yue Zhou, Long Bai, Nassir Navab, Hongliang Ren, Hong Joo Lee, Tom Vercauteren, Nicolas Padoy · 2026

Read Where It Moves, It Matters: Referring Surgical Instrument Segmentation via Motion by Meng Wei, Kun Yuan, Shi Li, Yue Zhou, Long Bai, Nassir Navab, Hongliang Ren, Hong Joo Lee, Tom Vercauteren, Nicolas Padoy (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-12224.txt.

Description

Meng Wei, Kun Yuan, Shi Li, and a large team find surgical tools in video by how they move, from a text brief. Language-led work with surgical scenes could aid smart operating rooms and robot help. The task is to cut out the tool named in words.

Past tools rest on static visual cues and fixed tool names. Those fail on new tools and phrasing. Motion gives a strong extra cue, since the used tool is the one that moves with intent. The team's motion-led method aims to generalize better.

Catalog record

CREATORMeng Wei, Kun Yuan, Shi Li, Yue Zhou, Long Bai, Nassir Navab, Hongliang Ren, Hong Joo Lee, Tom Vercauteren, Nicolas Padoy
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE35 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-12224

Browse the full library · About the Tower of Babel