Where It Moves, It Matters: Referring Surgical Instrument Segmentation via Motion
Meng Wei, Kun Yuan, Shi Li, Yue Zhou, Long Bai, Nassir Navab, Hongliang Ren, Hong Joo Lee, Tom Vercauteren, Nicolas Padoy · 2026
Read Where It Moves, It Matters: Referring Surgical Instrument Segmentation via Motion by Meng Wei, Kun Yuan, Shi Li, Yue Zhou, Long Bai, Nassir Navab, Hongliang Ren, Hong Joo Lee, Tom Vercauteren, Nicolas Padoy (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-12224.txt.
Description
Meng Wei, Kun Yuan, Shi Li, and a large team find surgical tools in video by how they move, from a text brief. Language-led work with surgical scenes could aid smart operating rooms and robot help. The task is to cut out the tool named in words.
Past tools rest on static visual cues and fixed tool names. Those fail on new tools and phrasing. Motion gives a strong extra cue, since the used tool is the one that moves with intent. The team's motion-led method aims to generalize better.
Catalog record
| CREATOR | Meng Wei, Kun Yuan, Shi Li, Yue Zhou, Long Bai, Nassir Navab, Hongliang Ren, Hong Joo Lee, Tom Vercauteren, Nicolas Padoy |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 35 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-12224