Think Proprioceptively: Embodied Visual Reasoning for VLA Manipulation

Fangyuan Wang, Peng Zhou, Jiaming Qi, Shipeng Lyu, David Navarro-Alarcon, Guodong Guo · 2026

Read Think Proprioceptively: Embodied Visual Reasoning for VLA Manipulation by Fangyuan Wang, Peng Zhou, Jiaming Qi, Shipeng Lyu, David Navarro-Alarcon, Guodong Guo (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-06575.txt.

Description

Vision-language-action models usually receive the robot's body state as a late add-on, too late to shape what the model looks at. Fangyuan Wang and 6 co-authors present ThinkProprio, which turns proprioception into tokens from the language model's own vocabulary. Those state tokens join the instruction to gate visual patches before the main model runs, steering attention to action-relevant evidence.

Passive state conditioning, the team found, changed performance little. Its value appeared only when state tokens actively selected which visual patches to process. Vocabulary tokens beat learned projector encodings for the state, and keeping only about an eighth of the visual tokens beat the full-token baseline on a standard manipulation suite. Across three benchmarks and real robots, latency fell while accuracy improved.

Catalog record

CREATORFangyuan Wang, Peng Zhou, Jiaming Qi, Shipeng Lyu, David Navarro-Alarcon, Guodong Guo
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE63 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-06575

Browse the full library · About the Tower of Babel