Think Proprioceptively: Embodied Visual Reasoning for VLA Manipulation
Fangyuan Wang, Peng Zhou, Jiaming Qi, Shipeng Lyu, David Navarro-Alarcon, Guodong Guo · 2026
Read Think Proprioceptively: Embodied Visual Reasoning for VLA Manipulation by Fangyuan Wang, Peng Zhou, Jiaming Qi, Shipeng Lyu, David Navarro-Alarcon, Guodong Guo (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-06575.txt.
Description
Vision-language-action models usually receive the robot's body state as a late add-on, too late to shape what the model looks at. Fangyuan Wang and 6 co-authors present ThinkProprio, which turns proprioception into tokens from the language model's own vocabulary. Those state tokens join the instruction to gate visual patches before the main model runs, steering attention to action-relevant evidence.
Passive state conditioning, the team found, changed performance little. Its value appeared only when state tokens actively selected which visual patches to process. Vocabulary tokens beat learned projector encodings for the state, and keeping only about an eighth of the visual tokens beat the full-token baseline on a standard manipulation suite. Across three benchmarks and real robots, latency fell while accuracy improved.
Catalog record
| CREATOR | Fangyuan Wang, Peng Zhou, Jiaming Qi, Shipeng Lyu, David Navarro-Alarcon, Guodong Guo |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 63 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-06575