Grounding Bodily Awareness in Visual Representations for Efficient Policy Learning

Junlin Wang, Zhiyun Lin · 2025

Read Grounding Bodily Awareness in Visual Representations for Efficient Policy Learning by Junlin Wang, Zhiyun Lin (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-18487.txt.

Description

Junlin Wang and Zhiyun Lin ask how robots can learn visual representations that understand their own bodies, in a two thousand twenty-five paper. Robotic manipulation is hard partly because actions involve complex body dynamics. A camera view mixes the robot itself with the surrounding scene.

Their method, called ICon, applies contrastive learning to the tokens inside a vision transformer. It pushes agent-related tokens apart from environment-related tokens in feature space. The result is an agent-centric representation carrying body-specific biases. The contrastive loss plugs into end-to-end policy learning as an extra objective. Experiments show better manipulation performance across tasks. Policies also transferred more easily between different robots.

Catalog record

CREATORJunlin Wang, Zhiyun Lin
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE31 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-18487

Browse the full library · About the Tower of Babel