Spatial Memory for Out-of-Vision Manipulation in Vision-Language-Action

Pengteng Li, Weiyu Guo, He Zhang, Tiefu Cai, Xiao He, Yandong Guo, Hui Xiong · 2026

Read Spatial Memory for Out-of-Vision Manipulation in Vision-Language-Action by Pengteng Li, Weiyu Guo, He Zhang, Tiefu Cai, Xiao He, Yandong Guo, Hui Xiong (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-22283.txt.

Description

Li and colleagues introduce SOMA, a spatial memory system for robots that must handle objects out of sight. Most such models assume target objects stay visible, which fails when a target leaves the camera view. SOMA builds a map of space and meaning from scans taken with a movable head camera. It keeps the map consistent over time and pulls out cues matching the instruction. Tests cover five hard real tasks, with two-arm work on hidden targets. Success rises, targets are found faster, and grasping nears one-shot success.

Catalog record

CREATORPengteng Li, Weiyu Guo, He Zhang, Tiefu Cai, Xiao He, Yandong Guo, Hui Xiong
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE83814
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.22283

Browse the full library · About the Tower of Babel