Probing a Vision-Language-Action Model for Symbolic States and Integration into a Cognitive Architecture

Hong Lu *, Hengxu Li *, Prithviraj Singh Shahani *, Stephanie Herbers, Matthias Scheutz · 2025

Read Probing a Vision-Language-Action Model for Symbolic States and Integration into a Cognitive Architecture by Hong Lu *, Hengxu Li *, Prithviraj Singh Shahani *, Stephanie Herbers, Matthias Scheutz (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-04558.txt.

Description

Lu and four colleagues probe a robot control model for hidden symbol like states in twenty twenty-five. The model turns camera views and words into arm actions, but works as a black box. The team read its inner layers while it did pick and place tasks. Simple probes decoded object traits, spatial relations, and action states from those layers.

Decoding topped ninety percent accuracy for most states and layers. Object states did not sit earlier than action states, against the team's guess. They wired the readouts into a reasoning shell for live state checks. The blend lays ground for robot control that can be watched and trusted more, they argue.

Catalog record

CREATORHong Lu *, Hengxu Li *, Prithviraj Singh Shahani *, Stephanie Herbers, Matthias Scheutz
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE28 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-04558

Browse the full library · About the Tower of Babel