Learning Affordances at Inference-Time for Vision-Language-Action Models
Ameesh Shah, William Chen, Adwait Godbole, Federico Mora, Sanjit A. Seshia, Sergey Levine https://liten-vla.github.io/ · 2025
Read Learning Affordances at Inference-Time for Vision-Language-Action Models by Ameesh Shah, William Chen, Adwait Godbole, Federico Mora, Sanjit A. Seshia, Sergey Levine https://liten-vla.github.io/ (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-19752.txt.
Description
Ameesh Shah and five co-authors give robot control models a way to learn from their own failures while they work. Vision-language-action models can direct robots through complex tasks, but they cannot adjust when an attempt goes wrong. Their method, LITEN, links the low-level control policy to a high-level vision-language model. That model studies records of past attempts.
The system swaps between planning and review. The high-level model drafts a plan, and the robot carries it out. The review phase then reflects on what happened, raw video of the motion included, and stores lessons for future plans. Over repeated tries, the planner learns which instructions the low-level policy can truly carry out. Tests show the approach finishing long-horizon tasks by favoring directions the robot handles well.
Catalog record
| CREATOR | Ameesh Shah, William Chen, Adwait Godbole, Federico Mora, Sanjit A. Seshia, Sergey Levine https://liten-vla.github.io/ |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 44 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2510-19752