HELM: Harness-Enhanced Long-horizon Memory for Vision-Language-Action Manipulation

Zijian Zeng, Fei Ding, Huiming Yang, Xianwei Li · 2026

Read HELM: Harness-Enhanced Long-horizon Memory for Vision-Language-Action Manipulation by Zijian Zeng, Fei Ding, Huiming Yang, Xianwei Li (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-18791.txt.

Description

Zeng and three colleagues present HELM, a framework that helps vision language action models succeed at long horizon manipulation tasks. Such models fail systematically on long tasks, and longer context alone does not fix the failure. HELM combines an episodic memory module that retrieves task history, a learned state verifier that predicts action failure before execution, and a harness controller that rolls back and replans. On LIBERO-LONG, HELM improves task success by 23 percentage points over OpenVLA, with gains on CALVIN and recovery under perturbations.

Catalog record

CREATORZijian Zeng, Fei Ding, Huiming Yang, Xianwei Li
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE34526
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.18791

Browse the full library · About the Tower of Babel