GoalLadder: Incremental Goal Discovery with Vision-Language Models

Alexey Zakharov, Shimon Whiteson · 2025

Read GoalLadder: Incremental Goal Discovery with Vision-Language Models by Alexey Zakharov, Shimon Whiteson (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-16396.txt.

Description

Teaching a robot from a single sentence of instruction is hard when the robot sees only pixels and feedback is scarce. Alexey Zakharov and Shimon Whiteson present GoalLadder in this 2025 paper, a method that lets a learning agent climb toward a language-specified goal in a visual world. The ladder is built from states the agent has already visited.

A vision-language model picks visited states that look like progress and ranks them in pairs. The authors do not take those judgments at face value. A rating system in the style of chess rankings smooths the noisy calls into a steady ladder. The agent then aims at the top-ranked state, measured in a visual embedding learned from unlabeled data. Over training, the ladder grows toward the goal, turning one vague instruction into many small, checkable steps.

Catalog record

CREATORAlexey Zakharov, Shimon Whiteson
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE37 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-16396

Browse the full library · About the Tower of Babel