Zero-shot Imitation Learning by Latent Topology Mapping

Maxwell J. Jacobson, Yexiang Xue · 2026

Read Zero-shot Imitation Learning by Latent Topology Mapping by Maxwell J. Jacobson, Yexiang Xue (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-08450.txt.

Introduction

Maxwell Jacobson and Yexiang Xue teach agents new long tasks from demonstrations of other tasks. Imitation learning works when experts show the exact job, but collecting demonstrations for every task is unaffordable, and small errors snowball over long action sequences when the agent improvises.

Their ZALT method maps the demonstration set into a latent topology. It finds hub states where trajectories converge or split, learns local policies and a dynamics model for hub-to-hub hops, and then plans across that hub graph. An unseen start and goal can be connected through hubs the demonstrations did visit, which turns a fixed dataset into zero-shot solutions for long-horizon tasks beyond those shown.

Catalog record

CREATORMaxwell J. Jacobson, Yexiang Xue
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE53 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.08450

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Zero-shot Imitation Learning by Latent Topology Mapping Maxwell J. Jacobson, Yexiang Xue Abstract Imitation learning is effective for training agents when expert demonstrations are available, but collecting demonstrations for every complex task in an environment is costly. We study the long-horizon, goal-conditioned setting where a fixed demonstration dataset contains useful behavior, but not complete examples for every task the agent must solve. Existing imitation learning methods can learn strong policies from demonstrations, but when solving long-horizon tasks, small errors accumulate over long primitive-action trajectories and make zero-shot adaptation to new tasks unreliable. We introduce Zero-shot Agents from Latent Topologies (ZALT), an imitation-learning method that solves unseen start–goal tasks beyond those demonstrated during training. ZALT identifies latent hub states where trajectories converge or diverge, learns policies and a dynamics model over hub-to-hub transitions, and plans over the hub topology to complete new tasks. This topology makes demonstrated behaviors explicitly composable while compressing long tasks into shorter sequences of abstract transitions – combined, these enable ZALT to perform zero-shot adaptation. In a complex 3D maze environment, ZALT achieves 55% zero-shot success on unseen tasks, compared to 6% for the strongest baseline. 1 Introduction Figure 1: Directly composing behavior at the primitive-action level requires many sequential decisions, allowing small policy, model, or distribution-shift errors to compound until the objective is lost ( left ). ZALT instead learns a behavior topology from demonstrations, using a low-level dynamics model to identify a few reusable hub states ( middle ). Then, a high-level dynamics model plans over those hubs, and demonstration-trained policies execute the selected hub-to-hub segments ( right ). This compresses a long primitive horizon into a shorter sequence of abstract transitions, enabling zero-shot composition of new start–goal behaviors with fewer opportunities for error accumulation. Demonstration video: https://arcosin.github.io/Zalt/ Imitation learning is a powerful technique for training agents from expert behavior, especially when direct reward design or online exploration is difficult. We study imitation learning in long-horizon, goal-conditioned environments where a fixed demonstration dataset covers some start–goal tasks, but the agent must solve new tasks zero-shot , without additional interaction or training. This setting captures a central promise of imitation learning: demonstrations should teach more than isolated task instances, since collecting expert trajectories for every possible long-horizon task combination is expensive or impossible in interactive agents, game environments, and robotics. Prior imitation-learning methods provide strong ways to learn from expert behavior. Behavioral cloning and goal-conditioned imitation can learn effective policies directly from demonstrations 24 ; 43 , while sequence models 6 and model-based imitation methods 23 ; 5 ; 27 can use demonstration data to predict or compose behavior beyond a single observed trajectory. However, zero-shot generalization becomes much harder in long-horizon tasks: the agent must compose behavior outside the demonstrated start–goal distribution, and policy, model, or distribution-shift errors have hundreds of steps over which to accumulate 47 . As a result, a fixed demonstration dataset can contain the local behavior needed for a new task while still failing to support reliable full-task execution. We introduce Zero-shot Agents from Latent Topologies (ZALT), an imitation-learning method for zero-shot long-horizon behavior composition. ZALT processes demonstrations into a latent behavior topology by identifying hub states where trajectories converge or diverge. These hubs act as reusable junctions in the demonstration data. Edges in the topology correspond to demonstrated multi-step behavioral segments between hubs, allowing long tasks to be represented as shorter sequences of abstract transitions (see Figure 1 , middle panel). ZALT then learns how to use the behavior topology. A high-level dynamics model predicts likely next hubs from the sequence of hubs visited so far, capturing path-dependent information that may not be reliable in a single low-level latent state over an entire long-horizon task. Separately, demonstration-trained policies learn to execute hub-to-hub transitions using the trajectory segments associated with each topology edge. At test time, ZALT matches the start and goal to hubs, searches for a most plausible route through the topology, and executes that route by chaining the learned hub policies (see Figure 1 , right panel). ZALT addresses long-horizon composition by performing composition at the hub level rather than the primitive-action level. This compresses a long task into a shorter sequence of abstract transitions, reducing opportunities for error accumulation while still grounding execution in policies learned from expert demonstrations. As a result, ZALT can solve new start–goal tasks zero-shot after processing a fixed demonstration dataset. We evaluate ZALT in a complex 3D maze environment requiring long-horizon ordered object manipulation with keys, locked doors, diamonds, and a barrel. The key challenge is zero-shot composition: the agent must solve held-out start–goal tasks whose complete successful trajectories never appear in the demonstration data. ZALT achieves 55% zero-shot success on unseen tasks, compared to 6% for the strongest baseline and 0% for the remaining baselines. It also achieves 72.2% success on seen tasks, while the strongest baseline reaches only 11%, showing that the task is difficult even before held-out generalization. Successful ZALT plans compress roughly 244–281 primitive timesteps into about 33 hub-level transitions, with each abstract edge encoding about 7.9 primitive actions on average. We also collect a video of a successful zero-shot ZALT execution, shown in Figure 4 , illustrating how the learned topology is used during live inference. 2 Problem Definition ZALT is designed to solve long-horizon tasks by composing behaviors learned from an incomplete set of expert demonstrations, enabling new tasks to be solved zero-shot. We formalize this setting as a fixed environment with many possible start–goal tasks. Each task is specified by an initial state ( s_{0} ) and a goal ( g ). The agent has access to an offline demonstration dataset collected from a subset of possible start–goal combinations, and must solve new start–goal combinations without additional environment interaction or policy optimization. Let \mathcal{S} be the state space, \mathcal{A} be the action space, and \mathcal{G} be the goal space. A task is a pair (s_{0},g)\in\mathcal{S}_{0}\times\mathcal{G} , where \mathcal{S}_{0}\subseteq\mathcal{S} is the set of possible initial states. Some imitation learning formulations define the problem over a Markov Decision Process (MDP), and therefore also define a reward function r(s,a,g) . The agent receives a fixed dataset of expert demonstrations \mathcal{D}=\{\tau_{i}\}_{i=1}^{N} . Each trajectory is written as \tau_{i}=(s^{i}_{0},a^{i}_{0},s^{i}_{1},a^{i}_{1},\ldots,s^{i}_{T_{i}},g_{i},y_{i}) , where g_{i} is the intended goal and y_{i}\in\{0,1\} indicates whether the trajectory successfully achieved that goal. We allow y_{i}=0 because expert-generated demonstrations may still fail in long-horizon environments, and failed trajectories can provide useful information about behavioral connectivity and unsupported routes. The objective is zero-shot behavior composition: use the structure present in \mathcal{D} to solve unseen start–goal combinations by recombining demonstrated behavioral segments. \mathcal{D} contains only some possible start–goal pairs ( s_{0},g ). At test time, the agent is evaluated on held-out start–goal pairs that do not appear in \mathcal{D} . A held-out pair may still involve familiar starts, goals, objects, rooms, or local behaviors, but the full task from that specific start to that specific goal was never demonstrated during training. A method succeeds on a test task if the executed trajectory reaches the specified goal within the environment horizon. This setting assumes that useful behavioral connectivity exists in the demonstration data. A complete test trajectory may not be present, but portions of the required behavior may appear across different

Read the complete text