Haibo Zhao
* · 2025
Read Haibo Zhao by * (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-05728.txt.
Introduction
Haibo Zhao and co-authors present a hierarchical policy that respects symmetry for robot control in a 2025 paper, based on the head byline. Splitting control into a high level planner and a low level actor helps long tasks. Yet the hand off between levels is rarely studied, and most methods ignore workspace symmetry, which forces learning from many demonstrations.
Their frame transfer hand off uses the planner output as the coordinate frame for the actor, a strong built in bias that stays flexible. Symmetry is built into both levels, and the whole system is proven to transform consistently. Tests on hard manipulation tasks topped prior methods in simulation and on real robots.
Catalog record
| CREATOR | * |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 50 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-05728
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Haibo Zhao * Abstract Recent advances in hierarchical policy learning highlight the advantages of decomposing systems into high-level and low-level agents, enabling efficient long-horizon reasoning and precise fine-grained control. However, the interface between these hierarchy levels remains underexplored, and existing hierarchical methods often ignore domain symmetry, resulting in the need for extensive demonstrations to achieve robust performance. To address these issues, we propose Hierarchical Equivariant Policy (HEP), a novel hierarchical policy framework. We propose a frame transfer interface for hierarchical policy learning, which uses the high-level agent’s output as a coordinate frame for the low-level agent, providing a strong inductive bias while retaining flexibility. Additionally, we integrate domain symmetries into both levels and theoretically demonstrate the system’s overall equivariance. HEP achieves state-of-the-art performance in complex robotic manipulation tasks, demonstrating significant improvements in both simulation and real-world settings. marginparsep has been altered. topmargin has been altered. marginparpush has been altered. The page layout violates the ICML style. Please do not change the page layout, or include packages like geometry, savetrees, or fullpage, which change it for you. We’re not able to reliably undo arbitrary changes to the style. Please remove the offending package(s), or layout-changing commands and try again. Hierarchical Equivariant Policy via Frame Transfer † † footnotetext: * Equal contribution 1 Northeastern University 2 Boston Dynamics AI Institute. Correspondence to: Dian Wang <[email protected]>. 1 Introduction Learning-based approaches have emerged as a powerful paradigm for developing control policies in sequential decision-making tasks, such as robotic manipulation. By leveraging data-driven methods, policy learning provides a scalable framework for addressing tasks with complex dynamics and high-dimensional observation spaces. Recent advancements in end-to-end policy learning Zhao et al. 2023 , Chi et al. 2023 have shown promising results in mapping raw sensory inputs to low-level actions such as end-effector trajectories. While these methods exhibit state-of-the-art performance when large amounts of training data are available, they struggle in scenarios with only limited data, due to the large function space required to parameterize complex end-to-end mappings. Figure 1: Hierarchical Equivariant Policy (HEP) is composed of a high-level agent that predicts a coarse translation, a low-level agent that predicts the fine-grained trajectory, and a novel Frame Transfer interface that transfers the coordinate frame of the low-level to the predicted keypose frame from the high-level. A promising alternative strategy is to employ a hierarchical structural prior that decomposes the policy into different levels, e.g., a high-level agent responsible for identifying a goal pose and a low-level agent for trajectory refinement. Hierarchical methods can reduce the complexity of the policy function space by delegating long-horizon reasoning to the high-level module and fine-grained control to the low-level module, enabling efficient learning and execution. Despite their promise, one underexplored question in hierarchical policy learning is what is the right interface between different levels. For example, in robotic manipulation, existing hierarchical methods Ma et al. 2024 , Xian et al. 2023 often impose rigid constraints on the interface between the high-level and low-level agents, where the high-level action is used as the last pose in the low-level trajectory. This constraint limits flexibility and often requires both levels to perform fine-grained reasoning in high-dimensional spaces, negating some of the potential benefits of the hierarchical design. Moreover, prior hierarchical methods focus solely on the hierarchical decomposition and do not exploit the domain symmetries often present in robotic tasks, missing an opportunity to further improve generalization and efficiency. In this paper, we propose a novel hierarchical policy learning framework that overcomes these limitations by introducing a more flexible and efficient interface between the high-level and low-level agents. Specifically, our high-level agent predicts a keypose in the form of a coarse 3D location representing a subgoal of the task. This location is then used to construct the coordinate frame for the low-level policy, enabling it to predict trajectories relative to this keypose frame, as shown in Figure 1 . This Frame Transfer interface maintains a strong inductive bias (by anchoring the low-level policy to a subgoal) yet offers structural flexibility (allowing the low-level policy to refine trajectories locally). Furthermore, Frame Transfer offers a natural fit for integrating domain symmetry by decomposing it into the global symmetry of the subgoal (i.e., the subgoal should transform with the scene) and a local symmetry of the low-level policy (i.e., it should behave consistently in the local keypose frame). By incorporating equivariant structures at both levels, our entire hierarchical system becomes more robust to spatial variations, resulting in significantly improved sample efficiency. Lastly, to better encode 3D sensory information, we adopt a stacked voxel representation Zhou & Tuzel 2018 , ensuring rich visual features and fast computation. We summarize our contributions as follows: • We propose Hierarchical Equivariant Policy (HEP), a novel, sample-efficient hierarchical policy learning framework. • We introduce Frame Transfer as an interface for hierarchical policy learning, providing effective and flexible policy decomposition. • We theoretically demonstrate the equivariance of HEP, showing its spatial generalizability. Although equivariance has been used in policy learning, our work is the first to study it in a hierarchical policy. • We provide a thorough evaluation of our method in both simulation and the real-world. Among 30 RLBench James et al. 2020 tasks, HEP outperforms state-of-the-art baselines by an average of 10% to 23% in different settings, with particular improvement on tasks requiring fine control or long-horizon reasoning. 2 Related Work Learning from Demonstrations (LfD) enables policies to be trained from human demonstrations and generalized to unseen scenarios. One class of LfD learns abstracted keyframe actions James & Davison 2022 , James et al. 2022 , Shridhar et al. 2023 , Gervet et al. 2023 , Goyal et al. 2023 in terms of the target pose of the gripper, then uses motion planning to interpolate between keyframes. This formulation enables learning with fewer decision steps, but is not suitable for non-prehensile actions like door opening or wiping Xian et al. 2023 , Ma et al. 2024 . Another class of LfD mimics the fine-grained trajectory directly Song et al. 2020 , Ye et al. 2022 , Toyer et al. 2020 , Zhang et al. 2018 , Chi et al. 2023 , Zhu et al. 2023 , Mandlekar et al. 2021 , Zhao et al. 2023 , Wang et al. 2024 , enabling broader task coverage but suffering from overloading the model with details Zhao et al. 2023 , covariant shift Ke et al. 2021 , and poor performance in long-horizon tasks. To bridge these approaches, we introduce Frame Transfer, a novel interface that integrates keyframe-based and trajectory-based models, enhancing flexibility and task adaptability. Hierarchical Policy has been explored for action refinement in a coarse-to-fine manner Levy et al. 2018 , Gualtieri & Platt 2020 , James et al. 2022 or through a two-stage hierarchy for translational and rotational actions Sharma et al. 2017 , Wang et al. 2020 , Zhu et al. 2022 . While these approaches improve over end-to-end policies, they lack integration of keyframe and trajectory actions. Recent works Xian et al. 2023 , Ma et al. 2024 address this by hierarchically combining a keyframe agent and a trajectory agent, but they fix the goal pose of the trajectory agent with the output from the keyfram agent, limiting flexibility in the