Efficient Navigation Among Movable Obstacles using a Mobile Manipulator via Hierarchical Policy Learning
Taegeun Yang, Jiwoo Hwang, Jeil Jeong, Minsung Yoon, Sung-Eui Yoon · 2025
Read Efficient Navigation Among Movable Obstacles using a Mobile Manipulator via Hierarchical Policy Learning by Taegeun Yang, Jiwoo Hwang, Jeil Jeong, Minsung Yoon, Sung-Eui Yoon (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-15380.txt.
Introduction
A robot that meets a blocking box can push it aside if it learns how pushes behave. Taegeun Yang, Jiwoo Hwang, Jeil Jeong, Minsung Yoon, and Sung-Eui Yoon teach that skill in two layers in a 2025 paper. A mobile arm does the pushing.
The top layer picks pushes that keep the robot near its planned path. The base layer turns picks into smooth whole-body motion. The robot first guesses each block's weight and grip from touch. In simulated trials, success rose against rival methods. Paths ran shorter and goals came sooner. Each layer's worth was checked by removal tests.
Catalog record
| CREATOR | Taegeun Yang, Jiwoo Hwang, Jeil Jeong, Minsung Yoon, Sung-Eui Yoon |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 40 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-15380
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Efficient Navigation Among Movable Obstacles using a Mobile Manipulator via Hierarchical Policy Learning Taegeun Yang, Jiwoo Hwang, Jeil Jeong, Minsung Yoon, Sung-Eui Yoon Abstract We propose a hierarchical reinforcement learning (HRL) framework for efficient Navigation Among Movable Obstacles ( NAMO ) using a mobile manipulator. Our approach combines interaction-based obstacle property estimation with structured pushing strategies, facilitating the dynamic manipulation of unforeseen obstacles while adhering to a pre-planned global path. The high-level policy generates pushing commands that consider environmental constraints and path-tracking objectives, while the low-level policy precisely and stably executes these commands through coordinated whole-body movements. Comprehensive simulation-based experiments demonstrate improvements in performing NAMO tasks, including higher success rates, shortened traversed path length, and reduced goal-reaching times, compared to baselines. Additionally, ablation studies assess the efficacy of each component, while a qualitative analysis further validates the accuracy and reliability of the real-time obstacle property estimation. I Introduction Robust robot navigation in complex environments is crucial for applications ranging from delivery [ 1 ] to warehouse automation [ 2 ] . While recent methods excel at collision avoidance, they could fail when physical object manipulation is necessary to create feasible paths, for instance, when narrow passages are blocked by obstacles, as shown in Fig. 1 . Navigation Among Movable Obstacles ( NAMO ) research addresses this challenge by enabling robots to manipulate objects (i.e., movable obstacles) to actively create navigable regions. Conventional offline NAMO methods require complete environmental knowledge, whereas recent online approaches operate with minimal or without global information, such as floor plans that only include large structures like walls, to generate coarse global paths and dynamically respond to encountered obstacles during navigation. (refer to Sec. II-A ) By leveraging the advancements in reinforcement learning (RL), some researchers in NAMO tasks have enhanced decision-making processes for robots, enabling efficient navigation while manipulating objects when necessary. However, existing research overlooks physical attributes of movable obstacles, such as mass, friction, and center of mass, which are critical for effective manipulation. To address this limitation, we adopt real-time property estimation approaches, allowing robots to better understand and interact with objects. This integration enhances manipulation accuracy and eventually improves navigation efficiency. (refer to Sec. II-B ) Fig. 1: Whole-Body Mobile Manipulator Control for NAMO . Illustration of the NAMO task, where the mobile manipulator follows a global path (red) while actively clearing a blocking obstacle using whole-body coordinated motions. During the interaction, the robot continuously tracks the global path with its base, while simultaneously pushing the obstacle aside to clear the way using its manipulator arm. The right sequence shows the interaction process between the robot and the obstacle. Furthermore, we employ hierarchical reinforcement learning (HRL) frameworks to manage the complexity of NAMO tasks. By decoupling high-level decision-making from low-level motor execution, HRL allows robots to generate strategic commands, such as determining where to push a blocking obstacle with the manipulator’s end-effector, and how quickly to move the base at a specific angle, as illustrated in Fig. 1 . These commands are then executed with precision through a low-level controller. This hierarchical structure not only streamlines the decision-making process but also enables more efficient and adaptive behaviors in complex, unstructured environments, resulting in improved overall NAMO task performance. (refer to Sec. II-C ) In this work, our main contributions are threefold : • A HRL framework that integrates mobile navigation with obstacle manipulation using a seven degrees-of-freedom (DOFs) mobile manipulator, the Fetch, to enable efficient navigation in unstructured environments for NAMO tasks; • An interaction-based property estimation module that facilitates adaptive interaction with diverse movable objects; • Comprehensive simulation-based experiments demonstrating improved navigation performance, in terms of success rates, path length, and goal-reaching times, along with ablation studies assessing the effectiveness of each component and qualitative analysis of the property estimation. II Related Work II-A Navigation Among Movable Obstacles (NAMO) NAMO represents robot navigation tasks in environments where obstacles need to be physically manipulated to create traversable paths toward goal locations. Traditional approaches [ 3 , 4 , 5 , 6 ] assume complete environmental knowledge, including floor plans and detailed obstacle information (e.g., poses, geometries, movability), limiting their applicability in dynamic and unexplored environments. To mitigate this requirement, recent online methods [ 7 , 8 , 9 , 10 , 11 , 12 , 13 ] utilize approximate global paths from coarse floor maps or even operate with only local sensing information, dynamically responding to unexpected obstacles during navigation toward goals. Recent advancements in reinforcement learning (RL) have enabled optimal decision-making in complex NAMO tasks that require simultaneous navigation and object manipulation [ 14 , 15 ] . However, existing RL-based methods overlook the physical properties of obstacles during interaction, such as mass, friction, or center of mass, often resulting in inaccurate manipulation and reduced navigation efficiency, as shown in Sec. V . In contrast, we incorporate real-time property estimation within our framework, improving obstacle manipulation and ultimately enhancing navigation efficiency. II-B Interaction-Based Estimation of Object Properties Accurate estimation of physical properties is essential for various domains, including system simulation [ 16 ] , legged locomotion [ 17 ] , and object manipulation [ 18 ] . Properties, such as mass, center of mass, and friction, significantly influence motion and interaction dynamics, making their estimation crucial for effective robotic control. While some objects have well-defined and predictable properties, real-world environments often contain unknown or visually similar objects with differing physical characteristics, requiring robots to infer these properties through direct interaction. In object manipulation, traditional analytical approaches often struggle with real-world uncertainties and object variability [ 19 , 20 , 21 , 22 ] . To address these limitations, recent methods utilize large-scale interaction data and learning-based inference for accurate and robust object property estimation [ 23 , 24 , 25 ] . Building on these advancements, we incorporate property estimation into RL frameworks for NAMO tasks, enabling more context-aware manipulation policies. Fig. 2: Training Framework . Our framework consists of two stages: (1) The low-level policy learns to execute whole-body actions that achieve the commanded robot-obstacle kinematic configuration (i.e., pushing command) while maintaining stable contact to push obstacles (refer to Sec. IV-B ). An adaptive command sampling strategy is used to train the policy, enabling it to handle a broader range of commands (Sec. IV-C3 ). (2) The high-level policy is trained to generate pushing commands for low-level that guide the robot’s base along the planned path while clearing obstacles, considering environmental factors. A history encoder is trained to estimate contact state and obstacle properties from low-level observation histories (Sec. IV-D2 ). The term ’obst.’ in the figure denotes ’obstacle’ for brevity. II-C Hierarchical Reinforcement Learning Hierarchical control structures simplify complex robotic tasks by decoupling high-level decision-making from low-level execution [ 26 , 27 , 28 , 29 , 30 , 31 ] . For instance, in navigation, high-level controllers generate body velocity independent of the robot’s specific embodiment [ 26 , 27 , 28 ] . Likewise, in manipulation, high-level controllers determine interaction strategies, such as motor skill selection [ 29 ] and sub-goal generation [ 30 , 31 ] , while low-level controllers execute high-level commands to generate precise motions for completing tasks. To resolve the complexity of NAMO tasks,