Task and Motion Planning for Humanoid Loco-manipulation
Michal Ciebielski, Victor Dhédin, Majid Khadiv · 2025
Read Task and Motion Planning for Humanoid Loco-manipulation by Michal Ciebielski, Victor Dhédin, Majid Khadiv (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-14099.txt.
Introduction
Michal Ciebielski and co-authors present in 2025 a planner that lets a humanoid robot walk and handle objects as one problem. Robots usually plan footsteps and hand moves in separate layers that argue at the seams. This framework plans through contact modes instead: a symbolic action is simply a change in what touches what, be it foot to floor or hand to box.
That shared language lets one search span the task list, the contact choices, and the body motion together, with whole body dynamics and actuator limits enforced throughout. On a humanoid platform the planner produced long sequences of loco-manipulation behavior, walking while carrying, bracing, and repositioning with physical consistency. The authors claim a first: an integrated task and motion formulation solved with fully open ended planning for humanoid loco-manipulation. One planner for the whole body moves robots toward improvising chores.
Catalog record
| CREATOR | Michal Ciebielski, Victor Dhédin, Majid Khadiv |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 38 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-14099
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Task and Motion Planning for Humanoid Loco-manipulation Michal Ciebielski, Victor Dhédin, Majid Khadiv Abstract This work presents an optimization-based task and motion planning (TAMP) framework that unifies planning for locomotion and manipulation through a shared representation of contact modes. We define symbolic actions as contact mode changes, grounding high-level planning in low-level motion. This enables a unified search that spans task, contact, and motion planning while incorporating whole-body dynamics, as well as all constraints between the robot, the manipulated object, and the environment. Results on a humanoid platform show that our method can generate a broad range of physically consistent loco-manipulation behaviors over long action sequences requiring complex reasoning. To the best of our knowledge, this is the first work that enables the resolution of an integrated TAMP formulation with fully acyclic planning and whole body dynamics with actuation constraints for the humanoid loco-manipulation problem. A supplementary video demonstrating the results is available 2 here . I Introduction To perform any reasonable real-world task, a humanoid robot needs to plan whole-body loco-manipulation movements. Solving a holistic optimal control problem with contact constraints has been shown to successfully generate loco-manipulation behaviors in simulation [ 1 , 2 ] . However, to achieve this these approaches relax complementarity constraints imposed by contact which introduces several artefacts and non-physical behaviors (e.g., force at a distance) in the generated trajectories, all the while being prone to poor local minima due to the non-convexity of the relaxed contact constraints. Furthermore, when multiple objects with sparse contact points (grabbing a handle to move an object or opening a door) are included, they struggle to find a solution. Classical approaches for planning and control of loco-manipulation systems consider the effect of manipulated objects on the locomotion system as a disturbance [ 3 , 4 , 5 ] . However, for solving complex loco-manipulation problems, concurrent consideration of both locomotion and manipulation is essential. For instance, for picking an object off of a tall shelf, the robot may first need to move a table close to the shelf and stand on it in order to reach the object. There have been recent efforts on the use of deep reinforcement learning (DRL) for loco-manipulation tasks in the real world [ 6 ] . However, these approaches are limited to very simple loco-manipulation tasks and cannot reason about more complex long-horizon goals. Imitation learning from tele-operation demonstration is another approach to performing complex loco-manipulation policies [ 7 , 8 ] . However, this approach requires expensive and laborious demonstration collection, which is in particular highly challenging for unstable loco-manipulation systems like humanoid robots. To address long-horizon, sequential manipulation tasks, [ 9 ] used an optimization-based framework known as logic-geometric programming (LGP) [ 10 ] . In [ 9 ] , the integrated TAMP problem [ 11 ] was formulated as a tree search combining motion optimization with symbolic planning. To achieve this for sequential manipulation, a kinematic trajectory optimization augmented with logic predicates that constrain object dynamics was used. While the approach demonstrated strong performance on a stationary manipulator and later on a mobile manipulator [ 12 ] , the omission of robot dynamics and robot-environment patch planning restricts the method’s applicability to tasks where the robot remains statically stable and does not need to plan transitions between different patches in the environment. To extend TAMP to quadrupedal loco-manipulation, [ 13 ] adopted an optimization-based framework similar to that of [ 10 , 9 ] . In particular, [ 13 ] combined a first-order kinematics model augmented with full centroidal dynamics and complete object dynamics, enabling the generation of dynamically stable motions for a legged robot, which were successfully executed in real-world experiments. Despite these impressive results, the approach is constrained to motions with predefined locomotion cycles and a predefined number of end-effectors in contact with the ground. Moreover, tree expansion relies on reference generation and short-horizon optimization with only one full horizon refinement at the end, which restricts the diversity of achievable behaviors. Actuation limits are also not incorporated due to the use of a first-order kinematic model. Compared to [ 13 ] , we employ a second-order kinematic model with whole-body centroidal momentum dynamics, which allows us to incorporate actuation limits. This capability is crucial for executing dynamic motions on a humanoid robot, which is inherently unstable, and allows us to achieve fully acyclic planning for all end-effectors. Furthermore, in each tree expansion, we solve a full-horizon trajectory optimization, since adding a new constraint inevitably affects the preceding motion. In addition, unlike [ 13 ] , which considers only discrete actions for manipulation, we unify the representation of locomotion and manipulation symbols, allowing us to reason over complex loco-manipulation skills. Finally, while [ 13 ] demonstrates TAMP on quadrupeds with a single arm, we tackle the more challenging problem of humanoid loco-manipulation involving two arms. Fig. 1 : Overview of the proposed framework. Second panel : the task and the scene are translated into our symbolic framework at the level of contact. Our symbolic state includes all the interfaces in contact in the scene as well as the type of contact (Section III-A ). Third panel : given a symbolic goal, a tree search algorithm plans for a sequence of contact leading to the goal. The search is guided by object-centric manipulation logic (Section III-D ). Fourth panel : a contact-explicit TO solver optimizes for state and control (of both robot and objects) to achieve the candidate contact plan. Time duration of each contact phase is optimized (Section III-B ). The interface between symbolic planning and TO is detailed in Section III-C . The main contributions of this paper are as follows: • We present a TAMP formulation for whole-body, long-horizon loco-manipulation that enables simultaneous decision-making over task, contact, and motions under whole-body constraints. Our generic formulation enables fully acyclic end-effector planning and dynamic patch transitions, while a unified treatment of locomotion and manipulation decision variables allows reasoning over complex loco-manipulation behaviors. • We develop a dedicated solver based on a combination of graph search and continuous trajectory optimization to generate long-horizon loco-manipulation behaviors with a mixture of different contact interaction modalities, such as one-handed full grasps and bi-manual loco-manipulation. To the best of our knowledge, this is the first work that enables the resolution of an integrated TAMP formulation with fully acyclic planning and whole body dynamics with actuation constraints for the humanoid loco-manipulation problem. The rest of the paper is structured as follows. Section II presents the extension of [ 9 ] to floating-base systems. Section III outlines our problem formulation, highlighting the key details that enable the generation of long-horizon humanoid loco-manipulation plans. In Section IV , we present the results and conclude our findings in V . II Preliminaries II-A Floating-base dynamics Our TAMP formulation in this paper is an extension of LGP, which was originally developed for manipulation problems in [ 9 ] . When extending to a floating-base legged robot, it becomes essential to consider the under-actuated part of the dynamics to make sure the generated motion is consistent with the floating-base dynamics and does not lead the robot to fall. In particular, as it is shown in [ 14 ] ,