Constrained Whole-Body Tracking for Humanoid Robots

Daniel Morton, Pranit Mohnot, Marco Pavone · 2026

Read Constrained Whole-Body Tracking for Humanoid Robots by Daniel Morton, Pranit Mohnot, Marco Pavone (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-00374.txt.

Introduction

Morton, Mohnot, and Pavone add live bound checks to whole-body track plans for humanoid bots. Late reward-based tools give such bots brisk, full-body grace. Hard bounds, most of all late-set ones, stay hard to keep. Their frame, ConstrainedMimic, guards those bounds in real time.

The frame draws on space-steer math and wall-type guard laws. It can hold bounds on both the guide moves and the bot's own force laws. It runs fast, at more than one round per thousandth of a second. Tests run in sims and on real gear. The bot dodges hits with self and with blocks in its path. Joint caps and mass-core calm are held at once. Bounds trim the plan just as much as they must.

Catalog record

CREATORDaniel Morton, Pranit Mohnot, Marco Pavone
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE51 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.00374

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Constrained Whole-Body Tracking for Humanoid Robots Daniel Morton, Pranit Mohnot, Marco Pavone Abstract Recent advances in reinforcement learning (RL) have demonstrated impressive whole-body agility for humanoid robots, yet ensuring safety and satisfying constraints -- particularly those specified after training -- remains a challenge. Towards this goal, we present ConstrainedMimic, a control framework that leverages whole-body kinematics and dynamics for real-time constraint enforcement within RL tracking policies. By integrating principles from operational space control and control barrier functions (CBFs), we enable the satisfaction of arbitrary runtime constraints on both the kinematic reference motion and the underlying dynamics. In whole-body motion-tracking and teleoperation experiments on a (simulated) Unitree G1 with a learned policy, we demonstrate collision avoidance (both with the robot body and external obstacles), joint limits, and center of mass stability constraints. By remaining consistent with the current contact mode and tracking objectives, we minimally restrict the capabilities of the policy when constraints are active. Our method is fully differentiable, runs on CPU, GPU, and TPU, and can be deployed at up to 300-500 Hz. All software will be freely available upon publication. † † footnotetext: Correspondence to: [email protected] Keywords: Whole-body control, Safety, Humanoids 1 Introduction Modern humanoid robots are becoming increasingly capable of whole-body teleoperation, locomotion, and manipulation, with reinforcement learning (RL) policies that achieve striking agility on hardware [ 1 , 2 , 3 ] . As these systems are deployed, especially when they must interact with novel scenes, other equipment, or humans, a framework to enforce previously unseen safety constraints becomes critical. An ideal runtime safety framework would be minimally invasive, policy-agnostic, easily configurable for arbitrary deployment-time constraints, and capable of real-time speeds ( \geq 50 Hz). Recent work has led to significant advances in humanoid whole-body control, demonstrating capable tracking across teleoperation [ 1 , 4 , 5 , 6 ] , multi-task control [ 2 , 7 ] , and expressive behaviors at scale [ 3 ] . Despite this diversity, these works share a common architectural paradigm: reference kinematic trajectories from retargeted MoCap, VR teleoperation, or high-level planners are passed to an RL motion tracking policy, which takes these (often dynamically infeasible) references and outputs joint commands that produce closely-tracking dynamically-feasible trajectories on the real robot. This separation provides two natural points at which safety can be considered without modifying the tracking policy: the input kinematic reference, and the output dynamics. With these desiderata and problem structure in mind, control barrier functions (CBFs) may be a natural choice to embed safety into humanoid locomotion and manipulation. Commonly used in optimization-based control, CBFs enforce safety via forward-invariance of a set defined by a differentiable barrier function h(\mathbf{z}) , and are typically applied as a safety filter on top of a nominal, unsafe controller [ 8 ] . While CBFs for humanoids have been explored in prior work [ 9 , 10 , 11 , 12 , 13 , 14 ] , safety for whole-body control remains underexplored, particularly in the context of learning-based motion tracking policies. Figure 1: Where does safety fit into a learning-based humanoid motion tracking stack? We approach safety from both the kinematics and dynamics levels, addressing safety from both sides (input and output) of the policy. On the kinematics side, constraints can naturally fit into the IK-based retargeting process between human and robot form-factors, or be applied as a safety filter on motions already mapped to the robot geometry. On the dynamics side, a potentially unsafe output from the policy can be passed through a safety filter prior to execution on the robot. 1.1 Related Work Whole-Body Control of Humanoid Robots. For years, the dominant approach to whole-body control was purely model-based, including operational-space control [ 15 , 16 , 17 ] and broader optimization-based methods [ 18 , 19 ] . More recently, RL-based whole-body control has since become the leading paradigm, with systems demonstrating whole-body teleoperation [ 1 , 4 , 5 , 6 ] , operation across multiple control modes [ 7 ] , diffusion-based skill composition [ 2 ] , and motion tracking at foundation-model scale [ 3 ] . In this paradigm, reference trajectories are produced by retargeting human motion to robot kinematics via inverse kinematics and optimization [ 20 , 21 , 22 , 23 ] , in both online and offline contexts. Broadly, these recent RL-based methods take advantage of modeling structure in robot kinematics as an interface for control, while relying on the expressiveness of learning-based policies for robustness and recovery behaviors. Learning-Based Humanoid Safety. Recent works in safety for learning-based humanoid control have explored several directions. First, methods that prioritize compliance [ 24 , 25 , 26 ] limit risk during incidental contact with humans, the environment, or the robot itself. Also critical to safety is understanding when and how to stop the robot [ 27 ] , and avoiding damage during falls [ 28 , 29 ] . However, these contexts differ from state constraint enforcement, which typically seeks to avoid contact or avoid exceeding other physical limits. Towards this end, recent work compiles and compares common safety methods [ 30 ] , incorporates potential fields during policy training [ 31 ] , and analyzes constraint infeasibility in cluttered settings [ 32 ] . CBFs for Humanoid Safety. CBFs have been applied to legged systems since early bipedal-walking demonstrations [ 9 , 10 ] . For humanoids, acceleration-level CBFs have been used as constraints in optimization-based whole-body controllers, for self-collision avoidance in locomotion [ 11 ] and task-space constraints in model-based control [ 12 ] . However, both works enforce the CBF with a reduced-order double-integrator model, which fails to properly consider the true constrained dynamics of the system. For more recent work combining CBFs and RL, two works are closest to ours. SHIELD [ 13 ] learns a stochastic residual on top of a planar single-integrator nominal model and enforces CBFs for safety in expectation. CBF-RL [ 14 ] integrates CBFs into the RL training loop for lower-body locomotion, demonstrating planar obstacle avoidance and stair-stepping. Both focus on locomotion , rather than whole-body tracking. 1.2 Contributions We make several contributions towards safe learning-based whole-body tracking. First, we identify where safety can be enforced in the motion-tracking stack (Fig. 1 ): at the input (kinematic reference) and the output (low-level joint commands) of the policy, and propose three methods for constraint enforcement: constrained retargeting , kinematic filters , and dynamic filters . For each of these methods, we construct CBFs on the full contact-constrained kinematics and dynamics, with task-consistent filtering objectives that respect the implicit task structure of motion tracking. Together, these form ConstrainedMimic : a runtime safety framework for learned whole-body motion-tracking policies, fully in JAX and capable of running well above policy frequency even on edge compute. In simulation, we demonstrate runtime-specified collision avoidance, joint limits, and stability constraints on top of unmodified pre-trained motion-tracking policies. 2 Constrained Whole-Body Tracking Safety in an RL-based motion-tracking stack admits two natural intervention points: the input kinematic reference, and the output joint commands. This gives rise to three methods (Fig. 1 ): a CBF inside the IK retargeter that produces the input reference (Sec. 2.2 ); a filter on already-retargeted references (Sec. 2.3

Read the complete text