SoftMimic : Learning Compliant Whole-body Control from Examples
Gabriel B. Margolis, Michelle WangNolan Fey, Pulkit Agrawal · 2025
Read SoftMimic : Learning Compliant Whole-body Control from Examples by Gabriel B. Margolis, Michelle WangNolan Fey, Pulkit Agrawal (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-17792.txt.
Introduction
Gabriel B. Margolis and three co-authors teach humanoid robots to move softly, not stiffly. Robots often copy human motions through reinforcement learning. Usual training rewards exact tracking of a reference motion. That makes robots push back hard against surprise contacts, which can be unsafe.
Their framework, SoftMimic, rewards matching gentle responses instead of rigid tracking. A kinematics solver first builds extra examples of feasible compliant motions. Compliant here means yielding to outside forces while keeping balance. The policy then learns from that enlarged example set. Simulations and real robot tests showed safer contact behavior.
Catalog record
| CREATOR | Gabriel B. Margolis, Michelle WangNolan Fey, Pulkit Agrawal |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 53 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2510-17792
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
SoftMimic : Learning Compliant Whole-body Control from Examples Gabriel B. Margolis, Michelle WangNolan Fey, Pulkit Agrawal Abstract We introduce SoftMimic , a framework for learning compliant whole-body control policies for humanoid robots from example motions. Imitating human motions with reinforcement learning allows humanoids to quickly learn new skills, but existing methods incentivize stiff control that aggressively corrects deviations from a reference motion, leading to brittle and unsafe behavior when the robot encounters unexpected contacts. In contrast, SoftMimic enables robots to respond compliantly to external forces while maintaining balance and posture. Our approach leverages an inverse kinematics solver to generate an augmented dataset of feasible compliant motions, which we use to train a reinforcement learning policy. By rewarding the policy for matching compliant responses rather than rigidly tracking the reference motion, SoftMimic learns to absorb disturbances and generalize to varied tasks from a single motion clip. We validate our method through simulations and real-world experiments, demonstrating safe and effective interaction with the environment. I INTRODUCTION A major goal in humanoid robotics is to build agents capable of performing a vast range of tasks humans execute in everyday environments. A promising avenue towards this goal is to leverage large-scale human motion capture data, enabling robots to learn human-like behaviors through imitation [ 1 ] . Recent work has successfully trained policies for tracking single motions, diverse motion datasets, and even real-time teleoperation on humanoid hardware [ 2 , 3 , 4 , 5 , 6 ] . These methods produce impressive, dynamic motions. Figure 1 : Soft Whole-body Control via Compliant Motion Augmentation. Left : Given an original reference motion ( q_{\text{ref}} ) and a specified interaction (external wrench W_{\text{ext}} and stiffness K_{\text{robot}} ), our offline data generation stage uses an IK solver to generate a kinematically feasible and stylistically consistent compliant motion ( q_{\text{aug}} ). Right : During online training, a policy learns to reproduce this behavior. It observes the robot’s proprioceptive state and the original reference ( q_{\text{ref}} ), but is rewarded for matching the augmented target ( q_{\text{aug}} ). This forces the policy to implicitly infer the external wrench and react appropriately, resulting in a robot that can controllably comply with generalized unanticipated perturbations. In the graphic, we only annotate translational forces and displacements for ease of interpretation, but the analogous rotational quantities are also simulated. However, motion tracking is usually insufficient for safe and effective deployment in the real world, where sensing uncertainty and frequent, unplanned physical (i.e., contact-rich) interactions are commonplace. Policies trained to rigidly track a reference motion treat any deviation in the robot’s motion as an error to be corrected aggressively. Consequently, when the robot makes an unexpected contact, such as brushing against a table, misjudging an object’s location, or interacting with a person, the controller attempts to correct the motion error caused by the contact with large, uncontrolled forces, resulting in brittle and potentially dangerous behavior. This lack of compliance is also a fundamental barrier to deploying humanoids alongside people, leading to the current state of humanoids operating in isolation. To address these shortcomings and pave the path for real-world humanoid deployment, we propose a framework for compliant whole-body motion tracking called SoftMimic . The objective of SoftMimic is not to blindly minimize tracking error, but to controllably depart from the reference motion in response to external forces according to a user-specified stiffness. A lower stiffness setting allows the robot to comply more and thereby deviate more from the reference trajectory, given the same force disturbance. Achieving compliant behavior on a high-DoF humanoid is challenging because complying with a force on a single limb requires coordinated, full-body adjustments to maintain balance and preserve the overall posture and style of the motion. Directly learning compliant behavior with reinforcement learning (RL) poses significant exploration challenges, as a stiff, non-compliant policy is often a strong local optimum. In scenarios where the robot must comply substantially, reward terms like tracking keypoints and joint angles, which typically reinforce each other, can come into conflict, making it difficult to balance them across a large potential solution space [ 7 ] . Furthermore, many desired compliant responses are kinematically or dynamically infeasible depending on the robot’s configuration, resulting in training for impossible tasks, which hinders learning [ 8 ] . To overcome these challenges, we adopt a learning-from-examples strategy. Instead of asking RL to discover compliant behaviors through intricate reward shaping, we first generate a dataset of kinematic references for compliant behaviors. We use an inverse kinematics (IK) solver to author a large-scale dataset of feasible and stylistically-consistent compliant trajectories for a wide range of interaction scenarios. This offline process allows us to filter out impossible tasks and precisely define the desired whole-body coordination. We then train a policy using RL, where the agent observes the robot’s state and the original, non-compliant reference motion, but is rewarded for tracking the corresponding pre-computed compliant trajectory from our augmented dataset. This formulation forces the policy to learn to infer the external forces from proprioceptive sensing and react with the demonstrated compliant behavior. Our experiments demonstrate that this approach yields a policy capable of tracking reference motions while exhibiting predictable, controllable compliance. Our compliant controller is more robust to disturbances, can generalize a single motion clip to handle variations in a task (e.g., picking up boxes of different sizes), and safely manages unexpected collisions. Crucially, these benefits are achieved while preserving good motion tracking performance in the absence of external forces. We validate our framework in simulation and on a real Unitree G1 humanoid robot. II RELATED WORK II-A Learning Humanoid Whole-Body Control The convergence of recent progress in articulated rigid-body simulation [ 9 , 10 , 11 ] , sim-to-real transfer techniques [ 12 , 13 , 14 ] , and advanced legged hardware [ 15 , 16 , 17 , 18 ] , combined with reinforcement learning paradigms like DeepMimic [ 19 , 1 ] , has enabled impressive performance in humanoid robot motion imitation [ 5 , 2 , 6 ] and real-time teleoperation [ 3 , 4 , 20 , 21 ] . Building on these components, some works use such whole-body controllers to teleoperate new tasks and train visuomotor policies on the resulting demonstrations, establishing a mapping from image observations to whole-body motion references [ 22 , 23 , 24 , 25 ] . During imitation or teleoperation, a common scenario is that the robot contacts an object while the teleoperator or motion reference does not. Light objects may be pushed out of the way or lifted, but heavier objects or fixtures may impede the robot and inhibit it from matching the reference. A natural question is what posture the robot should adopt when it is forced away from the reference motion, and how much force the robot should exert against the environment when attempting to reduce tracking error. Traditional factory arms that are purely position-controlled are extremely stiff, and consequently may damage themselves or the environment with large and unpredictable forces when impeded, making them dangerous and brittle to small environmental variations. Modern quasi-direct-drive (QDD) actuators support torque sensing and control, which allows them to realize different stiffnesses through software emulation. A prevalent strategy within learning-based whole-body control