KINESIS: Motion Imitation for Human Musculoskeletal Locomotion

Merkourios Simos, Alberto Chiappa, Alexander Mathis · 2025

Read KINESIS: Motion Imitation for Human Musculoskeletal Locomotion by Merkourios Simos, Alberto Chiappa, Alexander Mathis (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-14637.txt.

Introduction

Simos, Chiappa, and Mathis teach a simulated human body to move by copying real motion, muscles and all. Game-style humanoids driven by joint torques miss how people actually work: joints are constrained and muscles pull in overlapping, nonlinear ways. Their framework, KINESIS, learns from under two hours of recorded locomotion and imitates new, unseen movement well.

Its controller runs bodies with up to 290 muscles, and the muscle activity it generates lines up with real human recordings. The learned skills transfer to fresh tasks such as following text commands, walking to a target, and kicking a penalty. The authors argue this physiological realism makes the system a strong base for studying human motor control.

Catalog record

CREATORMerkourios Simos, Alberto Chiappa, Alexander Mathis
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE43 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-14637

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

KINESIS: Motion Imitation for Human Musculoskeletal Locomotion Merkourios Simos, Alberto Chiappa, Alexander Mathis Abstract How do humans move? Advances in reinforcement learning (RL) have produced impressive results in capturing human motion using physics-based humanoid control. However, torque-controlled humanoids fail to model key aspects of human motor control such as biomechanical joint constraints and non-linear, overactuated musculotendon control. We present KINESIS, a model-free motion imitation framework that tackles these challenges. KINESIS is trained on 1.8 hours of locomotion data and achieves strong motion imitation performance on unseen trajectories. Through a negative mining approach, KINESIS learns robust locomotion priors that we leverage to deploy the policy on several downstream tasks such as text-to-control, target point reaching, and football penalty kicks. Importantly, KINESIS learns to generate muscle activity patterns that correlate well with human EMG activity. We show that these results scale seamlessly across biomechanical model complexity, demonstrating control of up to 290 muscles. Overall, the physiological plausibility makes KINESIS a promising model for tackling challenging problems in human motor control. Code, videos, and benchmarks are available at https://github.com/amathislab/Kinesis. I Introduction A hallmark of embodied intelligence is the ability to efficiently navigate the world. In humans and other animals, this capacity to locomote translates to a diverse skillset including walking, turning, and running, movements that are driven by hundreds of musculotendon organs, constrained by the intricate joint morphology of the skeletal system [ 1 ] . How biological organisms master the complexity of the musculoskeletal system is a crucial question for neuroscience, and it could hold the key to unlocking robust and efficient high-dimensional motor control in robots. Deep reinforcement learning (DRL) has shown success in the field of physics-based motor control, enabling the control of humanoids that run, jump, and navigate complex terrain [ 2 , 3 ] . However, due to different scientific goals, these approaches use unrealistic models of the human body, which consist of a simplified kinematic tree and are notably controlled by torque controllers instead of muscles. Realistic musculoskeletal models, which are necessary to capture the true complexity of human locomotion, are receiving increasing attention across scientific domains [ 4 , 5 , 6 , 7 , 8 ] . Yet, despite the significant progress of the last years [ 6 , 8 ] , current works on muscle-driven locomotion are still limited compared to their torque-controlled counterparts, primarily due to their narrow focus on forward gait [ 9 , 10 , 11 ] or lack of quantitative comparisons to human data [ 12 , 13 , 14 ] . Fig. 1: KINESIS is a model-free RL policy for the musculoskeletal control of locomotion. Top left: Our policy is trained on a curated set of MoCap data focusing on locomotion, and can successfully imitate unseen motion clips of the same locomotion types. Top right: KINESIS can be deployed zero-shot on synthetic text-conditioned motion sequences. Bottom left: KINESIS is fine-tuned to reach goal locations, and produces human-like motion without reference motion guidance. Bottom right: Muscle activity patterns produced during motion imitation (active muscles shown in orange, inactive muscles shown in black) correlate well with human electrophysiology data (EMG). We propose KINESIS , a model-free motion imitation framework that facilitates the development of effective and scalable muscle-based control policies of locomotion (Fig. 1 ). We trained KINESIS on 1.8 hours of motion capture data that we curated for whole-body locomotion. We implemented this framework on three biomechanically validated musculoskeletal models of increasing complexity, and demonstrate that the learned policies achieve quantifiably high motion tracking performance and high-level controllability through natural language and target-reaching commands. Furthermore, we demonstrate that KINESIS serves as a strong foundation for downstream tasks by fine-tuning the policy to perform football penalty kicks. Finally, we find that the learned policies produce physiologically plausible muscle activity patterns, which we validate by comparisons with human electromyography (EMG) recordings across multiple subjects. II Related Work Musculoskeletal Models of the Human Body Efforts to model the human musculoskeletal system trace back to the Hill-type model, which provided a mathematical formulation of the dynamical properties of muscles [ 15 ] , and much later of musculotendon units [ 16 ] . Since then, many works have incorporated these models into numerical simulations of muscle-based systems [ 8 ] . In particular, the OpenSim platform provided an open-source tool for the design of accurate musculoskeletal models of the human body [ 4 , 17 ] . Unfortunately, it is computationally costly compared to physics engines that are used in robotics, machine learning and RL [ 18 ] . To this end, Lee et al. [ 12 ] implemented a full musculoskeletal model in DART [ 19 , 12 ] , and incorporated it into a motor skill task. Similarly, Caggiano et al. [ 20 ] developed MyoSuite, a suite of physiologically accurate biomechanical models implemented in Mujoco by porting models from OpenSim. Contemporary RL work uses alternative musculoskeletal models with more muscles [ 21 ] ; however, those are not open-source. In this work, we use three variants of the MyoLeg model from Myosuite, with the most complex variant featuring 290 muscles, more than any other open-source model. Control of Musculoskeletal Agents For high-dimensional musculoskeletal control, some works have utilized reference motion data [ 12 , 13 , 22 , 14 ] , whereas others focused on task-oriented learning frameworks [ 23 , 24 , 25 , 10 , 26 , 11 , 27 , 28 , 29 , 30 , 31 ] . MuscleVAE combined motion imitation of various locomotion skills with a muscle fatigue model using a model-based policy [ 13 ] . More recently, MAGNET introduced a three-stage learning approach for imitation learning of a large MoCap dataset and developed a distilled model for real-time muscle activity generation [ 14 ] . While the current lack of available training code for either of these works hinders direct comparison, KINESIS presents several comparative advantages. First, KINESIS is based on a single-stage, model-free algorithm, demonstrating seamless application to three musculoskeletal models with virtually no hyperparameter tuning. Second, we do not rely on model distillation for real-time muscle activity generation; our full model can run at 3.8-times the real speed on the CPU of a commercial laptop. Third, we present comprehensive quantitative metrics for our imitation and EMG comparison results as a baseline for future work. Comparison with human muscle activity Electromyography (EMG) signals are a common way to validate the physiological plausibility of biomechanical models fit to motion capture data [ 32 , 33 , 34 , 8 ] . In particular, the simulated muscle activity patterns are verified against physiological sequences measured by EMG. This matching is non-trivial, due to the non-linear, high dimensional, and over-actuated nature of biomechanical systems [ 4 , 5 ] . Some studies have investigated the correspondence between RL-based muscle control and human muscle activity, but for control policies generating a single motion skill at a time [ 22 , 6 ] . MAGNET focused on real-time EMG prediction, but the quantitative correspondence of the generated activity patterns to multi-subject ground truth data remains unclear [ 14 ] . Here, we propose a validation benchmark based on EMG data from human subjects during locomotion [ 35

Read the complete text