Motion Control of High-Dimensional Musculoskeletal Systems with Hierarchical Model-Based Planning

Yunyue Wei, Shanning Zhuang, Vincent Zhuang, Yanan Sui · 2025

Read Motion Control of High-Dimensional Musculoskeletal Systems with Hierarchical Model-Based Planning by Yunyue Wei, Shanning Zhuang, Vincent Zhuang, Yanan Sui (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-08238.txt.

Introduction

Yunyue Wei, Shanning Zhuang, Vincent Zhuang, and Yanan Sui present a control method for body-like models with many moving parts in this 2025 paper. Such musculoskeletal systems are hard to steer because their state and action spaces are huge. Learning methods can work, but they are slow and need much tuning.

Their method plans in two layers: a sampling planner picks target postures, and a body-aware controller coordinates the actuators to reach them. The system steers a detailed human body model with no task-specific training. It handled standing, walking over varied ground, and copying sports motions. The goal score can be tuned by automatic search rather than by hand. The authors say this cuts the human effort needed to set up new tasks.

Catalog record

CREATORYunyue Wei, Shanning Zhuang, Vincent Zhuang, Yanan Sui
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE46 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-08238

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Motion Control of High-Dimensional Musculoskeletal Systems with Hierarchical Model-Based Planning Yunyue Wei, Shanning Zhuang, Vincent Zhuang, Yanan Sui Abstract Controlling high-dimensional nonlinear systems, such as those found in biological and robotic applications, is challenging due to large state and action spaces. While deep reinforcement learning has achieved a number of successes in these domains, it is computationally intensive and time consuming, and therefore not suitable for solving large collections of tasks that require significant manual tuning. In this work, we introduce Model Predictive Control with Morphology-aware Proportional Control ( MPC 2 ), a hierarchical model-based learning algorithm for zero-shot and near-real-time control of high-dimensional complex dynamical systems. MPC 2 uses a sampling-based model predictive controller for target posture planning, and enables robust control for high-dimensional tasks by incorporating a morphology-aware proportional controller for actuator coordination. The algorithm enables motion control of a high-dimensional human musculoskeletal model in a variety of motion tasks, such as standing, walking on different terrains, and imitating sports activities. The reward function of MPC 2 can be tuned via black-box optimization, drastically reducing the need for human-intensive reward engineering. Figure 1: Movement control of whole-body human musculoskeletal system over a diverse set of motion control tasks. The videos of the control performances are on the project page . 1 Introduction High-dimensional nonlinear dynamical systems are prevalent in the real world, with important examples including biological musculoskeletal systems. The system complexity laid the foundation of flexible motion due to their over-actuated nature. The presence of redundant actuation enhances the safety and robustness of the system, reducing the risk of performance degradation from actuator faults ( Hsu et al., 1989 ) . However, it also leads to large state and action spaces, posing significant challenges to achieving stable control performance. We take the human musculoskeletal system as a key example, where hundreds of muscles coordinate to facilitate various movements. Understanding and optimizing control in such systems is crucial for applications in healthcare and human robot interaction ( Kidziński et al., 2018 ; Vittorio et al., 2022 ) . Deep reinforcement learning (DRL) is a promising approach for controlling high-dimensional systems. However, RL approaches often struggle in high-dimensional state and action spaces, and typically require the use of lower-dimensional representations. More importantly, the immense computational requirements of DRL imposes a severe bottleneck on the iteration speed of reward engineering, meaning that researchers often need days (or longer) to discover effective control policies. Furthermore, the high nonlinearity of the musculoskeletal system necessitates considerable sequential computation, complicating its parallel deployment on GPUs and impeding the training speed of DRL algorithms. Being able to generate effective control policies for high-dimensional nonlinear dynamical systems in near real-time is an open challenge. Clinical studies on motor control of human movement revealed that predictive sampling is a crucial strategy in human movement control, such as maintaining balance during walking ( Winter, 1991 ; Patla, 2003 ) , where planning over a finite horizon determines the controls to be executed. Recent works have started to incorporate model predictive control (MPC) as the control backbone, offering faster behavior synthesis and more efficient reward design compared to DRL ( Howell et al., 2022 ; Yu et al., 2023 ) . However, effective planning in high-dimensional control spaces remains challenging, limiting the success of MPC primarily to low-dimensional systems. To the best of our knowledge, no training-free methods have achieved stable movement control of a whole-body musculoskeletal model across varying task conditions. In this paper, we propose Model Predictive Control with Morphology-aware Proportional Control ( MPC 2 ), a hierarchical model-based planning algorithm designed to address the challenges of high-dimensional musculoskeletal control. We introduce a sampling-based model predictive controller to plan the target posture of the agent, while a morphology-aware proportional controller serves as the low-level policy, adaptively coordinating the actuators to achieve the target joint positions. We demonstrate that our method can achieve stable control of a 700-actuator whole-body musculoskeletal model without training , enabling tasks such as standing, walking over varying terrain conditions, and sports motion imitation (Figure 1 ). Furthermore, we show that MPC 2 ’s fast control generation facilitates efficient cost function optimization, improving task performance, especially for performing complex sequences of movement. The bottleneck in achieving real-time control with MPC 2 is the speed of the additional model forward dynamics computation, which can be solved by using more powerful computing devices or by controlling systems with reduced complexity. Our contributions. (1) We propose MPC 2 , the first MPC-based method capable of achieving near real-time stable control of high-dimensional musculoskeletal systems. (2) We demonstrate that our hierarchical model predictive control algorithm enables zero-shot high-dimensional full-body motion control across a wide range of motion tasks, many of which have not been achieved by state-of-the-art DRL-based methods. (3) We show that the much faster control generation latency of MPC 2 facilitates automated cost function optimization via Bayesian optimization, demonstrating a pathway for reducing the human burden of reward engineering to near zero. Figure 2: Workflow of Model Predictive Control with Morphology-aware Proportional Control ( MPC 2 ). Solid arrows indicate control pipeline, and dashed arrows indicate planning procedure. 2 Related Work High-dimensional musculoskeletal control. The control of musculoskeletal systems is challenging due to both high dimensionality and non-linearity, with deep reinforcement learning (DRL) being the predominant choice in existing solutions ( Kidziński et al., 2018 ; Geiß et al., 2024 ) . Hierarchical architectures are often employed to decompose control across different modules, where DRL provides high-level actions and a low-level policy generates muscle controls ( Lee et al., 2019 ; Park et al., 2022 ; Feng et al., 2023 ) . These approaches typically require large collections of motion data for imitation learning. Several works have also explored strategies to improve sample efficiency in over-actuated regime, including bio-inspired exploration ( Schumacher et al., 2022 ) , latent space exploration ( Chiappa et al., 2023 ) , model-based planning ( Hansen et al., 2023 ) , and multi-task learning ( Caggiano et al., 2023 ) . Recent studies have leveraged muscle synergies to reduce control dimensionality, enabling stable control across various musculoskeletal models ( Berg et al., 2023 ; He et al., 2024 ) . These methods typically require many hours or days of training to achieve effective control, posing a significant bottleneck on the iteration speed of reward engineering. Model-predictive control. Compared to DRL, model predictive control allows for real-time control ( Tassa et al., 2012 ) , and thus has seen an increasing application of MPC in robotics, including tasks such as quadruped locomotion and dexterous manipulation ( Kim et al., 2023 ) . Recent works have also integrated MPC into the reward design process due to its training-free nature ( Jain et al., 2021 ; Yu et al., 2023 ; Liang et al., 2024 ) . However, MPC typically succeeds only in low-dimensional settings and often struggles when applied to high-dimensional problems. The most complex systems handled by existing MPC-based methods are typically torque-driven humanoids ( Meser et al., 2024 ) . 3 Preliminaries 3.1 Musculoskeletal system control High-dimensional over-actuated system. In this paper, we used musculoskeletal models as the target high-dimensional over-actuated system, where the model dynamics can be formulated as follows:

Read the complete text