SSPINNpose: A Self-Supervised PINN for Inertial Pose and Dynamics Estimation

Markus Gambietz, Eva Dorschky, Altan Akat, Marcel Schöckel, Jörg Miehling, Anne D. Koelewijn · 2025

Read SSPINNpose: A Self-Supervised PINN for Inertial Pose and Dynamics Estimation by Markus Gambietz, Eva Dorschky, Altan Akat, Marcel Schöckel, Jörg Miehling, Anne D. Koelewijn (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-11786.txt.

Introduction

Markus Gambietz and co-authors estimate human pose and body forces from wearable motion sensors without any labeled training data, in this 2025 paper. Lab camera systems supply the usual ground truth, but they add errors and fail on new movements. Their method teaches itself using physics instead.

A neural network proposes joint angles and forces from the sensor stream. A physics model of the body turns those into virtual sensor readings. Training pulls the virtual readings toward the real ones, so no camera data is needed. Checks against camera capture suggest the self-taught estimates track real motion well enough for clinic and sport.

Catalog record

CREATORMarkus Gambietz, Eva Dorschky, Altan Akat, Marcel Schöckel, Jörg Miehling, Anne D. Koelewijn
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE56 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-11786

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

SSPINNpose: A Self-Supervised PINN for Inertial Pose and Dynamics Estimation Markus Gambietz, Eva Dorschky, Altan Akat, Marcel Schöckel, Jörg Miehling, Anne D. Koelewijn Abstract Accurate real-time estimation of human movement dynamics, including internal joint moments and muscle forces, is essential for applications in clinical diagnostics and sports performance monitoring. Inertial measurement units (IMUs) provide a minimally intrusive solution for capturing motion data, particularly when used in sparse sensor configurations. However, current real-time methods rely on supervised learning, where a ground truth dataset needs to be measured with laboratory measurement systems, such as optical motion capture. These systems are known to introduce measurement and processing errors and often fail to generalize to real-world or previously unseen movements, necessitating new data collection efforts that are time-consuming and impractical. To overcome these limitations, we propose SSPINNpose, a self-supervised, physics-informed neural network that estimates joint kinematics and kinetics directly from IMU data, without requiring ground truth labels for training. We run the network output through a physics model of the human body to optimize physical plausibility and generate virtual measurement data. Using this virtual sensor data, the network is trained directly on the measured sensor data instead of a ground truth. When compared to optical motion capture, SSPINNpose is able to accurately estimate joint angles and joint moments at an RMSD of 8.7 ° 8.7\text{\,}\mathrm{\SIUnitSymbolDegree} and 4.9 B ​ W ​ B ​ H % 4.9\text{\,}{BWBH\%} , respectively, for walking and running at speeds up to 4.9 m s − 1 4.9\text{\,}\mathrm{m}\text{\,}{\mathrm{s}}^{-1} at a latency of 3.5 ms 3.5\text{\,}\mathrm{ms} . Furthermore, the framework demonstrates robustness across sparse sensor configurations and can infer the anatomical locations of the sensors. These results underscore the potential of SSPINNpose as a scalable and adaptable solution for real-time biomechanical analysis in both laboratory and field environments. 1 Introduction Understanding the injury mechanisms important for their prevention. However, injuries seldomly occur in controlled environments [ 1 , 2 ] . Therefore, in-the-wild capturing of human movement dynamics, e.g. kinematics, joint torques, and ground reaction forces (GRFs), is required. Currently, the gold standard for capturing kinematics is optical motion capture (OMC), which is limited to a lab environment. In OMC, a person is fitted with reflective markers that are tracked by multiple cameras. Joint torques are estimated from the kinematics and force data, which are measured using force plates embedded into the floor, which further limits the environment. Applying the markers by hand is error-prone and the resulting kinematics can vary between different assessors and laboratories [ 3 , 4 ] . Furthermore, different processing techniques can also lead to different results [ 5 ] . An alternative to OMC is the use of inertial measurement units (IMUs). These small, lightweight sensors can be worn during sports activities. Recent studies have explored methods that, based on inertial sensing, estimate poses [ 6 , 7 , 8 , 9 , 10 , 11 ] , forces [ 12 ] or full dynamics [ 13 , 14 , 15 , 16 , 17 , 18 ] . The dynamics estimations are either based on deep learning [ 6 , 18 , 15 ] , trajectory optimization [ 14 , 17 ] or static optimization [ 13 ] . Current deep learning methods rely on supervised learning, which requires labeled data for training and, therefore, inherit the limitations and biases [ 4 ] of OMC. As a practical example, motions like high-speed running or sprinting require a large recording area, and are absent in widely used public IMU datasets like DIP-IMU and TotalCapture [ 9 , 19 ] . Additionally, these datasets do not include force data. On the other hand, optimization-based methods need no labeled data but are computationally expensive, therefore not capable of real-time inference. This furthermore makes them infeasible for analyzing dynamics over a long time period, which, for example, could be a running session leading to an injury. Both deep learning and optimization-based methods can handle sparse IMU configurations [ 18 , 6 , 17 , 20 ] , where not every body part is equipped with an IMU. This can make a system more practical for the user, but also makes the reconstruction of human movement dynamics even more challenging [ 8 ] . Similar to optical markers, the placement of IMUs can introduce errors in the kinematics estimation. Therefore, inferring the sensor placement from the data can be highly beneficial. To address these limitations, we introduce SSPINNpose, which combines the real-time inference of learning-based methods with the ability of optimization-based approaches to reconstruct motions without relying on labeled data. The core principle behind SSPINNpose, a self-supervised physics-informed learning method, is that if an estimated motion is physically correct and corresponds to the measured IMU data, it is likely to be the correct motion. During training, the network is therefore guided to generate physically plausible motions that align with IMU data through virtual sensors. We further exploit auxiliary assumptions to accelerate training, mitigate local minima or enforce known properties of human movement. Our main contribution is to transform the trajectory optimization problems from Li et al. [ 17 ] and Dorschky et al. [ 14 ] into a self-supervised learning problem, which allows for real-time inference. We further demonstrate that our method can be used with sparse IMU configurations and to estimate the IMU placement. To our knowledge, SSPINNpose is the first real-time method for estimating biomechanical variables from inertial sensor data without labeled training data. 2 Related Work Our work focuses on gait analysis, specifically the estimation of human movement dynamics, including both kinematics and the internal/external forces acting on the body. Since most dynamic motion during straight walking or running occurs in the lower limbs, particularly in the sagittal (forward-upward) plane, we review works that either examine full-body motion or focus on this plane. Deep learning for movement dynamics: In order to estimate the 3D pose of a person in real-time from sparse IMU configurations, Huang et al. [ 9 ] proposed a deep learning-based method using a recurrent neural network (RNN). Subsequent work enhanced motion accuracy and allowed for flexible sensor configurations [ 6 , 7 , 10 , 21 ] . Since visually plausible motion was prioritized in these early methods, physical correctness, such as accurate force estimation, became a significant next step. Therefore, Winkler et al. [ 18 ] trained reinforcement learning agents to control torque-driven multibody dynamics models in a physical simulator. Another approach, Physical Inertial Poser (PIP), [ 16 ] introduced a physics module to create physically plausible motions. The physics module contains a proportional-derivative (PD) controller and a motion optimizer, which also yields joint torques and GRFs, but only the kinematics have been validated so far. Similar to PIP, two-stage inference methods, where kinematics are first estimated with a learned prior and then dynamically updated with a physics model, are established in the domain of video-based pose estimation [ 22 , 23 , 24 , 25 , 26 ] . In biomechanical applications, reference data was often recorded with OMC in combination with force plates, from which joint angles and torques can be estimated via inverse kinematics and inverse dynamics. Supervised deep learning models have demonstrated to accurately predict these outcome

Read the complete text