HumanCM: One Step Human Motion Prediction * Corresponding author

1 st Haojie Liu, 2 nd Suixiang Gao * · 2025

Read HumanCM: One Step Human Motion Prediction * Corresponding author by 1 st Haojie Liu, 2 nd Suixiang Gao * (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-16709.txt.

Introduction

Liu Haojie and Gao Suixiang, a two-author team, introduce HumanCM, a method that predicts human motion in a single step. Motion prediction guesses how a body will move next, which matters for animation and human-robot interaction. Diffusion models do this well but need many denoising steps, which makes them slow.

HumanCM instead learns a direct, self-consistent map from noisy motion to clean motion, based on consistency models. Its Transformer design reads motion across space and time and uses time embeddings to keep movements coherent. On the Human3.6M and HumanEva-I benchmarks, it matched or beat leading diffusion models. At the same time, it cut the number of inference steps by up to about a hundredfold.

Catalog record

CREATOR1 st Haojie Liu, 2 nd Suixiang Gao *
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE20 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2510-16709

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

HumanCM: One Step Human Motion Prediction * Corresponding author 1 st Haojie Liu, 2 nd Suixiang Gao * Abstract We present HumanCM , a one-step human motion prediction framework built upon consistency models. Instead of relying on multi-step denoising as in diffusion-based methods, HumanCM performs efficient single-step generation by learning a self-consistent mapping between noisy and clean motion states in a latent space. By operating in this compact representation, HumanCM captures long-range temporal dependencies and preserves motion coherence. Experiments on Human3.6M and HumanEva-I demonstrate that HumanCM achieves comparable or superior accuracy to state-of-the-art diffusion models while reducing inference steps by up to two orders of magnitude. I Introduction Human motion prediction (HMP) is a fundamental task in computer vision and robotics, aiming to forecast future 3D human poses from observed motion sequences. It serves as a core component in applications such as human–robot interaction [ 1 , 2 , 3 , 4 ] , autonomous navigation [ 5 , 6 , 7 , 8 ] , and immersive virtual environments [ 9 , 10 ] . The key challenge lies in accurately modeling the spatial correlations among human joints and the temporal dynamics across frames, while ensuring both high fidelity and real-time responsiveness. Recent advances in deep generative modeling have greatly enhanced the realism and diversity of motion forecasting. In particular, diffusion-based approaches [ 11 , 12 , 13 ] have shown remarkable success in generating natural and continuous motion trajectories by progressively denoising noisy latent representations. However, their iterative inference—often involving tens or even hundreds of denoising steps—poses a severe computational bottleneck, limiting their applicability in latency-sensitive scenarios such as interactive agents and AR/VR systems. To overcome this limitation, we propose HumanCM , a one-step human motion prediction framework built upon the recently introduced Consistency Model (CM) [ 14 ] . Unlike diffusion models that rely on multi-step refinement, consistency models learn a self-consistent mapping between noisy and clean motion states, enabling high-quality generation within a single forward pass. We extend this paradigm to the spatiotemporal domain by integrating temporal embeddings with a Transformer-based architecture, which effectively captures long-range dependencies across both time and body joints. This design allows HumanCM to preserve motion coherence and structural integrity without iterative sampling. Fig. 1: Comparison of generation time under identical hardware and batch size. HumanCM achieves over two orders of magnitude faster inference compared with diffusion-based models such as HumanMAC and TransFusion. Furthermore, we enhance consistency learning with a reconstruction-guided objective that stabilizes training and enforces semantic fidelity. Our framework distills diffusion dynamics into a lightweight one-step generator, maintaining competitive accuracy while significantly reducing inference cost. Comprehensive experiments on Human3.6M and HumanEva-I demonstrate that HumanCM achieves state-of-the-art or comparable performance with up to two orders of magnitude faster inference, paving the way for real-time human motion prediction. As illustrated in Figure 1 , HumanCM achieves significant acceleration, requiring only a single inference step compared with tens or hundreds of steps in diffusion-based models, resulting in dramatically reduced generation time under identical hardware conditions. Our main contributions are summarized as follows: • We propose HumanCM , the first consistency-based generative framework for 3D human motion prediction, capable of one-step generation. • We introduce a reconstruction-guided objective that enhances stability and motion fidelity during consistency training. • Extensive experiments demonstrate that HumanCM achieves competitive accuracy with dramatically improved efficiency, enabling real-time motion forecasting. II Related Work II-A Human Motion Prediction Early works on Human Motion Prediction (HMP) can be broadly divided into deterministic and stochastic paradigms. Deterministic approaches [ 15 , 16 , 17 , 18 ] typically adopt sequence-to-sequence frameworks such as RNNs and CNNs to model temporal evolution, but often suffer from error accumulation and motion discontinuities over long horizons. To better capture spatial dependencies among human joints, Graph Convolutional Networks (GCNs) [ 19 , 20 , 21 ] have been introduced and achieved strong performance. To model the inherent uncertainty of human motion, stochastic frameworks based on VAEs [ 22 , 23 ] and GANs [ 24 , 25 ] were developed to generate diverse motion trajectories. More recently, diffusion-based generative models [ 11 , 12 , 13 ] have achieved state-of-the-art performance by formulating motion prediction as a denoising diffusion process. For instance, MotionDiff [ 13 ] interprets motion dynamics as particle diffusion, while HumanMAC [ 12 ] introduces a masked completion mechanism for end-to-end prediction. Despite their success, diffusion methods remain computationally expensive due to iterative sampling, motivating the development of faster, more efficient generative alternatives. II-B Diffusion and Consistency Models Diffusion probabilistic models [ 26 , 27 ] have shown exceptional generative quality across image, video, and motion domains but suffer from slow inference. Subsequent improvements, such as DDIM [ 28 ] , DPM-Solver [ 29 ] , and progressive distillation [ 30 ] , reduce sampling steps yet still require multiple iterations. The recently proposed Consistency Model (CM) [ 14 ] offers a new paradigm for fast generative modeling by enforcing prediction consistency across different noise levels. Variants including Consistency Distillation (CD), Latent Consistency Models (LCM) [ 31 ] , and SCM [ 32 ] extend this concept to latent or continuous-time domains, achieving single-step generation in visual tasks. However, their application to spatiotemporal data such as 3D motion remains largely unexplored. Our work bridges this gap by adapting the CM framework to the motion domain, introducing spatiotemporal consistency learning that effectively captures both structural and dynamic dependencies while enabling real-time motion generation. III Methodology III-A Problem Definition We represent an observed human motion sequence consisting of H consecutive frames as \mathbf{x}^{(1:H)}=\big[\mathbf{x}^{(1)},\mathbf{x}^{(2)},\ldots,\mathbf{x}^{(H)}\big]\in\mathbb{R}^{H\times 3J} , where each \mathbf{x}^{(h)}\in\mathbb{R}^{3J} denotes the 3D joint coordinates of J skeletal joints at frame h . Given such an observation sequence \mathbf{x}^{(1:H)} , the objective of the stochastic human motion prediction (SHMP) task is to infer a set of plausible future motions composed of F frames, denoted as \mathbf{x}^{(H+1:H+F)}=\big[\mathbf{x}^{(H+1)},\mathbf{x}^{(H+2)},\ldots,\mathbf{x}^{(H+F)}\big]\in\mathbb{R}^{F\times 3J} . Unlike deterministic forecasting, which yields a single motion trajectory, SHMP aims to model the inherent uncertainty and multimodality of human motion, producing diverse yet physically coherent future sequences conditioned on the observed motion context. III-B Discrete Cosine Transform To effectively capture the temporal evolution of human motion, we adopt the Discrete Cosine Transform (DCT) as a compact frequency-domain representation of sequential data. Unlike the raw time-domain signals, the DCT encodes motion trajectories through a set of frequency components, allowing the model to represent both rapid transitions and long-term periodic structures in a unified manner. This frequency-based representation has been shown to produce smoother, more consistent motion predictions and to facilitate efficient learning of temporal dependencies [ 19 , 12 , 33 ] . Formally, let \mathbf{x}\in\mathbb{R}^{(H+F)\times 3J} denote a motion sequence composed of (H+F) frames, where each frame contains the 3D joint coordinates of J skeletal joints. The sequence is projected into the frequency domain by performing a DCT transformation: \mathbf{y}=\mathrm{DCT}(\mathbf{x})=D\mathbf{x}, (1) where D\in\mathbb{R}^{(H+F)\times(H+F)} denotes the predefined orthogonal DCT basis, and \mathbf{y}\in\mathbb{R}^{(H+F)\times 3J} represents the corresponding spectral coefficients. Since the DCT is an orthogonal linear transform, the original temporal sequence can be reconstructed exactly by applying its inverse operation: \mathbf{x}=\mathrm{iDCT}(\mathbf{y})=D^{\top}\mathbf{y}. (2) In practice, human motion sequences are generally smooth, meaning that most of their spectral energy resides in the low-frequency bands.

Read the complete text