PMG: Progressive Motion Generation via Sparse Anchor Postures Curriculum Learning CCS: Computer systems organization Embedded systems CCS: Computer systems organization Redundancy CCS: Computer systems organization Robotics CCS: Networks Network reliability

Yingjie Xi, Jian Jun Zhang, Xiaosong Yang · 2025

Read PMG: Progressive Motion Generation via Sparse Anchor Postures Curriculum Learning CCS: Computer systems organization Embedded systems CCS: Computer systems organization Redundancy CCS: Computer systems organization Robotics CCS: Networks Network reliability by Yingjie Xi, Jian Jun Zhang, Xiaosong Yang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-16722.txt.

Introduction

Xi, Zhang, and Yang present ProMoGen in twenty twenty-five, a system that makes human motion follow both a path and key poses. Animators need motion that matches intent, but text cues are vague and path cues are crude. Their design splits the two jobs. A path sets where the figure goes, while sparse anchor poses set how it moves.

A staged learning plan grows the anchor count slowly, which steadies training. One model handles both dual and single cue modes. Tests beat past methods across control setups. Motions came out vivid and varied while obeying the set path. The split gives artists fine control without losing the route.

Catalog record

CREATORYingjie Xi, Jian Jun Zhang, Xiaosong Yang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE39 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-16722

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

PMG: Progressive Motion Generation via Sparse Anchor Postures Curriculum Learning CCS: Computer systems organization Embedded systems CCS: Computer systems organization Redundancy CCS: Computer systems organization Robotics CCS: Networks Network reliability Yingjie Xi, Jian Jun Zhang, Xiaosong Yang Abstract . In computer animation, game design, and human-computer interaction, synthesizing human motion that aligns with user intent remains a significant challenge. Existing methods have notable limitations: textual approaches offer high-level semantic guidance but struggle to describe complex actions accurately; trajectory-based techniques provide intuitive global motion direction yet often fall short in generating precise or customized character movements; and anchor poses-guided methods are typically confined to synthesize only simple motion patterns. To generate more controllable and precise human motions, we propose ProMoGen (Progressive Motion Generation) , a novel framework that integrates trajectory guidance with sparse anchor motion control. Global trajectories ensure consistency in spatial direction and displacement, while sparse anchor motions only deliver precise action guidance without displacement. This decoupling enables independent refinement of both aspects, resulting in a more controllable, high-fidelity, and sophisticated motion synthesis. ProMoGen supports both dual and single control paradigms within a unified training process. Moreover, we recognize that direct learning from sparse motions is inherently unstable, we introduce SAP-CL (Sparse Anchor Posture Curriculum Learning) , a curriculum learning strategy that progressively adjusts the number of anchors used for guidance, thereby enabling more precise and stable convergence. Extensive experiments demonstrate that ProMoGen excels in synthesizing vivid and diverse motions guided by predefined trajectory and arbitrary anchor frames. Our approach seamlessly integrates personalized motion with structured guidance, significantly outperforming state-of-the-art methods across multiple control scenarios. https://github.com/2022yingjie/ProMoGen.git Figure 1. The left panel illustrates the synthesized results of the ProMoGen framework, under the control of both predefined trajectory and arbitrary anchor motions. The right panel delineates the inference process of our framework, wherein specific poses extracted from various images, as anchor motions, are combined with a predefined trajectory to synthesize realistic and customized human motion. Figure 2. The SAP-CL training strategy(left panel) and the structure of ProMoGen method(right panel). 1. Introduction Human motion synthesis plays a crucial role in the field of cinematic character animation, game design, human-robot interaction, and virtual avatars. In these domains, there is a growing need for methods that can produce high-fidelity, expressive motion that is both semantically and environmentally aligned with specific thematic styles, while maintaining flexibility to accommodate diverse user requirements and interaction scenarios. Therefore, achieving precise control over motion trajectories and character postures is necessary to keep the generated motion realistic and desired. Traditional human motion synthesis methods primarily include text-to-motion ( Petrovich et al. 2022 ; Wang 2023 ; Zhang et al. 2023b ; Lu et al. 2023 ; Ma et al. 2024a ; Dabral et al. 2023 ; Xie et al. 2024 ; Tevet et al. 2022b ; Chen et al. 2024b ; Huang et al. 2024 ; Chen et al. 2024a ) synthesis, trajectory-to-motion synthesis ( Kania et al. 2021 ; Wan et al. 2024 ; Guo et al. 2025 ) , and audio-based synthesis ( Zhou et al. 2025 ; Zhang et al. 2025 ; Chhatre et al. 2024 ; Wan et al. 2024 ) , which have enabled coarse alignment between these conditions inputs and the generated motions. While these approaches are capable of generating smooth and simple human motion sequences, they still face significant challenges in producing highly customized or personalized complex motions that meet user-specific requirements ( Gang and Wang 2025 ) . For example, the specific posture at the selected position on the trajectory is the key to personalized motion expression, and this posture is often difficult to accurately describe using conventional text and other conditions. This limitation arises not only from the distribution of existing datasets, which tend to focus on simple motion patterns, but also from more fundamental issues, that the semantic ambiguity inherent in text descriptions and the geometric sparsity of trajectory signals, therefore further loss the interaction ability with the practical environment ( Cong et al. 2024 ; Ma et al. 2024a ; Qu et al. 2024 ) . These factors often fail to provide sufficient guidance for specifying fine-grained motion details, hindering the generation of more complex and personalized motion sequences. Other works ( Kim et al. 2022 ; Wang et al. 2025a ) adopts transformer-based end-to-end network to make an interpolation task for motion in-between,but directly end-to-end learning paradigm cannot learn motion distribution well, resulting low-fidelity and single synthesis. The ( Karunratanakul et al. 2023 ) explores the interplay between text and trajectories, as well as text and anchor posetures positions, but it did not effectively decouple these features nor achieve refined control over human motion generation. To address these limitations, we propose ProMoGen(Progressive Motion Generation), a diffusion-based framework ( Ho et al. 2020 ; Song et al. 2020 ; Ho et al. 2022 ; Yang et al. 2023 ) . By synergizing trajectory control with sparse anchor motions guidance, our method facilitates hierarchically controllable, customized, and precise motion synthesis. The key insight driving our approach is the decomposition of motion generation into two complementary subspaces: a global trajectory that governs macroscopic movement patterns, and local poses that represent stylistic content, towards to more diverse and free motion combination with control of arbitrary trajectory or motions. Specifically, to ensure robust understanding of global trajectories, we design the global Trajectory Feature Encoder (TFE), a transformer-based ( Peebles and Xie 2023 ; Vaswani et al. 2017 ) architecture that projects user-defined trajectories into a latent space, capturing both temporal displacement and directional coherence. In parallel, to dynamically guide motion synthesis under varying key postures, we develop the anchor Filtering Module, which samples sparse anchor poses based on predefined temporal density and interval elasticity to get specific anchor pose controls. Then an Anchor Motion Encoder (AME) is introduced to learn features from the sparse pose conditions. To effectively integrate the outputs of these components, we design a Initial Motion Generator and Refinement Module, the former is responsible to build coarse motion under the control of trajectory only, to roughly align the latent representations of postures and trajectory, and the latter is to ensure smooth and high-fidelity interpolation while maintaining input pose original details. Besides, the diffusion process significantly enhances the synthesis capabilities of ProMoGen, enabling the generation of realistic and precisely controlled motions. In addition, traditional training directly using sparse signals(e.g., less than 5% frame density) often results in unstable gradient propagation due to insufficient supervisory information, hindering effective learning. Moreover, models trained under the specific conditions may not generalize well to varying inference scenarios. To alleviate this challenge, we introduce a novel training strategy, termed Sparse Anchor Posture Curriculum Learning (SAP-CL) ( Bengio et al. 2009 ; Soviany et al. 2021 ; Zhang et al. 2021 ; Zhang et al. 2019 ; Zhao et al. 2021 ; Kim and Lee 2024 ; Muttaqien et al. 2024 ; Manela and Biess 2022 ; Liu et al. 2022 ; Wang et al. 2024b ) . Intuitively, in this work, the tasks with denser anchor postures are simpler, enabling model easily handle the task by providing more informative supervisory signals, then gradually increase the difficulty level to get a better convergence. Following this easy-to-hard paradigm, our

Read the complete text