The Last Mile to Production Readiness: Physics-Based Motion Refinement for Video-Based Capture Conference: SIGGRAPH Asia 2025 Technical Communications; December 15–18, 2025; Hong Kong, Hong Kong SIGGRAPH Asia 2025 Technical Communications (SA Technical Communications ’25), December 15–18, 2025, Hong

Tianxin Tao, Han Liu, Hung Yu Ling · 2026

Read The Last Mile to Production Readiness: Physics-Based Motion Refinement for Video-Based Capture Conference: SIGGRAPH Asia 2025 Technical Communications; December 15–18, 2025; Hong Kong, Hong Kong SIGGRAPH Asia 2025 Technical Communications (SA Technical Communications ’25), December 15–18, 2025, Hong by Tianxin Tao, Han Liu, Hung Yu Ling (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-19036.txt.

Introduction

Tianxin Tao, Han Liu, and Hung Yu Ling polish machine captured motion until studios can use it. Motion data feeds games, film, virtual worlds, and robots. Camera based capture now looks good at a glance. But the last mile to real use is full of flaws that break the sense of physical truth.

Their fix is based on physics: it refines raw captured motion so feet, weight, and contact behave as real bodies do. The work was shown as a technical talk at SIGGRAPH Asia. Closing that last mile matters because studios judge tools by shipped shots, not by demos.

Catalog record

CREATORTianxin Tao, Han Liu, Hung Yu Ling
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE17 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-19036

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

The Last Mile to Production Readiness: Physics-Based Motion Refinement for Video-Based Capture Conference: SIGGRAPH Asia 2025 Technical Communications; December 15–18, 2025; Hong Kong, Hong Kong SIGGRAPH Asia 2025 Technical Communications (SA Technical Communications ’25), December 15–18, 2025, Hong Kong, Hong Kong DOI: 10.1145/3757376.3771379 ISBN: 979-8-4007-2136-6/2025/12 CCS: Computing methodologies Motion processing Tianxin Tao, Han Liu, Hung Yu Ling Abstract . High-quality motion data underpins games, film, XR, and robotics. Vision-based motion capture tools have made significant progress, offering accessible and visually convincing results, yet often fall short in the final stretch—the last mile—when it comes to physical realism and production readiness, due to various artifacts introduced during capture. In this paper, we summarize key issues through case studies and feedback from professional animators to set a stepping stone for future research in motion cleanup. We then present a physics-based motion refinement framework to bridge the gap, with the goal of reducing labor-intensive manual clean-up and enhancing visual quality and physical realism. Our framework supports both single- and multi-character sequences and can be integrated into animator workflows for further refinement, such as stylizing motions via keyframe editing. Figure 1 . We present a framework for generating physically plausible motions from imperfect vision-based capture data. Two motion clips are presented: 1. torso penetration during header; 2. arm-torso penetration from retargeting. Yellow&pink characters: raw motions. Teal&blue characters: cleaned-up results. † † cc-license: by-nc 1. Introduction Motion capture (Mo-cap) is central to character animation. It has evolved from traditional marker-based and inertia sensor-based systems to recent vision-based techniques, greatly reducing setup effort and enabling scalable motion data collection. Vision-based capture, both in academia ( 16 ; 7 ; 13 ) and in commercial products ( 4 ; 14 ; 10 ; 2 ) , now delivers visually appealing results in diverse environments. However, raw vision-captured data still requires manual cleanup for production quality due to subtle but critical artifacts of physical implausibility. In this paper, we first aim to bridge this gap by systematically identifying and categorizing motion artifacts, such as floating, mesh interpenetration, phantom contact, and foot sliding, through feedback and insights gathered from professional animators, noting their persistence even in high-quality commercial pipelines, limiting large-scale deployment of captured motions. To close this "last-mile" gap, we build a physics-based motion refinement framework using deep reinforcement learning (DRL) that operates on a per-sequence basis, and corrects flawed motion while preserving the integrity and fidelity of the original content. It supports both single- and multi-character scenarios, and introduces key innovations such as artifact-aware evaluation, adaptive termination, and flexible reward shaping. 2. Related Work Motion cleanup follows two main paths: physics-based and data-driven. Data-driven methods ( 5 ; 1 ) require large, high-quality datasets, which are not always available, so we focus on physics-based approaches. Early work improved quality by simulating marker–character forces ( 22 ) , and addressed artifacts like ground penetration via sampling-based control ( 8 ) . Subsequent research extended these methods to broader scenarios ( 12 ; 18 ) . Recent DRL-based imitation refines motions from 3D pose estimators ( 20 ; 19 ) , motions involving multi-character interactions ( 6 ) , and retargeted motions with contact-graphs ( 21 ) . 9 proposed space-time bounds as an alternative to tracking rewards. Figure 2 . A sharp stop motion showing over-smoothed hip (root) trajectory in the raw input (pink), which lacks a sense of weight. The refined motion (teal) from our method adds realistic root movement. Figure 3 . Over-smoothed hip trajectory during locomotion. The plot compares hip height from raw motion (pink) and our physical reconstruction (teal). 3. Types of Motion Artifacts A key motivation for leveraging physics in motion refinement is the observation that many artifacts trace to violations of physical laws. Physical realism is a necessary condition for high-quality motion—any motion that breaks physics principles, such as gravity, friction, or collision constraints, is inherently flawed. We highlight common physics artifacts that impact the quality of captured data. Floating and Weightedness. A typical issue in captured data is the lack of perceived weight. Characters often appear to glide or float, especially during dynamic actions like running or abrupt stops (see Figure 2 ), despite feet appearing correctly planted. This is usually caused by an over-smoothed root trajectory, which flattens the vertical movement and reduces impact forces, as shown in Figure 3 . An over-smooth root trajectory can be easily recognized by expert animators as low-quality motion. Physics-based simulators help resolve this by modeling gravity and inertial forces, allowing characters to exhibit natural and grounded interactions. Penetration. Self-penetration and inter-character penetrations are common in both single and multi-character motions. In Figure 4 , we show that these artifacts occur, such as arms that intersect the torso or legs that collide, because pose estimators fail to account for the volumes of physical collisions. Physics simulators inherently enforce collision constraints at each step, making them a natural tool to address these issues. Figure 4 . Penetration depth in the motion clip where two characters run into each other. The peaks in the penetration depth are highlighted with blue circles. Phantom Contact. When characters interact with objects, exact contact timing is always difficult to capture, which results in phantom contact. This usually stems from incomplete object modeling. For simpler objects, the issue can be addressed by incorporating object motion tracking into the physics-based simulation to enhance contact realism. However, fully modeling all objects remains impractical. As an alternative, we adopt keyframing, a widely used technique familiar to animators, to guide motion cleanup. Animators manually add contact keyframes, and our system automatically refines the motion, reducing artifacts while maintaining realism. Foot Sliding. Foot sliding arises from errors in predicting global trajectory and joint positions, especially in the feet, which are sensitive end effectors. In vision-based capture, this leads to visible drifting during ground contact, as illustrated in Figure 5 . Physics-based simulators mitigate this by modeling ground friction to keep feet properly anchored. Figure 5 . Foot sliding example. The pink character shows sliding artifacts, while the teal version from our method maintains proper foot contact. Blue circle marks a planted right foot, which should remain stationary. 4. System Overview Our framework addresses the four aforementioned motion artifacts. Floating and foot sliding are naturally mitigated through physics-based motion tracking, while penetration requires additional handling due to the complexity of resolving geometry collisions without compromising motion fidelity. Phantom contact is addressed case by case, depending on the nature of object interaction. Our framework begins with estimating the severity of artifacts in Mo-cap. From our observations, we have found that measuring penetration serves as an effective indicator of artifact severity. Specifically, we assess self-penetrations to address common issues such as limb clipping, which typically occurs in single characters. For complex interactions involving multiple characters, we measure penetrations between characters to determine the extent of correction required. We then enhance the standard physics-based motion imitation setup, similar to DeepMimic ( 11 ) , with key modifications to early termination, reward design, and action space. 4.1. Penetration Estimation Penetration depth intuitively measures the extent of the intersection of objects. Larger depths correspond to more noticeable and unrealistic mesh clipping issues that require correction. Using the articulated humanoid model, we first

Read the complete text