Again-Pose: Anchor-Guided Adaptive Inter-Frame Motion Cues Propagating for High-quality Human Pose Reconstruction
Shuaikang Zhu, Yiding Sun, Yang Yang · 2026
Read Again-Pose: Anchor-Guided Adaptive Inter-Frame Motion Cues Propagating for High-quality Human Pose Reconstruction by Shuaikang Zhu, Yiding Sun, Yang Yang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-29230.txt.
Introduction
Zhu, Sun and Yang present Again-Pose, a method for reconstructing three-dimensional human poses from ordinary video when motion gets extreme. Severe motion blur and occlusion degrade frames so badly that their features collapse into noise. Methods relying on implicit temporal attention, which aggregate information across frames, then cannot tell valid signal from noise, and reconstruction fails.
Again-Pose reframes pose estimation in degraded frames as motion-guided recovery. It explicitly identifies high-quality anchor frames, judged by feature saliency, and propagates reliable kinematic cues from them to inpaint the poses of degraded frames between them. A dual-path motion-aware module captures the fine-grained inter-frame dynamics. A difference-weighted fusion module then propagates those cues adaptively, suppressing drift. On standard benchmarks and the FineDiving dataset, it beat state-of-the-art approaches in robustness and stability.
Catalog record
| CREATOR | Shuaikang Zhu, Yiding Sun, Yang Yang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 44 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.29230
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Again-Pose: Anchor-Guided Adaptive Inter-Frame Motion Cues Propagating for High-quality Human Pose Reconstruction Shuaikang Zhu, Yiding Sun, Yang Yang Abstract Reconstructing continuous 3D human poses from unconstrained videos is challenging, especially in extreme motion scenarios involving severe motion blur and occlusion. Current state-of-the-art methods typically rely on implicit temporal attention to aggregate features across frames. However, under severe visual degradation, input features often suffer from collapse, rendering them indistinguishable from noise. In such cases, implicit aggregation fails to distinguish valid signals, leading to catastrophic reconstruction errors. To address this robustness gap, we propose a simple yet effective framework called A nchor- g uided a daptive in ter-frame motion cues propagating ( Again-Pose ), reformulating pose estimation in degraded frames as a motion-guided recovery task. Instead of blindly smoothing features, we explicitly identify high-quality Anchor Frames based on feature saliency and propagate reliable kinematic cues to "inpaint" the poses of degraded intermediate frames. Specifically, a Dual-path Motion-aware Module captures fine-grained inter-frame dynamics, while a Difference-weighted Fusion Module adaptively propagates these cues to suppress drift. Extensive experiments on standard benchmarks (Human3.6M, 3DPW, PoseTrack) and the challenging FineDiving dataset demonstrate that Again-Pose significantly outperforms state-of-the-art methods in robustness and stability, effectively recovering plausible poses where other methods fail. 1 Introduction Figure 1 : Solving Feature Collapse via Anchor Propagation. In high-speed scenarios ( e.g . , diving), severe motion blur renders features in certain frames unreliable ( e.g . , the first two frames), leading to feature collapse. Our key insight is to treat pose estimation as a recovery task: we explicitly leverage high-quality Anchor Frames ( e.g . , the clear third frame) as reliable references. The clear body contour ( blue dashed line ) from the anchor is propagated backwards via inter-frame motion dynamics to accurately infer the underlying shapes ( red dashed line ) in the preceding blurred target frames, effectively recovering visual evidence lost to blur. Reconstructing continuous 3D human poses from unconstrained video sequences is a fundamental problem in computer vision [ 32 , 37 , 9 ] , holding immense value for applications such as augmented/virtual reality [ 35 ] , human–robot interaction [ 6 , 19 , 28 , 29 ] , and action quality assessment [ 46 , 42 ] . Thanks to the development of parametric human body models ( e.g . , SMPL), significant progress has been made in pose estimation accuracy [ 40 , 7 , 10 ] . Some methods achieve a Mean Per Joint Position Error (MPJPE) close to 50 mm on standard benchmarks. However, in real-world scenarios—especially extreme motion settings such as sports analytics [ 5 , 20 ] and diving analysis [ 46 ] —the primary challenge shifts from per-frame accuracy to robustness against degradation. In these scenarios, video frames are frequently plagued by severe motion blur , abrupt pose changes , and occlusions , causing standard reconstruction methods to fail catastrophically. Current human pose sequence reconstruction methods can be broadly divided into two categories: single-frame regression and temporal modeling. Single-frame-based methods ( e.g . , HMR 2.0 [ 7 ] , HSMR [ 40 ] ) leverage large-scale ViT backbones to extract global features, achieving leading accuracy on benchmarks like PoseTrack [ 1 ] . However, due to the lack of temporal constraints, they suffer from jitter and inconsistency when handling ambiguous frames. To address this, video-based methods introduce temporal modeling to enhance coherence. Approaches like VIBE [ 13 ] employ recurrent architectures (GRU), while recent state-of-the-art methods like GLoT [ 30 ] , and more recent works [ 38 , 15 ] , utilize Transformers to capture long-range dependencies. These methods implicitly aggregate features across frames via attention mechanisms, significantly improving performance on standard datasets. However, a critical limitation remains overlooked: these temporal methods operate on the assumption that the input visual features are relatively reliable. They rely on implicit attention mechanisms to weigh temporal information. In extreme scenarios ( e.g . , high-speed diving or gymnastics), rapid motion causes severe feature collapse in blurry frames, where visual cues become indistinguishable. Under such conditions, implicit attention mechanisms struggle to distinguish between valid signals and noise, often propagating errors from low-quality frames throughout the sequence. As a result, even sophisticated Transformer-based models risk generating collapsed or chaotic meshes when the majority of a local window is degraded. To tackle this robustness gap , we argue that temporal information should not just be aggregated, but must be explicitly filtered and propagated . Instead of trusting all frames, we should identify "Anchors"—frames with high visual fidelity—and use them to recover the degraded frames. As illustrated in Fig. 1 , although a single-frame might be severely blurred, the human body contour can be inferred from the inter-frame motion dynamics derived from adjacent high-quality anchors. This effectively turns the pose estimation problem in extreme scenarios into a motion-guided inpainting task. In this paper, we propose Again-Pose, an anchor-guided video pose estimation framework designed for robustness in extreme motion scenarios. The core idea is to decouple the sequence into reliable Anchor Frames and unreliable intermediate frames, balancing frame-wise accuracy with temporal continuity. Specifically, Again-Pose operates through three key components: First, we design an Intelligent Anchor-frame Selector . Unlike heuristic keyframe selection, this mechanism computes a quality score combining visual saliency (sharpness) with a learnable confidence metric, explicitly filtering out collapsed features to establish a reliable foundation. Second, we construct a Dual-path Motion-aware Module . It models inter-frame dynamics from two perspectives: parametric differences (pose changes) and visual dynamics (appearance flow), ensuring that the propagation respects the kinematic trends of the human body. Finally, a Difference-weighted Fusion Module adaptively fuses predictions propagated from adjacent anchors based on temporal distance, suppressing drift and ensuring smooth transitions even across extended blurry intervals. Extensive experiments on multiple benchmarks demonstrate that Again-Pose achieves state-of-the-art performance. Crucially, in the challenging FineDiving dataset characterized by high-speed motion, our method exhibits superior robustness compared to Transformer-based baselines, effectively recovering plausible poses where other methods fail. For instance, on the 3DPW dataset, our method improves the MPJPE metric by nearly 10 mm compared with the previous best-performing approach. The main contributions of this work are summarized as follows: (1) We identify the vulnerability of implicit temporal aggregation in extreme motion scenarios and propose Again-Pose, an explicit anchor-guided framework. To form a reliable foundation, we introduce an Intelligent Anchor-frame Selector that explicitly evaluates feature saliency to identify high-quality anchors and filter out degraded features. (2) We design a Dual-path Motion-aware Module coupled with a Difference-weighted Fusion strategy. It captures fine-grained inter-frame dynamics to explicitly propagate reliable kinematic cues from the identified anchors, effectively "inpainting" the poses of degraded intermediate frames. (3) Extensive experiments demonstrate that Again-Pose significantly outperforms state-of-the-art methods under severe motion blur and occlusion, providing superior temporal stability for downstream tasks like action quality assessment. 2 Related Work Single-frame-based Human Reconstruction. The task of single-frame human pose reconstruction primarily focuses on estimating SMPL model parameters directly from individual images. Early approaches like HMR [ 11 ] pioneered the use of CNNs with adversarial priors to regress SMPL parameters. Subsequent works have improved upon this by incorporating iterative optimization (SPIN [ 16 ] ), mesh alignment feedback (PyMAF [ 43 , 44