Moment-Reenacting: Inverse Motion Degradation with Cross-shutter Guidance
Xiang Ji, Guixu Lin, Zhengwei Yin, Jiancheng Zhao, Yinqiang Zheng · 2026
Read Moment-Reenacting: Inverse Motion Degradation with Cross-shutter Guidance by Xiang Ji, Guixu Lin, Zhengwei Yin, Jiancheng Zhao, Yinqiang Zheng (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-22423.txt.
Introduction
Ji and colleagues propose a unified framework that inverts motion degradation and re-enacts moments. Blur in global shutter images and rolling shutter distortion were long treated as separate problems. Their dual-shutter setup captures synchronised blur and rolling shutter pairs, resolving temporal and spatial ambiguities in both modes. A stereo variant with a narrow baseline offers flexible performance-cost trade-offs. A triaxial system collects real aligned pairs plus high-speed frames for training. Tests validate the approach for realistic high-speed video reconstruction under complex motion.
Catalog record
| CREATOR | Xiang Ji, Guixu Lin, Zhengwei Yin, Jiancheng Zhao, Yinqiang Zheng |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 94922 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.22423
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Moment-Reenacting: Inverse Motion Degradation with Cross-shutter Guidance Xiang Ji, Guixu Lin, Zhengwei Yin, Jiancheng Zhao, Yinqiang Zheng Abstract Motion degradation, manifested as blur in global shutter (GS) images or rolling shutter (RS) distortion in RS counterparts, remains a fundamental challenge in computational imaging, especially under fast motion or low-light conditions. While prior works have treated blur decomposition and RS temporal super-resolution as separate tasks, this separation fails to exploit their intrinsic complementarity. In this paper, we propose a unified framework to invert motion degradation and reenact imaging moment by jointly leveraging the complementary characteristics of GS blur and RS distortion. To this end, we introduce a novel dual-shutter setup that captures synchronized blur-RS image pairs and demonstrate that this combination effectively resolves temporal and spatial ambiguities inherent in both modalities. For allowing flexible performance-cost trade-offs, we further extend this dual-shutter setup to a stereo Blur-RS configuration with a narrow baseline. In addition, we construct a triaxial imaging system to collect a real-world dataset with aligned GS-RS pairs and ground-truth high-speed frames, enabling robust training and evaluation beyond synthetic data. Our proposed network explicitly disentangles motion into context-aware and temporally-sensitive representations via a dual-stream motion interpretation module, followed by a self-prompted frame reconstruction stage. Extensive experiments validate the superiority and generalizability of our approach, establishing a new paradigm for realistic high-speed video reconstruction under complex motion degradations. Codes and more resources are available at https://jixiang2016.github.io/dualBR_site/ . \justify I Introduction Photographic capture relies on sufficient exposure time to accumulate photons. When fast motions get involved, existing imaging system will inevitably introduce undesired degradations, motion blur or rolling shutter effect, exhibiting significant relevance to the exposure modes exploited: Global Shutter (GS) and Rolling Shutter (RS) respectively (Figure 1 ). These motion degradations severely compromise perceptual quality and content interpretability. Hence, extensive research has been devoted to reverse these degrading processes and produce sharper details. Fig. 1 : Imaging moment reenacting. If latent sharp frames within an exposure captured by GS or RS modes under fast motion, it will cause distinct degradations: blur and RS effects. Current research reverses the two degrading processes independently. We propose to simultaneously handle the two issues by exploiting the complementarity of RS and GS views, and ultimately reenact the imaging moment regardless of motion degradations. While conventional approaches formulate reconstruction as single-frame recovery through image-to-image translation ( i.e . , deblurring [ 47 , 63 , 66 , 17 , 74 , 51 , 80 , 53 , 26 , 67 ] or RS correction [ 55 , 50 , 15 , 19 , 64 , 82 , 83 , 71 , 54 , 13 ] ). Recent advances have shifted focus toward more ambitious tasks, retrieving a sharp image sequence instead, dubbed as blur decomposition [ 31 , 49 , 52 , 76 ] and RS temporal super-resolution [ 11 , 77 , 58 , 10 ] . Despite significant progress, both tasks have evolved in a separate manner, with no rigorous studies exploring the potential of their correlations for the inversion process. Moreover, they are basically grounded on synthetic data [ 47 , 61 , 40 , 77 ] , leaving the real-world performance uncertain. Such synthesis processes can easily lead to unnatural artifacts [ 57 , 79 , 28 ] . Thus, models trained on synthetic datasets are likely to demonstrate inferior generalization and may not perform effectively in practice. Most importantly, the intrinsic ambiguities in the degradation processes make both problems even more difficult. Under the context of blur decomposition, averaging effects of motion blur have severely destroyed the temporal ordering of latent frames [ 31 ] . Moreover, the presence of motion ambiguity within each dynamic object intensifies the problem, generating numerous plausible yet physically unrealistic solutions. This ambiguity is illustrated in Figure 2 a-b with two dynamic objects. Successfully resolving the loss of temporal order in blur decomposition remains an ongoing challenge. Existing approaches can be broadly classified into two types: (i) methods that employ ordering-invariant loss [ 31 ] and (ii) techniques that approximate latent temporal order within exposure by leveraging the motion of consecutive blurred frames [ 78 , 76 ] . The first category often leads to sub-optimal solutions due to the limited supervision provided by the loss function, whereas the second struggles with significant degradation under conditions of prolonged exposure or rapid motion. Additionally, estimating motion within blurry frames is inherently complex and computationally expensive. RS images have recently been acknowledged for encoding hidden motion due to their row-by-row exposure mode [ 11 , 10 ] , which provides a foundation for mitigating RS effects. However, reconstructing a sequence from a single RS image remains unresolved due to the absence of complete global content. Conversely, blurred images preserve globally integrated scene information but lack temporal order. While human visual perception is less sensitive to RS effects compared to blur, the severe ill-posedness of RS temporal super-resolution makes it not only nontrivial but even more difficult than blur decomposition [ 27 ] . One potential reason is the ambiguity in the initial state, as illustrated in Figure 3 a-b. For instance, when an RS image captures an upright figure, the unknown initial state leads to three possible motion patterns within the exposure period. Fig. 2 : Motion ambiguity of blur observation. In this toy example, we show two objects: a soccer and a player, both moving horizontally. (a) shows four possible motion states (both moving right, both moving left, one moving left while the other moves right.) during the exposure time. (b) presents corresponding motion blurred observations. They are all identical due to averaging effects, which brings about motion ambiguity to blur decomposition and further causes issues of instability and low performance [ 78 ] . (c) In our dual Blur-RS setting, rolling shutter (RS) view implicitly encodes temporal ordering of latent frames. Therefore, considering the complementarity of Blur and RS observations, we propose dual Blur-RS setting to reenact the imaging moment by jointly handling the aforementioned ambiguities of blur decomposition and RS temporal super-resolution. As shown in Figure 2 c, the RS view not only provides local details but also implicitly captures temporal order of latent frames. Meanwhile, the GS view could be exploited to disambiguate the initial-state from RS counterpart (Figure 3 c). On the other hand, dual camera system has been widely exploited in RS correction (RS-RS, RS-Event) [ 1 , 77 , 81 , 39 ] , deblurring (GS-Event) [ 62 , 70 ] , and even vibration sensing (GS-RS) [ 59 ] , which offers a promising pathway to address synthetic data challenges. Inspired by the hardware design of [ 57 , 79 ] , we devise our triaxial imaging system to capture strictly aligned high-speed sharp videos and low-speed Blur-RS pair videos. Facilitated by the imaging prototype, we contribute a real world dataset (realBR) capable of benchmarking multiple correlated tasks ( e.g . RS correction, deblurring and video frame interpolation). Beyond the collected dataset, we further introduce a novel model to recover a sharp video sequence from cross-shutter views, specifically blur and RS observations, through two stages: motion interpretation and frame reconstruction. The motion interpretation module first decomposes the bilateral motion fields into