Video Deblurring by Sharpness Prior Detection and Edge Information Journal: Pattern Recognition

Yang Tian, Fabio Brau, Giulio Rossolini, Giorgio Buttazzo, Hao Meng · 2025

Read Video Deblurring by Sharpness Prior Detection and Edge Information Journal: Pattern Recognition by Yang Tian, Fabio Brau, Giulio Rossolini, Giorgio Buttazzo, Hao Meng (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-12246.txt.

Introduction

Yang Tian and co-authors present a method and a data set for clearing blur from video. Their 2025 paper starts from a simple insight. Most videos hold some sharp frames among the blurred ones, and those sharp frames can guide repair. Older data sets fix how many sharp frames appear, which can bias training. The new data set lets that count vary freely across clips.

Their model finds sharp frames with a light detector, pulls edge details from them, and feeds both into the repair of blurred frames. Tests across several data sets show clear gains over leading methods. Sharpness scores rise by a solid margin on average. The work matters for self-driving cars, face checks, and camera watch systems, where clear video can decide safety and trust.

Catalog record

CREATORYang Tian, Fabio Brau, Giulio Rossolini, Giorgio Buttazzo, Hao Meng
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE57 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-12246

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Video Deblurring by Sharpness Prior Detection and Edge Information Journal: Pattern Recognition Yang Tian, Fabio Brau, Giulio Rossolini, Giorgio Buttazzo, Hao Meng Abstract Video deblurring is essential task for autonomous driving, facial recognition, and security surveillance. Traditional methods directly estimate motion blur kernels, often introducing artifacts and leading to poor results. Recent approaches utilize the detection of sharp frames within video sequences to enhance deblurring. However, existing datasets rely on fixed number of sharp frames, which may be too restrictive for some applications and may introduce a bias during model training. To address these limitations and enhance domain adaptability, this work first introduces GoPro Random Sharp ( GoProRS ), a new dataset where the the frequency of sharp frames within the sequence is customizable, allowing more diverse training and testing scenarios. Furthermore, it presents a novel video deblurring model, called SPEINet , that integrates sharp frame features into blurry frame reconstruction through an attention-based encoder-decoder architecture, a lightweight yet robust sharp frame detection and an edge extraction phase. Extensive experimental results demonstrate that SPEINet outperforms state-of-the-art methods across multiple datasets, achieving an average of +3.2% PSNR improvement over recent techniques. Given such promising results, we believe that both the proposed model and dataset pave the way for future advancements in video deblurring based on the detection of sharp frames. 1 Introduction With the increasing development of technology and social media, video recording using handheld and airborne devices such as smartphones, action cameras and drones is becoming increasingly popular [ 48 ] . However, fast light changes, camera shakes, rapid object movements and depth changes can often produce undesired effects and lead to video blur [ 35 ] . The presence of blur in a video not only affects the visual quality, but can also hinder other downstream visual tasks such as tracking [ 46 ] and video anomaly detection [ 24 ] . While dedicated hardware, such as event cameras, could be beneficial [ 3 ] , it represents a costly and partial solution that is not always applicable to popular devices. For this reason, the development of effective video deblurring algorithms has been actively studied in the last decades [ 11 ] and still represents a hot research topic [ 12 ] . To recover sharp frames from blurred video, conventional approaches [ 11 , 7 , 28 , 33 ] typically use optical flow to estimate a blur kernel and recover the blur sequence by deconvolution, making assumptions about the type of motion blur. However, the dynamic nature of video and the difficulty of estimating the motion blur kernel often leads to artifacts and poor robustness. With the advancement of artificial intelligence, video deblurring methods based on deep learning have achieved remarkable success [ 32 , 42 , 5 , 1 , 12 , 2 ] . To achieve better performance, other works [ 55 , 18 , 27 , 44 ] focused on the spatio-temporal dependence of successive non-uniformly blurred video frames. For example, Wang et al. 2021 proposed the Spatio-Temporal Pyramid Network (SPN), which can dynamically learn different spatio-temporal dependencies, while Zhu et al. 2023 used time-spectrum energy as a global clarity guide to solve the problem of local feature loss due to blur. Furthermore, Lin et al. 2020 and Kim et al. 2022 incorporate the active gray level pixels generated by an event camera to further improve the quality of the results. Recently, some research has observed that not all frames in a blurred video are actually blurred, and that some sharp frames may occasionally occur, [ 26 , 49 , 38 ] . Building on this observation, previous studies have suggested that once these sharp frames are identified, they can be exploited to extract finer and more precise temporal information, enhancing the deblurring process. For example, Pan et al. 2023a proposed a convolutional neural network (CNN) that incorporates a temporal sharpness prior module to utilize the information from sharp frames for recovering blurred frames. Similarly, Xiang et al. 2020 leveraged features from sharp frames to estimate temporal information related to video motion flow, guiding the network to restore blurred images. In addition to the abovementioned techniques, new ad hoc datasets that incorporate portions of sharp frames have gained increasing attention, such as the GoProS dataset [ 38 ] . However, in these datasets, sharp frames are added to the sequences based on a probability that is consistently constrained to 50%, resulting in a fixed ratio of sharp to blurred frames. This constraint makes such datasets unsuitable for videos where the occurrence of sharp and blurry frames varies dynamically, significantly limiting their applicability in real-world scenarios. To overcome these problems, this paper introduces a new dataset, GoProRS , in which sharp frames occur according to a probability defined by the user, so enabling a desired ratios of sharp and blurred frames. This setup helps trained models to generalize across diverse blurring conditions. Then, to evaluate the benefits of the dataset and advance the state-of-the-art in deblurring, this paper proposes a novel video deblurring method called Sharpness Prior Detection and Edge Information Network ( SPEINet ). The SPEINet model incorporates regularized edge emphasis to improve the edge mapping capabilities of blurred frames and includes a lightweight sharp frame detector based on six computationally efficient classical metrics commonly used for autofocus [ 29 ] , avoiding reliance on a slower, dedicated neural network as used in previous works [ 38 ] . Finally, its attention-based encoder-decoder architecture effectively integrates sharp frame information and edge-enhanced features to reconstruct blurred video frames. In particular, the encoder extracts deep features from sharp and blurry frames using attention mechanisms, while the self-transfer and cross-transfer modules transfer key pixel details to assist the decoder in recovering and reconstructing blurred frames. In summary, the paper provides the following main contributions: 1. A new video deblurring dataset ( GoProRS ) is proposed and synthesized, where sharp frames occur with a probability defined by the user, thus enhancing the model’s generalization capabilities. 2. The SPEINet model for video deblurring is proposed, which leverages key pixel information from sharp frames to guide the recovery and reconstruction of adjacent blurry frames. The model incorporates an edge emphasis algorithm and a lightweight sharp frame detector, integrated with a custom designed attention-based encoder-decoder architecture. 3. Extensive experiments have been carried out to evaluate the performance of SPEINet on four datasets, demonstrating the effectiveness of the proposed approach and the benefits of the GoProRS dataset. The achieved results show that SPEINet outperforms the state-of-the-art methods across multiple datasets, providing a clear direction for future research and advancements in video deblurring. The rest of the paper is organized as follows. Section 2 analyzes the state of the art, focusing on the solutions that use sharp frames to improve the results. Section 3 presents the construction details of the GoProRS dataset. Section 4 presents the framework and components of the model. Section 5 presents the experimental results comparing the performance of SPEINet with the ones of other related state-of-the-art models. Section 6 includes a detailed ablation study to assess the impact of each component of the model. Section 7 illustrates some examples of deblurred video sequences and, finally, Section 8 concludes the

Read the complete text