Counteracting temporal attacks in Video Copy Detection

Katarzyna Fojcik, Piotr Syga · 2025

Read Counteracting temporal attacks in Video Copy Detection by Katarzyna Fojcik, Piotr Syga (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-11171.txt.

Introduction

Katarzyna Fojcik and Piotr Syga harden video copy detection against time-based tricks in this 2025 paper. Copy detection spots duplicate videos in huge libraries to guard copyright. A winning contest system pairs edit detection with scene detection, but it handles exact copies poorly and can be fooled by edits that play with time.

Their fix picks frames at the peaks of change between neighboring frames, not at a steady one per second. The method ran several times faster than the steady approach and shrank the data a video leaves behind by over half. Accuracy stayed level with the contest winner on standard tests. Robustness against time tricks improved, a key need for real platforms.

Catalog record

CREATORKatarzyna Fojcik, Piotr Syga
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE27 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-11171

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Counteracting temporal attacks in Video Copy Detection Katarzyna Fojcik, Piotr Syga Abstract Video Copy Detection (VCD) plays a crucial role in copyright protection and content verification by identifying duplicates and near-duplicates in large-scale video databases. The META AI Challenge on video copy detection provided a benchmark for evaluating state-of-the-art methods, with the Dual-level detection approach emerging as a winning solution. This method integrates Video Editing Detection and Frame Scene Detection to handle adversarial transformations and large datasets efficiently. However, our analysis reveals significant limitations in the VED component, particularly in its ability to handle exact copies. Moreover, Dual-level detection shows vulnerability to temporal attacks. To address it, we propose an improved frame selection strategy based on local maxima of interframe differences, which enhances robustness against adversarial temporal modifications while significantly reducing computational overhead. Our method achieves an increase of 1.4 to 5.8 times in efficiency over the standard 1 FPS approach. Compared to Dual-level detection method, our approach maintains comparable micro-average precision ( μ \mu AP) while also demonstrating improved robustness against temporal attacks. Given 56% reduced representation size and the inference time of more than 2 times faster, our approach is more suitable to real-world resource restriction. 1 Introduction Video content has become ubiquitous in the digital age, serving as a primary medium for entertainment, education, and communication. As video-sharing platforms grow in popularity, the need for effective copyright protection mechanisms becomes increasingly important. Video copy detection systems aim to identify duplicates or near-duplicates of videos, enabling rights holders to enforce intellectual property laws and combat unauthorized usage. Aside from copyright protection, copy detection is an important tool in reducing database redundancies or localizing the original recordings of DeepFake attacks. The dual-level detection method, as described in [ 13 , 16 ] was recognized as the winning solution in the prestigious META AI Challenge on video copy detection [ 13 ] . This approach combines Video Editing Detection (VED) with Frame Scene Detection (FSD) to address the challenges posed by large-scale datasets and adversarial transformations. Specifically, VED is designed to differentiate unedited videos by assigning them descriptors with small norms and negative bias terms instead of deriving descriptors using a trained model. This significantly reduces the computation time, but the assumption that an unedited video definitely does not contain copied fragments from a database of reference videos is naive. For edited videos, FSD captures situation when multiple scenes are concatenated along edge and split the scenes in one frame. The dataset used in the original study is representative of real-world scenarios and contains edited and unedited videos. It includes a diverse range of transformations, such as scaling, cropping, and temporal shifts, as well as adversarial attacks such as frame duplication and deletion. These variations provide a robust benchmark for evaluating video copy detection methods. Despite challenge winners’ method strong performance on this dataset, our experiments reveal critical limitations of the dual-level detection method, particularly in its VED component and frame extraction approach. In this article, we present a detailed analysis of the shortcomings of the original method and propose enhancements to improve its efficiency and robustness. By leveraging local maxima from interframe differences for frame extraction and evaluating the system’s resistance to temporal attacks, we aim to provide a more practical and resilient solution for video copy detection. 2 Related work Video copy detection has been an active area of research for more than a decade, with early methods focusing on descriptors such as histograms and block-based matching techniques. As computational power and storage capabilities improved, researchers shifted towards feature-based approaches, utilizing local descriptors like Scale-Invariant Feature Transform (SIFT) and Speeded-Up Robust Features (SURF). These methods enabled more accurate matching of video fragments, even under transformations such as scaling, cropping, and rotation [ 17 , 10 ] . With the advent of deep learning, video copy detection has undergone a paradigm shift. Convolutional Neural Networks (CNNs) like VGG [ 15 ] , ResNet [ 7 ] , and models such as ViSiL [ 9 ] have significantly advanced frame-level feature extraction for video similarity learning. Additionally, architectures like 3D-CNNs [ 11 ] and encoder–decoder ConvLSTM models [ 3 ] capture spatiotemporal dynamics, improving robustness to temporal edits. Advanced methods now incorporate transformer-based architectures, such as Video ViT [ 1 ] , and self-supervised learning frameworks like 3D-CSL [ 4 ] to further enhance the system’s ability to detect heavily edited and transformed videos [ 4 , 5 , 2 ] . Lightweight approaches, including multi-teacher distillation frameworks [ 12 ] and compact Siamese neural networks [ 6 ] , have recently gained attention for achieving high efficiency and scalability on large datasets. The importance of dynamic frame selection based on interframe differences to create highly compact video representations was shown in [ 6 ] . This approach reduces computational complexity while preserving the core structure of the video, enabling efficient storage and retrieval even under severe distortions such as extreme compression or resizing. Such strategies demonstrate the potential for real-time applications, where memory and computational constraints are critical. We extend this approach to show robustness against temporal attacks. On the other hand, [ 18 ] proposes a CNN-LSTM hybrid model for human action recognition, evaluated on UCF101 and HMDB51 datasets. Their method improves accuracy by up to 3.5% over CNN-only baselines but suffers from high computational complexity and sensitivity to viewpoint variations, making the solution unusable in real-world applications. The authors of [ 8 ] also indicate time and memory limitations and propose Relational Self-supervised Distillation with Compact Descriptors (RDCD) for image copy detection, using a lightweight network and compact descriptors to improve efficiency. Their method employs relational self-supervised distillation to transfer knowledge from a large teacher network (ResNet-50) to a smaller student network (EfficientNet-B0) and introduces contrastive learning with a hard negative loss to mitigate dimensional collapse. Evaluated on the DISC2021, Copydays (CD10K), and NDEC datasets, RDCD improves micro average precision (µAP) by about 5.0%, depending on the descriptor sizes over the baseline while maintaining competitive performance with significantly smaller descriptor sizes. However, the reliance on knowledge distillation from a large network and additional computational costs during training remain limitations. Despite these advances, challenges persist. Many systems struggle with efficiency when processing large-scale datasets, as feature extraction and matching remain computationally expensive. For example, as demonstrated in [ 6 ] , widely used models like ViSiL generate descriptors of 2025kB for a typical 30-second video, with an inference speed of approximately 6.5 samples per second (sps), where one sample corresponds to a 30-second video. In contrast, the method proposed in [ 6 ] achieves a descriptor size of just 1.875kB while delivering an inference speed of up to 178.6 sps with satisfactory accuracy. Similarly, the authors of [ 4 ] highlight that prevalent models such as VRL-F and TCA-F (both frame-based matching) require over 10 seconds to generate a single descriptor for a sample from the FIVR-200K dataset, with descriptor sizes spanning several megabytes. ViSiL, by comparison, is even less efficient, taking about 10 times longer and producing descriptors approximately 10 times larger. Robustness against adversarial transformations—such as frame manipulation, extreme compression, or rotation—also varies widely among methods. The dual-level detection method, incorporating Video Embedding Descriptors (VED) for

Read the complete text