Scoring, Remember, and Reference: Catching Camouflaged Objects in Videos

Yu’ang Feng, Shuyong Gao, Fuzhen Yan, Yicheng Song, Lingyi Hong, Junjie Hu, Wenqiang Zhang · 2025

Read Scoring, Remember, and Reference: Catching Camouflaged Objects in Videos by Yu’ang Feng, Shuyong Gao, Fuzhen Yan, Yicheng Song, Lingyi Hong, Junjie Hu, Wenqiang Zhang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-17050.txt.

Introduction

Yu'ang Feng and co-authors published a computing paper in 2025 on spotting camouflaged objects in video. Such objects blend into their surroundings, and past models underuse motion across frames. Their framework borrows from human memory: past frames serve as references for the current one. A decoder both predicts masks and scores them, so the best reference frames can be picked by score.

An attention design joins long-term reference data with short-term motion cues. The full system beat prior approaches by a clear margin on benchmarks while using fewer parameters and a single pass through each video. The authors plan to release the code publicly.

Catalog record

CREATORYu’ang Feng, Shuyong Gao, Fuzhen Yan, Yicheng Song, Lingyi Hong, Junjie Hu, Wenqiang Zhang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE38 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-17050

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Scoring, Remember, and Reference: Catching Camouflaged Objects in Videos Yu’ang Feng, Shuyong Gao, Fuzhen Yan, Yicheng Song, Lingyi Hong, Junjie Hu, Wenqiang Zhang Abstract Video Camouflaged Object Detection (VCOD) aims to segment objects whose appearances closely resemble their surroundings, posing a challenging and emerging task. Existing vision models often struggle in such scenarios due to the indistinguishable appearance of camouflaged objects and the insufficient exploitation of dynamic information in videos. To address these challenges, we propose an end-to-end VCOD framework inspired by human memory-recognition, which leverages historical video information by integrating memory reference frames for camouflaged sequence processing. Specifically, we design a dual-purpose decoder that simultaneously generates predicted masks and scores, enabling reference frame selection based on scores while introducing auxiliary supervision to enhance feature extraction. Furthermore, this study introduces a novel reference-guided multilevel asymmetric attention mechanism, effectively integrating long-term reference information with short-term motion cues for comprehensive feature extraction. By combining these modules, we develop the Scoring, Remember, and Reference (SRR) framework, which efficiently extracts information to locate targets and employs memory guidance to improve subsequent processing. With its optimized module design and effective utilization of video data, our model achieves significant performance improvements, surpassing existing approaches by 10% on benchmark datasets while requiring fewer parameters (54M) and only a single pass through the video. The code will be made publicly available. 1 1 footnotetext: Corresponding authors. Figure 1 : Comparison of methods with and without reference frame utilization. Bottom: Conventional video models that do not save reference frames. Top: Our method saves optimal frames as references to guide subsequent segmentation. The line graph illustrates the performance curves of the two methods on a sample video, with bold points highlighting frames visualized. 1 Introduction When objects are concealed within backgrounds that closely resemble their appearance, even the human eye struggles to accurately identify them and delineate their boundaries. Camouflaged Object Detection (COD) is a task aimed at segmenting camouflaged objects from their surroundings. In real-world scenarios, numerous objects exhibit substantial visual similarity to their environment. This task finds applications in diverse fields, including wildlife conservation [ 35 ] , medical image segmentation [ 10 , 9 , 40 ] , art analysis [ 13 , 5 ] , agriculture [ 36 , 28 ] , and security [ 27 ] . In dynamic environments, objects may be well-camouflaged while stationary, but human vision often identifies them readily upon movement. This highlights the critical role of dynamic information in object detection. Consequently, the task of Video Camouflaged Object Detection (VCOD) arises, focusing on identifying objects concealed within backgrounds from video sequences. Unlike typical video tasks, such as Video Object Segmentation (VOS) [ 15 , 32 , 45 ] and Video Salient Object Detection (VSOD) [ 24 , 12 , 20 ] , camouflaged targets are characterized by colors and textures that closely mimic the background and by indistinct boundaries. This necessitates the use of information beyond visual appearance. Recent advancements in COD based on static images have achieved remarkable progress [ 37 , 46 , 16 ] , offering valuable insights into leveraging visual information for this task. Nevertheless, methods relying solely on static information exhibit suboptimal performance when extended to video-based tasks. On the VCOD front, some progress has been achieved [ 4 , 17 ] with approaches that integrate motion information alongside appearance features. However, these methods often involve additional computational overhead and fail to fully exploit long-term memory information. The objective of this research is to propose methods that effectively utilize video data to extract dynamic information, thereby improving object detection and segmentation performance. How do humans identify an object concealed within its environment? Initially, the object may remain indistinguishable. However, since objects are rarely perfectly stationary, their movement or diminished camouflage enables humans to detect them by synthesizing new dynamic information with visual cues. More importantly, once identified, humans tend to remember the object’s characteristics. Even if the object becomes stationary or re-hidden, its identification subsequently requires less effort due to memory. Inspired by this behavior, we propose the Scoring, Remember, and Reference (SRR) framework, named SRR-Net , which effectively utilizes video data to enhance VCOD performance. First, we introduce the concept of memory reference frames as the core of our design. Unlike ground-truth references provided for the first frame in VOS [ 34 ] , our reference frame is generated from preceding frames in the video sequence. Specifically, we develop a Dual-Purpose Decoder that outputs both segmentation maps and scores, enabling the model to select frames to retain as references. This design also incorporates automatic supervision for the scoring task, enhancing the quality of feature extraction. Second, to utilize reference frames effectively, we propose Reference-Guided Multilevel Asymmetric (RMA) Attention . This attention mechanism within the transformer’s backbone integrates memory information from reference frames with motion information from adjacent frames, enabling robust feature extraction for detecting camouflaged objects. Notably, our approach requires only a single pass through the video sequence for feature extraction and memory mechanism utilization, eliminating the need for future frames or additional post-processing, and enhancing its practicality for real-world applications. In summary, the key contributions of this study are as follows: • We design a novel pipeline introducing the memory reference mechanism, effectively leveraging dynamic video information to advance the VCOD task and offering new methodologies for utilizing video data in VCOD. • We propose the RMA Attention and the Dual-Purpose Decoder , implementing effective strategies for utilizing memory and motion information. These modules complete the Scoring, Remember, and Reference detection pipeline, enabling efficient detection of camouflaged objects in videos. • Our model surpasses existing state-of-the-art methods by a margin of 10% on large-scale datasets, requiring only a single pass through the video and fewer parameters (54M). Figure 2 : Overview of SRRNet. Using the proposed RMA attention mechanism, the framework constructs four stages to progressively extract multilevel features. These features are then fed into the dual-purpose decoder to generate segmentation results and predicted scores, which are subsequently used to update the reference frame. 2 Related Work 2.1 Camouflaged Object Detection Camouflaged Object Detection (COD) focuses on identifying and segmenting objects concealed within their background. With the introduction of datasets such as CAMO [ 25 ] , COD10K [ 8 ] , and NC4K [ 30 ] , increasing attention has been drawn to COD research. Fan et al. [ 8 ] proposed a two-stage strategy employing a coarse-to-fine approach to locate and segment camouflaged objects. Pang et al. [ 33 ] mimicked human behavior by scaling input images to enhance target recognition. BGNet [ 37 ] introduced edge-guided feature extraction to improve segmentation performance. SAM-COD [ 3 ] utilized the pretrained SAM model [ 22 ] , combined with weakly supervised labels, to perform COD. These studies have made significant contributions to COD. However, due to the high visual similarity between camouflaged objects and their background, relying solely on static visual information is insufficient for practical applications, leading to the emergence of video-based tasks for camouflaged object detection. 2.2 Video Object Segmentation Video Object Segmentation (VOS) aims to segment desired objects from video sequences. The most common VOS task is Semi-Supervised VOS (SVOS) [ 42 ] , where the ground-truth for the

Read the complete text