D 3 {D}^{3} ETOR: D {D} ebate-Enhanced Pseudo Labeling and Frequency-Aware Progressive D {D} ebiasing for Weakly-Supervised Camouflaged Object D {D} etection with Scribble Annotations

Jiawei Ge, Jiuxin Cao, Xinyi Li, Xuelin Zhu, Chang Liu, Bo Liu, Chen Feng · 2025

Read D 3 {D}^{3} ETOR: D {D} ebate-Enhanced Pseudo Labeling and Frequency-Aware Progressive D {D} ebiasing for Weakly-Supervised Camouflaged Object D {D} etection with Scribble Annotations by Jiawei Ge, Jiuxin Cao, Xinyi Li, Xuelin Zhu, Chang Liu, Bo Liu, Chen Feng (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-20260.txt.

Introduction

Jiawei Ge and co-authors detect camouflaged objects in images when only scribble annotations are available for training. Scribbles are cheap to draw but sparse, and they bias models toward marked regions. General segmentation models such as SAM can propose full masks, yet they lack the task-specific understanding that hidden objects require.

Their approach, called D3ETOR, works in two stages. A multi-agent debate mechanism plus entropy-driven point sampling improves the pseudo masks that SAM produces. A second network, FADeNet, then fuses frequency-aware features at several levels and reweights supervision across regions to counter scribble bias. Combined, the stages narrow the gap to fully supervised detection and reach leading results on several benchmarks.

Catalog record

CREATORJiawei Ge, Jiuxin Cao, Xinyi Li, Xuelin Zhu, Chang Liu, Bo Liu, Chen Feng
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE52 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2512-20260

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

D 3 {D}^{3} ETOR: D {D} ebate-Enhanced Pseudo Labeling and Frequency-Aware Progressive D {D} ebiasing for Weakly-Supervised Camouflaged Object D {D} etection with Scribble Annotations Thanks: This work is supported by National Natural Science Foundation of China under Grants No.62472092, No. 62172089, No.62106045. Natural Science Foundation of Jiangsu Province under Grants No. BK20241751. Jiangsu Provincial Key Laboratory of Computer Networking Technology. Jiangsu Provincial Key Laboratory of Network and Information Security under Grants No. BM2003201, and Key Laboratory of Computer Network and Information Integration of Ministry of Education of China under Grants No. 93K-9, Nanjing Purple Mountain Laboratories, Fintech and Big Data Laboratory of Southeast University. We thank the Big Data Computing Center of Southeast University for providing the facility support on the numerical calculations. ( Corresponding author: Jiuxin Cao ) J. Ge, J. Cao, X. Li, and C. Liu are with School of Cyber Science and Engineering, Southeast University, Nanjing 211189, China. (e-mail: [email protected], [email protected], [email protected], [email protected]) X. Zhu is with Department of Aeronautical and Aviation Engineering, The Hong Kong Polytechnic University, Hong Kong, China (e-mail: [email protected] B. Liu is with School of Computer Science and Engineering, Southeast University, Nanjing 211189, China. (e-mail: [email protected]) C. Feng is with School of Electronics, Electrical Engineering and Computer Science, Queen’s University Belfast, Belfast, U.K. (e-mail: [email protected]) I. Patras is with School of Electronic Engineering and Computer Science, Queen Mary University of London, London E1 4NS, U.K. (e-mail: [email protected]) Jiawei Ge, Jiuxin Cao, Xinyi Li, Xuelin Zhu, Chang Liu, Bo Liu, Chen Feng Abstract Weakly-Supervised Camouflaged Object Detection (WSCOD) aims to locate and segment objects that are visually concealed within their surrounding scenes, relying solely on sparse supervision such as scribble annotations. Despite recent progress, existing WSCOD methods still lag far behind fully supervised ones due to two major limitations: (1) the pseudo masks generated by general-purpose segmentation models (e.g., SAM) and filtered via rules are often unreliable, as these models lack the task-specific semantic understanding required for effective pseudo labeling in COD; and (2) the neglect of inherent annotation bias in scribbles, which hinders the model from capturing the global structure of camouflaged objects. To overcome these challenges, we propose D 3 {D}^{3} ETOR, a two-stage WSCOD framework consisting of Debate-Enhanced Pseudo Labeling and Frequency-Aware Progressive Debiasing. In the first stage, we introduce an adaptive entropy-driven point sampling method and a multi-agent debate mechanism to enhance the capability of SAM for COD, improving the interpretability and precision of pseudo masks. In the second stage, we design FADeNet, which progressively fuses multi-level frequency-aware features to balance global semantic understanding with local detail modeling, while dynamically reweighting supervision strength across regions to alleviate scribble bias. By jointly exploiting the supervision signals from both the pseudo masks and scribble semantics, D 3 {D}^{3} ETOR significantly narrows the gap between weakly and fully supervised COD, achieving state-of-the-art performance on multiple benchmarks. I Introduction Camouflaged Object Detection (COD) is a challenging task that involves identifying and segmenting objects that are well-concealed within their environments [ 1 ] . In contrast to salient object detection [ 2 ] or generic object detection [ 3 ] , COD must handle scenarios where an object’s appearance, shape, and color are almost indistinguishable from the background (as shown in Figure 1 (d)). These objects range from animals exhibiting protective coloration or small, occluded forms to man-made objects engineered for concealment. The high similarity to the surrounding background, along with indistinct boundaries and deceptive textures, poses significant challenges for detection. Despite these challenges, COD still attracts growing interest in the computer vision community and shows promise in applications such as species discovery [ 4 , 5 ] , agriculture monitoring [ 4 ] , medical image segmentation [ 6 , 7 , 8 ] , and wildlife tracking [ 9 ] . Fig. 1: Visualization of task objectives across different detection paradigms. (a) Input raw image. (b) Generic object detection aims to locate and classify all identifiable objects (segmented with distinct colors). (c) Salient object detection focuses on identifying objects that naturally attract human attention (e.g., the stick highlighted in green). (d) Camouflaged object detection identifies visually inconspicuous objects that blend into the background, such as the small snake highlighted in red. While existing COD methods have achieved impressive performance, they rely heavily on dense pixel-wise annotations, which can take up to 60 minutes per image [ 1 ] . In contrast, weakly-supervised labels offer a much more efficient and scalable alternative. For instance, scribble-based annotations require only around 10 seconds per image [ 10 ] . As a recently emerging task, Weakly-Supervised Camouflaged Object Detection (WSCOD) has seen only limited exploration [ 10 , 11 , 12 ] . Early efforts such as CRNet [ 10 ] focus on expanding the scribbles to wider camouflaged regions to capture structural information and semantic relationships. More recent methods, WS-SAM [ 11 ] and SAM-COD [ 12 ] , push the boundary of WSCOD by adopting a two-stage learning framework: they first generate high-quality pseudo masks from scribbles using the Segment Anything Model (SAM) [ 13 ] , and then train COD models on these pseudo masks. Despite these advances, current WSCOD approaches still lag far behind fully supervised COD models in terms of detection accuracy and segmentation quality. We observe that such performance gaps primarily result from the suboptimal exploitation of weak supervision signals, particularly in two key aspects: (1) the limited quality and quantity of supervision signals generated by SAM , and (2) the harmful annotation bias inherent in scribbles introduced by annotators . Fig. 2: As a general-purpose segmentation model, SAM struggles to meet the specific demands of the COD task. Consequently, its limited semantic discriminative capability often leads to suboptimal segmentation performance on camouflaged objects. To begin with, effectively leveraging the Segment Anything Model (SAM) [ 13 ] for the WSCOD task is non-trivial. Although SAM can directly generate pseudo masks for generic objects, it is prone to producing unwanted semantic responses, such as non-camouflaged objects or fragmented local regions (as shown in Figure 2 ). This limitation is largely due to SAM’s restricted semantic understanding and its inability to comprehend the specific demands of camouflaged object detection. To alleviate this issue, prior works like WS-SAM [ 11 ] and SAM-COD [ 12 ] propose heuristic selection mechanisms with predefined thresholds to filter unreliable pseudo masks. However, such strategies still fail to equip SAM with the semantic reasoning capabilities necessary for COD. Ultimately, the quality of the pseudo masks remains constrained by the inherent limitations of SAM . Inevitably, many informative hard examples may be prematurely discarded due to low confidence scores in the rule-based selection . As a result, the current exploitation of weak supervision in WSCOD is insufficient, both in quality and quantity, to support the training of robust and accurate models. Fig. 3: The relative distances from ground truth mask and scribble pixels to their respective nearest object boundaries reveal a notable discrepancy in spatial distribution. It is evident that scribble annotations are biased toward central object regions, whereas mask labels exhibit a more uniform coverage across entire object areas. Furthermore, these methods tend to overlook the rich semantic information (e.g., structure and relation) embedded in scribble annotations

Read the complete text