Weakly Supervised Camouflaged Object Detection Based on the SAM Model and Mask Guidance
Xia Li, Xinran Liu, Lin Qi, Junyu Dong · 2026
Read Weakly Supervised Camouflaged Object Detection Based on the SAM Model and Mask Guidance by Xia Li, Xinran Liu, Lin Qi, Junyu Dong (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-25385.txt.
Introduction
Xia Li and colleagues detect camouflaged objects, which blend into their surroundings, using only weak supervision instead of costly exact labels. Their MGNet network tackles fuzzy edges and missed objects with masks from a custom layered decoder that guides segmentation and sharpens edges. A context module cuts missed detections, while an aggregation module combines features from masks. For training labels, BoxSAM prompts the Segment Anything Model with boxes to make good pseudolabels through repeat processing. Experiments show competitive performance against fully supervised leading methods.
Catalog record
| CREATOR | Xia Li, Xinran Liu, Lin Qi, Junyu Dong |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 66180 |
| LICENSE | http://creativecommons.org/publicdomain/zero/1.0/ |
| RIGHTS | CC0 |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.25385
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Weakly Supervised Camouflaged Object Detection Based on the SAM Model and Mask Guidance Xia Li, Xinran Liu, Lin Qi, Junyu Dong Abstract Camouflaged object detection (COD) from a single image is a challenging task due to the high similarity between objects and their surroundings. Existing fully supervised methods require labor-intensive pixel-level annotations, making weakly supervised methods a viable compromise that balances accuracy and annotation efficiency. However, weakly supervised methods often experience performance degradation due to the use of coarse annotations. In this paper, we introduce a new weakly supervised approach for camouflaged object detection to overcome these limitations. Specifically, we propose a novel network, MGNet, which tackles edge ambiguity and missed detections by utilizing initial masks generated by our custom-designed Cascaded Mask Decoder (CMD) to guide the segmentation process and enhance edge predictions. We introduce a Context Enhancement Module (CEM) to reduce the missing detection, and a Mask-guided Feature Aggregation Module (MFAM) for effective feature aggregation. For the weak supervision challenge, we propose BoxSAM, which leverages the Segment Anything Model (SAM) with bounding-box prompts to generate pseudo-labels. By employing a redundant processing strategy, high quality pixel-level pseudo-labels are provided for training MGNet. Extensive experiments demonstrate that our method delivers competitive performance against current state-of-the-art methods. keywords Camouflaged object detection ,Weak supervision ,Segment anything model ,Mask guidance † † corresponding: Corresponding author 1 Introduction Camouflaged object detection (COD) refers to the pixel-level segmentation of objects that blend seamlessly with their surrounding environment [ 8 ] . This task presents greater challenges compared to general object detection and salient object detection (SOD) because camouflaged objects usually make themselves highly match their surroundings in terms of texture, color and shape. The detection of camouflaged objects finds extensive utility in various practical domains such as polyp segmentation [ 10 ] in the medical domain, pest detection [ 11 ] in agriculture and object surface defect detection in the industrial field [ 9 ] . Benefiting from the strong learning capacity of advanced CNN and transformer architectures, COD has achieved remarkable progress in recent years. The task of COD has evolved from relying on low-level visual features, such as traditional texture [ 43 ] , gradient [ 39 ] , and motion features [ 17 ] , to extracting high-level semantic features using deep learning methods. Recently, numerous deep learning-based methods for COD have achieved significant advancements [ 19 , 18 , 33 , 15 ] . However, our experiments reveal that these methods still exhibit two shortcomings: 1) the ambiguous edges of camouflaged objects. 2) the missed detection of camouflaged objects. As shown in Figure 1 , due to the intrinsic similarity between the camouflaged objects and the backgrounds, FSPNet [ 19 ] fails to completely detect the edges of caddis moth (row 1) and fish (row 2), and even misses the small hippocampi (rows 3 and 4). Figure 1: Visual examples of different methods. (a) RGB images. (b) Ground truth. (c)-(d) The detection results obtained by (c) Our results, (d) FSPNet [ 19 ] . In addition to these two problems, fully supervised COD training typically relies on pixel-level supervision, which involves costly pixel-level annotation [ 1 ] . Consequently, weakly supervised COD holds significant research importance. Weakly supervised camouflaged object detection (WSCOD) relies on point annotations, bounding-box annotations or scribble annotations in the foreground or background, eliminating the need for pixel-level labeling. This approach enhances labeling efficiency and reduces costs. However, coarse annotations that only differentiate between foreground and background result in degraded segmentation performance. For instance, WSCOD based on scribble annotations [ 16 ] results in decreased segmentation accuracy. In addition, the community of weakly supervised salient object detection [ 67 , 63 , 29 , 34 , 47 , 32 ] has made remarkable advancements, whereas there have been only very few attempts in WSCOD [ 16 , 14 , 4 ] . How to balance accuracy and annotation efficiency in WSCOD is still under exploration. Inspired by the process of human observation, we first roughly localize the position and contour of the camouflaged object and then refine its edges. We propose the Mask-guided Network (MGNet) for the COD task, which guides subsequent segmentation through the initial generated masks by our designed Cascaded Mask Decoder (CMD). Specifically, to reduce the missing detection, we design a Context Enhancement Module (CEM), which employs convolutional layers with varying dilation rates to reduce information loss during the downsampling process. Besides, the CMD incrementally fuses multi-scale features, including high-level semantic information and low-level detail information, to guide subsequent segmentation from a global perspective. To address the ambiguous edges problem, we design a Mask-guided Feature Aggregation Module (MFAM), which is utilized to identify the fine regions of objects by fusing adjacent-level features with the guidance of masks from the CMD. To address the challenge of weak supervision, we propose BoxSAM. We annotate the images with bounding boxes, which are less affected by human subjective factors compared to scribble annotations and point annotations. This is attributable to the fact that both the position of the point annotations and the length and location of the scribble annotations can significantly impact the performance of the model. In contrast, under ideal circumstances, a bounding box annotation represents the minimal enclosing box that completely encompasses the object. Segment Anything Model (SAM) [ 25 ] possesses powerful segmentation capabilities, but its performance in the field of camouflaged object detection is not particularly outstanding due to the high intrinsic similarity between the camouflaged objects and the backgrounds, segmentation results of SAM may mistakenly classify the backgrounds as camouflaged objects [ 22 , 45 , 23 ] . To address this issue, we design a redundancy processing strategy to refine the initial labels, providing high-quality pixel-level pseudo labels for training MGNet. In contrast to the strategies during the training period [ 31 ] , we directly process the pseudo-labels generated by SAM based on the bounding-box prompts. We propose the redundancy processing strategy specifically designed to address the issue of redundant predictions generated by SAM when segmenting images with cluttered backgrounds or scenarios where the background and camouflaged objects exhibit high similarity. By integrating deep learning model MGNet with the generalization capabilities of SAM, we achieve more accurate pseudo-label generation. Our contributions in this paper are as follows: • The proposed BoxSAM is a WSCOD method that generates pseudo-labels by annotating bounding-boxes of the camouflaged objects and integrating the SAM model. Furthermore, we propose a redundancy processing strategy to obtain more accurate pseudo-labels. • We propose a novel Mask-guided Network (MGNet) that enhances subsequent segmentation by utilizing the initially generated masks as guidance. We propose a CEM to reduce the missing detection. Additionally, we design a MFAM to aggregate features at different levels under the guidance of masks generated by the CMD. • BoxSAM is evaluated on three widely used COD datasets, the experiments demonstrate that our method achieves state-of-the-art performance. MGNet outperforms the current state-of-the-art COD methods. In addition, it also demonstrates excellent performance in COD-related applications. 2 Related work 2.1 Camouflaged object detection Traditional COD methods are susceptible to noise, resulting in relatively poor detection performance. With the advancement of deep learning, many contemporary COD methods now leverage deep learning techniques. Fan