SCOUT: Semi-supervised Camouflaged Object Detection by Utilizing Text and Adaptive Data Selection

Weiqi Yan, Lvhai Chen, Shengchuan Zhang, Yan Zhang, Liujuan Cao · 2025

Read SCOUT: Semi-supervised Camouflaged Object Detection by Utilizing Text and Adaptive Data Selection by Weiqi Yan, Lvhai Chen, Shengchuan Zhang, Yan Zhang, Liujuan Cao (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-17843.txt.

Introduction

Weiqi Yan and co-authors present SCOUT for finding camouflaged objects in images in this 2025 paper. Camouflaged objects blend into their background, so pixel-level labels are costly to make. With few labeled images, models must learn from unlabeled ones as well.

SCOUT picks the most useful unlabeled data through an adaptive augment and selection step. A text fusion module then adds knowledge about camouflage and links words to image regions. The team built a new dataset, RefTextCOD, to support this text-guided approach. Tests show SCOUT beats prior semi-supervised methods in this field. The gain comes from using unlabeled data more wisely rather than merely using more of it.

Catalog record

CREATORWeiqi Yan, Lvhai Chen, Shengchuan Zhang, Yan Zhang, Liujuan Cao
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE38 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-17843

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

SCOUT: Semi-supervised Camouflaged Object Detection by Utilizing Text and Adaptive Data Selection Weiqi Yan, Lvhai Chen, Shengchuan Zhang, Yan Zhang, Liujuan Cao Abstract The difficulty of pixel-level annotation has significantly hindered the development of the Camouflaged Object Detection (COD) field. To save on annotation costs, previous works leverage the semi-supervised COD framework that relies on a small number of labeled data and a large volume of unlabeled data. We argue that there is still significant room for improvement in the effective utilization of unlabeled data. To this end, we introduce a S emi-supervised C amouflaged O bject Detection by U tilizing T ext and Adaptive Data Selection ( SCOUT ). It includes an Adaptive Data Augment and Selection (ADAS) module and a Text Fusion Module (TFM). The ADSA module selects valuable data for annotation through an adversarial augment and sampling strategy. The TFM module further leverages the selected valuable data by combining camouflage-related knowledge and text-visual interaction. To adapt to this work, we build a new dataset, namely RefTextCOD. Extensive experiments show that the proposed method surpasses previous semi-supervised methods in the COD field and achieves state-of-the-art performance. Our code will be released at https://github.com/Heartfirey/SCOUT . 1 Introduction Camouflaged object detection (COD) Fan et al. 2020 ; Fan et al. 2022 aims at segmenting objects that are visually concealed in their surroundings, which has important applications in several fields, such as military Cannaday et al. 2023 , environmental monitoring Yadav et al. 2018 , urban security Li et al. 2024 etc. Existing COD methods always require large amounts of labeled data to segment camouflaged objects precisely Mei et al. 2021 . However, camouflaged objects often employ complex camouflage strategies to blend deeply with their background. Such camouflage strategies make pixel-level camouflaged object annotations difficult to obtain, and annotating the entire dataset requires a significantly greater cost. To reduce the annotation costs, semi-supervised COD methods utilize only a small amount of labeled data alongside a large amount of unlabelled data. However, as shown in Fig. 1 , we identified the following two main issues with existing methods Lai et al. 2024 ; Zhang et al. 2024 : 1). Most existing methods rely on random sampling to select a portion of the data as the labeled set, without thoroughly considering the quality of the selected data. This often results in the annotation of some meaningless data. 2). For the selected small amount of labeled data, existing models struggle to fully learn camouflage-related knowledge, resulting in poor segmentation performance. Figure 1: Comparison between the proposed method SCOUT and previous semi-supervised COD methods. The proposed SCOUT introduces an adaptive selection strategy and text guidance strategy and achieves a better segmentation performance. Therefore, we argue that there is still significant room for improvement in the effectiveness of unlabeled data utilization. As shown in Fig. 1 , we propose a SCOUT model that introduces an adaptive selection strategy and a text guidance strategy. Specifically, the adaptive selection strategy is implemented by the Adaptive Data Augmentation and Selection(ADAS) module. The ADAS module adaptively selects valuable training data through the Adaptive Data Augmentation (ADA) and the Adaptive Data Selection (ADS) component. The text guidance strategy is implemented by the Text Fusion Module (TFM). To help the model fully learn camouflage-related knowledge, TFM introduces referring text assistance and enhances representation ability, thereby improving the model’s performance across various camouflage scenarios. By annotating precise image-level referring text for existing mainstream COD datasets, we develop a new dataset called RefTextCOD. Our comprehensive evaluations on this dataset demonstrate substantial enhancements over existing semi-supervised COD models. Especially, our method improves the Mean Absolute Error (MAE) by 52.0\% and the S-Measure by 19.1\% compared to previous SOTA semi-supervised COD methods. Additionally, our approach outperforms some supervised COD methods, highlighting its greater practical applicability. Our main contributions are summarized as follows: • We proposed an innovative semi-supervised COD model SCOUT, and extensive experiments have demonstrated its high performance and effectiveness. • To avoid meaningless data annotations, we proposed an ADAS module, which selects valuable data through an adversarial augmentation and sampling strategy. • To fully utilize the referring text, we proposed a TFM module, which leverages the selected valuable data by combining camouflage-related knowledge and text-visual interaction. • We build a new dataset, namely RefTextCOD. We performed image-level referring text annotations on existing mainstream camouflaged object detection (COD) datasets, providing a data foundation for this paper and future explorations of other COD tasks. 2 Related Works 2.1 Camouflaged Object Detection Camouflaged object detection (COD) has a long-standing history, and deep learning-based COD methods have seen rapid development in recent years. Existing fully-supervised COD methods have already achieved great performance by employing multiple strategies. For example, Pang et al. 2022 ; Pang et al. 2023 extract multi-scale features from the backbone and design strategies for fusion. Fan et al. 2022 ; Jia et al. 2022 ; Zhang et al. 2022 further use multi-stage refine. Some methods introduce additional information, e.g. boundary guidance Sun et al. 2022 ; Ji et al. 2023 ; Zhai et al. 2021 , texture clues Ji et al. 2023 ; Zhu et al. 2021 ; Ren et al. 2023 , and other information such as frequency domain and depth Zhong et al. 2022 ; Lin et al. 2023 . The fully-supervised COD methods heavily rely on a large amount of labeled data, while pixel-level annotation incurs significant costs. As a result, some unsupervised, weakly-supervised, and semi-supervised methods have emerged. UCOS-DA Zhang and Wu 2023 is the first unsupervised COD method that addresses the task as a domain adaptation problem. SCOD Zhang et al. 2024 is the first weakly supervised COD method, which introduces a novel feature-guided loss and consistency loss with a new scribble learning approach. Semi-supervised COD methods have also received considerable attention from researchers. This paper focuses on investigating the rationality of data selection and the sufficiency of data utilization in semi-supervised COD methods. 2.2 Semi-Supervised Camouflaged Object Detection In traditional fully-supervised learning, models require extensive labeled data for training to achieve optimal performance. However, obtaining labeled data in practical applications is often costly and time-consuming. Semi-supervised learning (SSL) enhances the model’s generalization capability by combining labeled data and unlabeled data Chen et al. 2023 ; Grandvalet and Bengio 2004 ; Mi et al. 2022 , which effectively addresses the challenges of acquiring labeled data. Some previous works Chen et al. 2021 ; Sohn et al. 2020 ; Wang et al. 2022 introduce the pseudo-labeling mechanism, where a teacher model is trained using a small amount of labeled data, and then the teacher model is used to produce the pseudo labels of the unlabeled data for the subsequent training of the student model. Semi-supervised learning has shown significant potential in various fields. In semi-supervised COD methods, CamoTeacher Lai et al. 2024 applies different augmentation strategies to teacher-student networks and introduces a dual-rotation consistency loss. SCOD-ND Fu et al. 2024 proposes a window-based voting strategy and an ensemble learning algorithm to eliminate noise from labels. However, these methods typically split the dataset into labeled sets and unlabeled sets by random sampling, without considering the value of the selected data. Moreover, they do not make full use of the labeled data. In

Read the complete text