A Single Set of Adversarial Clothes Breaks Multiple Defense Methods in the Physical World Journal: ****

Wei Zhang, Zhanhao Hu, Xiao Li, Xiaopei Zhu, Xiaolin Hu · 2025

Read A Single Set of Adversarial Clothes Breaks Multiple Defense Methods in the Physical World Journal: **** by Wei Zhang, Zhanhao Hu, Xiao Li, Xiaopei Zhu, Xiaolin Hu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-17322.txt.

Introduction

Printed patterns on clothing can fool the cameras that spot people, and Wei Zhang with four co-authors tests whether current defenses can stop them. Earlier defenses were built against small adversarial patches, which are images made to mislead object detectors. Zhang and his co-authors noticed that simply making a patch larger already made many defenses fail.

Clothes cover far more of the body and look more natural than a large patch, so the team tested printed adversarial clothes in both computer tests and the real world. Every defense performed poorly. One single set of clothes fooled the detector and nine defended versions at high rates, showing a shared weakness across the defenses.

Catalog record

CREATORWei Zhang, Zhanhao Hu, Xiao Li, Xiaopei Zhu, Xiaolin Hu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE37 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2510-17322

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

A Single Set of Adversarial Clothes Breaks Multiple Defense Methods in the Physical World Journal: **** Wei Zhang, Zhanhao Hu, Xiao Li, Xiaopei Zhu, Xiaolin Hu Abstract In recent years, adversarial attacks against deep learning-based object detectors in the physical world have attracted much attention. To defend against these attacks, researchers have proposed various defense methods against adversarial patches, a typical form of physically-realizable attack. However, our experiments showed that simply enlarging the patch size could make these defense methods fail. Motivated by this, we evaluated various defense methods against adversarial clothes which have large coverage over the human body. Adversarial clothes provide a good test case for adversarial defense against patch-based attacks because they not only have large sizes but also look more natural than a large patch on humans. Experiments show that all the defense methods had poor performance against adversarial clothes in both the digital world and the physical world. In addition, we crafted a single set of clothes that broke multiple defense methods on Faster R-CNN. The set achieved an Attack Success Rate (ASR) of 96.06 % 96.06\text{\,}\mathrm{\%} against the undefended detector and over 64.84 % 64.84\text{\,}\mathrm{\%} ASRs against nine defended models in the physical world, unveiling the common vulnerability of existing adversarial defense methods against adversarial clothes. Code is available at: https://github.com/weiz0823/adv-clothes-break-multiple-defenses . 1 Introduction Deep Neural Networks (DNNs) are known to be vulnerable to adversarial examples not only in the digital world ( Goodfellow et al. 2014 ; Madry et al. 2018 ; Karmon et al. 2018 ) , but also in the physical world ( Brown et al. 2017 ; Thys et al. 2019 ; Xu et al. 2020 ; Wu et al. 2020b ; Hu et al. 2021 ; Hu et al. 2022 ; Hu et al. 2023 ) . Physical adversarial examples raise serious security concerns since they can be deployed in the real world. Given the widespread deployment of object detection models in various applications, researchers have focused on fooling object detection models in the physical world in recent years, especially person detection models ( Thys et al. 2019 ; Xu et al. 2020 ; Wu et al. 2020b ; Hu et al. 2021 ; Hu et al. 2022 ; Hu et al. 2023 ) . To defend against physically realizable attacks, various defense methods ( Naseer et al. 2019 ; Zhou et al. 2020 ; Yu et al. 2022 ; Mu and Wagner 2021 ; Ji et al. 2021 ; Yu et al. 2021 ; Kim et al. 2022 ; Liu et al. 2022 ; Rossolini et al. 2023 ; Xu et al. 2023 ; Tarchoun et al. 2023 ; Rao et al. 2020 ; Metzen et al. 2021 ) have been proposed. They are usually designed for and evaluated on adversarial patches ( Brown et al. 2017 ; Thys et al. 2019 ) . Some of the defense methods ( Yu et al. 2022 ; Kim et al. 2022 ; Zhou et al. 2020 ) were evaluated on physical-world patch-based attacks, and others were evaluated on digital-world patch-based attacks. They worked well in defending against patch-based attacks. However, in this paper we will show that this may have given a false sense of security of protected object detectors. Fig. 1 : APs of person class of the FNC-defended Faster R-CNN ( Ren et al. 2015 ) detector against patch attack of different patch sizes on the Inria person dataset ( Dalal and Triggs 2005 ) . Solid lines denote the APs of the FNC-defended detector, when the input images are applied with random patch , non-adaptive patch optimized on the undefended detector, and adaptive patch optimized on the FNC-defended detector. Dashed line denotes the AP of the undefended detector, when the input images are applied with non-adaptive patch . Details of experiment setups are provided in Section 3 . Our key observation is that existing defense methods against patch-based attacks have not given enough attention to the patch size. Intuitively, larger patch size corresponds to larger optimization space, and the attack becomes stronger and harder to defend against. Motivated by this, we first investigated whether patch size influences the performance of the defense. Figure 1 provides a clue, where we tested FNC ( Yu et al. 2021 ) , a patch defense method that was independent of the patch size. Note that the defense performance of FNC against adaptive attack (the green line) vanished as the patch became larger. However, simply enlarging patch is not a natural way for physical implementation, since holding a board much larger than body size is not very much natural in real-world scenarios. Instead, texture-based attacks ( Hu et al. 2022 ; Hu et al. 2023 ) , also known as adversarial clothes, provide intuitively similar implementation as the enlarged patch size. It is therefore necessary to re-evaluate the state-of-the-art (SOTA) defense methods to demonstrate their capability of defending against adversarial clothes. In this study, we evaluated various SOTA adversarial defense methods against adversarial clothes. To craft the adversarial clothes in the physical world, we need to design the texture by gradient-based optimization in the digital world first. We adopted a 3D rendering pipeline ( Hu et al. 2023 ) to optimize adversarial textures on clothes. We tested diverse defense methods ( Li et al. 2023a ; Yu et al. 2021 ; Zhou et al. 2020 ; Liu et al. 2022 ; Kim et al. 2022 ; Naseer et al. 2019 ; Yu et al. 2022 ; Tarchoun et al. 2023 ) and found that all of them had poor performance against the digital-world adversarial texture. An implementation of the adversarial clothes in the physical world by printing the texture on real-world clothes unveiled that the vulnerability of defense methods could also be exploited in real-world scenarios. Based on these findings, we conjectured that these defense methods share common vulnerabilities that could be exploited by a single set of adversarial clothes. We optimized the texture of a set of clothes and included an ensemble of defended models during the optimization. We printed the clothing texture on a piece of cloth and tailored it into a set of adversarial clothes including a shirt and a pair of trousers. Experiments showed that the set of clothes bypassed nine defense methods in both the digital world and the physical world. The main contributions are: (1) We evaluated SOTA adversarial defense methods against adversarial clothes, and found that adversarial clothes impaired the performance of the existing defense methods in real-world scenarios. (2) We successfully broke nine defense methods in the physical world with a single set of clothes, achieving over 64.84\text{\,}\mathrm{\%} ASRs against all nine defense methods. (3) The results unveil that SOTA defense methods are still vulnerable to physical-world adversarial examples when confronted with texture-based attacks. The rest of this paper is organized as follows. Section 2 briefly reviews the physically realizable threats to person detectors. Section 3 shows the impact of patch size on adversarial defense, which provides the motivation to evaluate the defense methods against adversarial clothes. Section 4 describes the attack settings of adversarial clothes and evaluation metrics used in this study. Section 5 shows the evaluation results of various adversarial defense methods

Read the complete text