Adversarial Camouflage
Paweł Borsukiewicz, Daniele Lunghi, Melissa Tessa, Jacques Klein, Tegawendé F. Bissyandé · 2026
Read Adversarial Camouflage by Paweł Borsukiewicz, Daniele Lunghi, Melissa Tessa, Jacques Klein, Tegawendé F. Bissyandé (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-21867.txt.
Introduction
Borsukiewicz and co-authors design face patterns that fool recognition systems, to shield people from mass surveillance. Their Adversarial Camouflage searches a small pattern space built from color, shape, and angle. Winning patterns are placed on valid face regions and scored across recognition models. The search maximizes error, so the patterns transfer even to black-box systems. Tests degraded every leading model they tried in simulation. Early real-world trials with human wearers looked promising. The method is meant to be cheap for ordinary users to copy.
Catalog record
| CREATOR | Paweł Borsukiewicz, Daniele Lunghi, Melissa Tessa, Jacques Klein, Tegawendé F. Bissyandé |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 38499 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.21867
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Adversarial Camouflage Paweł Borsukiewicz, Daniele Lunghi, Melissa Tessa, Jacques Klein, Tegawendé F. Bissyandé Abstract While the rapid development of facial recognition algorithms has enabled numerous beneficial applications, their widespread deployment has raised significant concerns about the risks of mass surveillance and threats to individual privacy. In this paper, we introduce Adversarial Camouflage as a novel solution for protecting users’ privacy. This approach is designed to be efficient and simple to reproduce for users in the physical world. The algorithm starts by defining a low-dimensional pattern space parameterized by color, shape, and angle. Optimized patterns, once found, are projected onto semantically valid facial regions for evaluation. Our method maximizes recognition error across multiple architectures, ensuring high cross-model transferability even against black-box systems. It significantly degrades the performance of all tested state-of-the-art face recognition models during simulations and demonstrates promising results in real-world human experiments, while revealing differences in model robustness and evidence of attack transferability across architectures. 1 Introduction Over the past decade, machine learning algorithms have significantly improved our ability to perform a wide range of computer vision tasks, from enabling autonomous driving systems [ 37 ] to detecting cancerous formations [ 41 ] . One application that has proven particularly controversial is facial recognition. On the one hand, facial recognition has enabled convenient applications such as smartphone unlocking and has proven helpful in locating missing persons [ 34 ] and identifying criminal suspects [ 47 ] . On the other hand, the widespread deployment of face recognition raises serious concerns about mass surveillance and large-scale linking of facial identities across the web. In this context, it is critical to investigate mechanisms by which individuals can protect their privacy from automated face recognition. Existing solutions, however, suffer from several limitations. First, most solutions rely on image-level post-processing [ 51 ] , and are not applicable when the user is photographed in public by a third party. Moreover, modern computer vision algorithms rely on information across the entire face to perform recognition [ 8 ] , and prior work has shown that they are highly robust to local attacks such as the obfuscation of the most salient pixels [ 32 ] . Finally, existing physical-world solutions often rely on physical artifacts such as clothes [ 28 ] and glasses [ 44 ] , which can be hard for users to reproduce. In this study, we propose a novel approach to user privacy in real-world settings, which we call Adversarial Camouflage . Specifically, we model the facial recognition evasion task as an adversarial attack, in which the goal is to prevent recognition, and the attack consists of optimizing a pattern that, when painted on the face, maximizes the goal. We parametrize patterns by shape, angle and color, and use gradient ascent to optimize them [ 29 ] . Since we cannot expect the attacker to know the recognition model, we leverage transferability [ 17 ] and select the one-fits-all-faces pattern that, once optimized on a model, most affects all other face recognition classifiers. To make the approach more accessible, we also develop a new evaluation pipeline in which, once a pattern has been found, we use a Diffusion Model [ 23 ] to simulate its application to a face and evaluate the target face recognition algorithms on the resulting image. Our experiments, conducted on existing datasets and in real-world settings, aim to assess both the effectiveness of adversarial camouflage and the validity of the proposed evaluation pipeline. The results, presented in Section 4 , show that the generated patterns are highly effective against convolutional neural networks (CNNs), but exhibit mixed performance against state-of-the-art vision transformers. The evaluation, while overestimating the attacks’ effectiveness relative to the conducted real-world experiments, generally preserves the correct ordering of patterns and models, making it a promising tool for evaluating the relative performance of both attacks and classifiers. Overall, this paper presents four main contributions: (1) a novel technique for real-world privacy protection, called Adversarial Camouflage, capable of hindering facial recognition; (2) The development and assessment of a novel evaluation pipeline, using a 2D application and simulation through Diffusion Models to optimize and evaluate the attack without the need for physical tests; (3) Empirical findings on model robustness under adversarial camouflage conditions and the transferability of attacks across models; (4) One of the most extensive real-world experimental analyses for real-world privacy-protection adversarial attacks, involving a diverse test over three patterns and 20 users, for a total of 1120 photos. 2 Related Works Relevant prior work spans adversarial attacks on computer vision systems, with a specific focus on the physical attacks against facial recognition, which serves as the core domain of our study. 2.1 Adversarial Attacks in General Since the advent of CNNs [ 46 ] and, more recently, Vision Transformers [ 13 ] , deep learning models have achieved remarkable performance in computer vision and image recognition. Despite these advances, such models remain highly vulnerable to adversarial perturbations that degrade their performance [ 14 , 42 ] . In extreme cases, even modifications as imperceptible as the variations of a single pixel [ 48 ] are sufficient to induce misclassification by the target model. The two families of attacks most closely related to our work are gradient-based attacks [ 57 ] and adversarial patch attacks [ 52 ] . Gradient-based attacks compute the gradient of the target classifier’s loss with respect to the input and iteratively apply small, carefully crafted perturbations that maximize the prediction error. While highly effective in the digital domain, these methods are notoriously difficult to transfer to the physical world [ 45 ] , as their success relies on a precise control of the input, which is not always possible on physical objects. Adversarial patch attacks, in contrast, introduce localized physical or digital artifacts, such as stickers [ 53 ] or vehicle decorations [ 60 ] . A foundational framework for such attacks is the Expectation Over Transformations (EOT) [ 5 ] , which optimizes adversarial examples to be robust against a distribution of physical transformations, such as scaling, rotation, and lighting variations. EOT has become the standard pipeline for crafting physically realizable attacks, enabling adversarial patches that survive real-world capture conditions [ 5 , 11 ] . However, EOT-driven patching typically requires precise fabrication and rigid application of 2D stickers, which struggle with the 3D geometry and deformability of human faces. 2.2 Adversarial Attacks on Face Recognition In the context of face recognition, researchers have developed attacks with two distinct goals: dodging and impersonation [ 52 ] . Dodging attacks aim only to avoid detection, whereas impersonation attacks also aim to deceive the model into classifying the attacker as a specific individual. Concerning privacy aspects, most works [ 51 , 26 ] have been designed to operate on digital images rather than the physical world [ 52 ] , for instance, by applying pixel-level changes [ 42 ] on individuals’ photos to make recognition harder. Such approaches, however, are of limited interest to our case, where we assume the attacker is in a public space with no control over how their photographs are taken or processed. To address this issue, some existing physical adversarial attacks against facial recognizers focused on the use of