Personalized Face Privacy Protection From a Single Image

Zachary Yahn, Fatih Ilhan, Tiansheng Huang, Selim Tekin · 2026

Read Personalized Face Privacy Protection From a Single Image by Zachary Yahn, Fatih Ilhan, Tiansheng Huang, Selim Tekin (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-19032.txt.

Introduction

Zachary Yahn and seven colleagues build FaceCloak, a face shield from one photo alone. Scraped shots feed rogue match tools. From that shot it spins a small varied face set. It learns a cloak for weak spots, pushing face code to a far anchor and from a near one. A light pixel mask then fits any shot at good look, beating twenty nine rivals on three sets and ten tools.

Catalog record

CREATORZachary Yahn, Fatih Ilhan, Tiansheng Huang, Selim Tekin
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE48048
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.19032

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Personalized Face Privacy Protection From a Single Image Thanks: Manuscript received April 30, 2026 This work was funded by the GTRI PhD Fellowship. The authors are with the Georgia Institute of Technology, Atlanta, Georgia, USA. (email: [email protected]) Zachary Yahn, Fatih Ilhan, Tiansheng Huang, Selim Tekin Abstract Photos of faces uploaded online are vulnerable to malicious actors who can scrape facial images from online sources and intrude on personal privacy via unauthorized use of facial recognition models. This paper presents FaceCloak , a novel personalized face privacy protection system, which can generate defensive identity-specific universal face privacy masks from a single image of a user, causing facial recognition to fail. FaceCloak introduces a three-stage personalized face perturbation learning methodology: (1) It generates a small set of high-variety synthetic face images of a person based on a single image of the person. (2) It learns face cloaking by adding more protection to key facial-identity leakage regions through iterative perturbation generation over the small set of synthetic images, effectively shifting a user’s identity embedding towards a distant anchor identity and away from a similar one. (3) It generates a personalized identity-protective mask in the form of pixel-wise cloaking, which is light-weight and can be efficiently applied to any facial image of a user while maintaining good perceptual quality. Extensive experiments on three popular face datasets across ten recognition models show the effectiveness of FaceCloak compared to 29 other existing representative methods. Code is available here . Fig. 1: Overview of FaceCloak with three progressive stages for face privacy protection: synthetic facial image generation, defensive face cloak optimization, and face-based identity protection. A user only needs to supply a single face image of themselves and will receive an identity-specific face privacy mask that can be rapidly added to any of their face images prior to online release. I Introduction Facial Recognition (FR) has long been an important concern for individual privacy. People wish to post their face photos online to socialize, blog, network, and connect with their colleagues, families, and friends, but they do not want unauthorized collection of their identities in large-scale databases. These databases can support infringements on real-world privacy by individuals, such as via stalking and identity fraud [ 2 , 14 ] , as well as by corporations, such as via surveillance, targeted advertisements, and tracking [ 45 ] . Examples include PimEyes [ 35 ] , which provides a searchable database of public facial photos, and Clearview AI [ 1 ] , which provides facial data to governments. In light of these threats to privacy and given the prevalence of open-source facial recognition models [ 10 , 46 , 21 , 55 ] , there is a pressing need to protect user images uploaded online from unwanted facial recognition while maintaining image quality. A popular defense against unauthorized facial recognition is to subtly perturb a person’s face images with strategic noise (often dubbed a ‘cloak’) to transpose their embeddings to a different latent identity class prior to uploading. However, most existing face perturbation methods require numerous backpropagation calls on a surrogate model [ 42 , 6 , 48 , 4 ] or inference on a large generative model [ 23 , 43 , 3 , 40 ] for every new image, which may be prohibitively expensive for the average user. Instead of generating a new mask for each image, identity-specific (often dubbed ‘universal’) perturbations optimize a personalized defensive perturbation once for each user [ 56 ] . Once generated, such perturbations can be applied to new images of that user trivially. This presents a new set of problems: images provided by users may not be sufficiently representative, the user may not have enough images available to supply the learning process, or the privacy-minded user may not want to share many images of themselves in the first place. With these problems in mind, we present FaceCloak , a novel three-stage system which needs only one face image from a user to generate their identity-specific face privacy cloak. First, we generate a small set of diverse, high-quality synthetic images using a single seed image provided by the user. These synthetic images portray the user with varying expressions, lighting, poses, clothing, and backgrounds. Second, we optimize a personalized identity-specific privacy perturbation over the set of synthetic images to shift their embeddings towards a distant latent identity class. We constrain this optimization with a perturbation budget hyperparameter to ensure that the images perturbed with the identity-specific face privacy cloak will maintain high perceptual quality. Third, FaceCloak provides a personalized identity-specific face perturbation mask that can be applied to any new image of the user through the combination of diverse perturbation focusing methods, e.g., Region-Sticker, Learnable Attention, and High-Pass Mask. We validate our approach with experiments on three face datasets with ten facial recognition models compared with 29 existing representative identity-specific and image-specific face perturbation methods. Our results show that FaceCloak substantially outperforms all other identity-specific and image-specific methods in the literature. We also visually compare FaceCloak to examples from the literature to show that it maintains a high perceptual quality for cloaked face images. II Related Work Image-Specific Perturbations. Image-specific perturbations learn a new perturbation for every image regardless of user identity [ 42 , 15 , 6 , 4 , 48 ] . Noise-based image-specific methods mainly differ by how different parts of the loss function are constructed, aiming to design an iterative method for optimizing stealthy perturbations [ 49 ] . A different thread of image-specific work proposed applying makeup to faces instead of learning noise-based perturbations [ 50 ] . Some use generative adversarial networks [ 18 ] , such as AMT-GAN [ 23 ] , while others, like DiffAm, [ 43 ] use a fine-tuned diffusion model [ 20 ] . Similarly, CLIP2Protect [ 40 ] uses zero-shot CLIP [ 37 ] embeddings to generate protective makeup. These makeup-based methods achieve high protection rates, but the makeup masks are often highly visible and may be undesirable for people who do not wear makeup. Existing works have also attempted to combine perturbation-based and makeup-based techniques by training generative models to produce stealthy privacy masks. AdvFaces [ 8 ] synthesizes protected face images with a GAN [ 18 ] . SD4Privacy [ 3 ] uses Stable Diffusion [ 38 ] to generate adversarial perturbations that blend with a user’s face. This achieves strong stealthiness scores but lacks the advanced protection of other methods. Adv-CPG [ 47 ] proposes a different approach by generating portraits optimized against facial recognition; however, this significantly alters the original image. Identity-Specific Perturbations . These perturbations are learned offline once and rapidly applied online to any facial images of the user. One Person One Mask (OPOM) [ 56 ] produces universal perturbations by optimizing over many images of the same user in order to ensure that the perturbation generalizes to any image of that user. AdvCloak [ 29 ] proposes to first learn image-specific perturbations and then combine them into identity-specific perturbations with a GAN [ 18 ] . P3-Mask [ 7 ] proposes an ensemble method to optimize identity-specific universal perturbations. All of these identity-specific perturbation methods require many images for each user to either train

Read the complete text