Privacy Blur: Quantifying Privacy and Utility for Image Data Release

Saeed Mahloujifar, Narine Kokhlikyan, Chuan Guo, Kamalika Chaudhuri · 2025

Read Privacy Blur: Quantifying Privacy and Utility for Image Data Release by Saeed Mahloujifar, Narine Kokhlikyan, Chuan Guo, Kamalika Chaudhuri (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-16086.txt.

Introduction

Saeed Mahloujifar and three co-authors audit a common privacy trick in their arXiv paper from 2025. Photos shared for research often show faces and license plates, which must be hidden before release. The industry standard is Gaussian blur, but the team shows practical blur settings can be reversed enough to expose private details.

They compare four ways to hide image content: blur, pixelization, pixelization plus noise, and cropping. Privacy was tested with reversal and discrimination attacks, while usefulness was tested by training vision models on the cleaned data. Blur proved the least private of the four. Pixelization, with or without added noise, gave both privacy and utility at the right grain size. The authors released their methods and suggested settings in a software package called Privacy Blur.

Catalog record

CREATORSaeed Mahloujifar, Narine Kokhlikyan, Chuan Guo, Kamalika Chaudhuri
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE47 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2512-16086

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Privacy Blur: Quantifying Privacy and Utility for Image Data Release Saeed Mahloujifar, Narine Kokhlikyan, Chuan Guo, Kamalika Chaudhuri Abstract Image data collected in the wild often contains private information such as faces and license plates, and responsible data release must ensure that this information stays hidden. At the same time, released data should retain its usefulness for model-training. The standard method for private information obfuscation in images is Gaussian blurring. In this work, we show that practical implementations of Gaussian blurring are reversible enough to break privacy. We then take a closer look at the privacy-utility tradeoffs offered by three other obfuscation algorithms – pixelization, pixelization and noise addition (DP-Pix), and cropping. Privacy is evaluated by reversal and discrimination attacks, while utility by the quality of the learnt representations when the model is trained on data with obfuscated faces. We show that the most popular industry-standard method, Gaussian blur is the least private of the four – being susceptible to reversal attacks in its practical low-precision implementations. In contrast, pixelization and pixelization plus noise addition, when used at the right level of granularity, offer both privacy and utility for a number of computer vision tasks. We make our proposed methods together with suggested parameters available in a software package called Privacy Blur. † † affiliation: FAIR at Meta † † contribution: Joint first author 1 Introduction Data is the new oil that will power the AI engines of tomorrow. Fueled by the need to train bigger and better computer vision models, the last few years have seen a significant rise in the number, size and quality of released image datasets. At the same time, many of these datasets, especially those collected in the wild, contain private information, such as, faces, house numbers and license plates. Responsible data release must ensure that this information stays hidden, while still retaining the usefulness of the released data for model-training. The typical pipeline for data release has two steps. First, regions of the image containing private information such as a face or a license plates are detected using an automatic detector; these regions are then obfuscated. The standard way for obfuscation is Gaussian blurring: this convolves the image with a Gaussian kernel and renders it visually unrecognizable. Practical forms of Gaussian blurring are implemented by libraries such as PIL and OpenCV, and sometimes involve multiple iterations of blurring together with rounding to lower precision for efficiency. In this work, we take a closer look at this second step of obfuscation and measure its privacy-utility tradeoff in detail. Prior work 27 has looked at the evaluating only the accuracy of models when trained on Imagenet where faces are Gaussian blurred or cropped. In contrast, we look at a broader spectrum of obfuscation methods, datasets and tasks, and evaluate both privacy and utility. In particular, in addition to Gaussian blurring and cropping, we look at two other obfuscation methods: pixelization, which involves dividing the image into blocks and replacing each block by the average pixel color, and pixelization followed by noise-addition (DP-Pix 7 ). We also look at two more relevant computer vision tasks: representation learning on MetaCLIP and pose estimation on MS-COCO. We evaluate privacy via two different empirical attacks. The first is the reversal attack, where the goal is to partially or completely reconstruct the private information present in an obfuscated image; for example, reconstruct an entire face so that it is recognizable. We introduce a new optimization-based method for executing a reversal attack. A second, weaker, attackis the discrimination attack, which has also been considered in prior work 18 ; 14 . Here the private information can only take a limited number of options (such as, letters and digits), and our goal is to determine the option the obfuscated information came from, given an auxiliary sample of obfuscated images and their labels. For example, if we are looking to obfuscate an image which could be either 0 or 1 , then our goal is to infer which digit it is, given a sample of similarly obfuscated 0 s and 1 s. Our experiments reveal an interesting pattern. In terms of privacy, as expected, cropping is the most private and is not susceptible to either attack. However, Gaussian blurring, the most popular obfuscation method is highly non-private in its practical implementations, and is susceptible to both reversal and discrimination attacks. In contrast, pixelization and DP-Pix, when used with the right parameters, cannot be reversed reliably. In addition, in simple OCR datasets such as MNIST these methods are amenable to discrimination attacks, but in more complex datasets such as SVHN, they are less so. In terms of utility, we find that cropping, Gaussian blurring and pixelization and DP-pix form a privacy-utility curve. Cropping is the most private and the least accurate, particularly in use-cases involving pose estimation. Gaussian blurring is the least private and most accurate. Pixelization and DP-Pix fall somewhere in between the two extremes - more privacy than Gaussian blurring for slightly less accuracy. We also find that for most tasks, the loss of utility of these two methods over Gaussian blurring is quite minimal. Our findings suggest that pixelization and DP-Pix are good alternatives to Gaussian blurring for private information obfuscation in images. To summarize, our contributions are as follows: • We propose a new privacy measurement framework for private information obfuscation in image with two empirical tests: reversal and discrimination attacks. • We provide a simple and novel reversal attack that applies to practical versions of Gaussian blurring. • We provide a novel privacy analysis for different image obfuscation methods. • We evaluate four image obfuscation methods for privacy and utility. We find that Gaussian blurring is the least private, being susceptible to reversal and discrimination attacks, and less private pixelization and DP-Pix. • We find that Gaussian blurring has the highest utility, followed by pixelization and DP-Pix, followed by cropping. While cropping has a bit lower utility for pose estimation tasks, for most standard benchmark tasks, the drop in accuracy due to face obfuscation is minimal. 2 Related Work There is a body of scientific literature on privacy in visual data as well as privacy-preserving machine learning. 2.1 Obfuscation Methods The standard approach to releasing image data while ensuring privacy is to detect sensitive information such as faces and license plates and then obfuscate them. The main methods available for obfuscation are blurring, pixelization (also known as mosaicing), noise-addition (such as DP-Pix 7 ), and in-painting 28 . The most popular method is blurring, where private information is convolved with a Gaussian kernel. This leads to good visual quality, but private information in the form of pixels still remains in the image even though not in human-perceptible form. Examples include 8 , which detects and blurs faces and license plates in Google Street View, and recently released image and video datasets such as the AViD dataset 22 among others. An alternative to blurring is pixelization, also known as mosaicing, where the image is broken down into blocks, and the average value of pixels in each block is reported. This offers more privacy due to information loss, but is used less frequently in data release due to poor visual quality of

Read the complete text