Privacy-Shielded Image Compression: Defending Against Exploitation from Vision-Language Pretrained Models

Xuelin Shen, Jiayin Xu, Kangsheng Yin, Wenhan Yang · 2025

Read Privacy-Shielded Image Compression: Defending Against Exploitation from Vision-Language Pretrained Models by Xuelin Shen, Jiayin Xu, Kangsheng Yin, Wenhan Yang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-15201.txt.

Introduction

Xuelin Shen and co-authors design image compression that shields photos from AI reading. Their 2025 paper starts from a new privacy risk: vision-language models can mine posted images for meaning their owners never meant to share. The defense is placed at compression time, before an image ever reaches a platform.

Their scheme writes a single bitstream with more than one valid decoding. By default it rebuilds a good-looking image that the big models cannot interpret. With the right condition supplied, the same stream rebuilds the full original, meaning intact. A trigger module steers which version appears, and the training objective leans on the target model's own uncertainty. The authors add a balancing strategy so quality and privacy can be traded smoothly.

Catalog record

CREATORXuelin Shen, Jiayin Xu, Kangsheng Yin, Wenhan Yang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE34 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-15201

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Privacy-Shielded Image Compression: Defending Against Exploitation from Vision-Language Pretrained Models Xuelin Shen, Jiayin Xu, Kangsheng Yin, Wenhan Yang Abstract The improved semantic understanding of vision-language pretrained (VLP) models has made it increasingly difficult to protect publicly posted images from being exploited by search engines and other similar tools. In this context, this paper seeks to protect users’ privacy by implementing defenses at the image compression stage to prevent exploitation. Specifically, we propose a flexible coding method, termed Privacy-Shielded Image Compression (PSIC), that can produce bitstreams with multiple decoding options. By default, the bitstream is decoded to preserve satisfactory perceptual quality while preventing interpretation by VLP models. Our method also retains the original image compression functionality. With a customizable input condition, the proposed scheme can reconstruct the image that preserves its full semantic information. A Conditional Latent Trigger Generation (CLTG) module is proposed to produce bias information based on customizable conditions to guide the decoding process into different reconstructed versions, and an Uncertainty-Aware Encryption-Oriented (UAEO) optimization function is designed to leverage the soft labels inferred from the target VLP model’s uncertainty on the training data. This paper further incorporates an adaptive multi-objective optimization strategy to obtain improved encrypting performance and perceptual quality simultaneously within a unified training process. The proposed scheme is plug-and-play and can be seamlessly integrated into most existing Learned Image Compression (LIC) models. Extensive experiments across multiple downstream tasks have demonstrated the effectiveness of our design. † † affiliationnotice: Equal contribution Figure 1: In the default protected coding mode, our compression model protects images by preserving content similar to the original, while concealing machine-perceived semantics. Additionally, the model can encode images in a way that maintains both critical pixel fidelity and semantics. 1 Introduction In recent years, the rapid advancement of large-scale Vision-Language Pretrained (VLP) models has transformed traditional task-specific approaches, significantly improving the performance across a range of vision tasks. State-of-the-art VLP models, such as Contrastive Language-Image Pre-training (CLIP) ( Radford et al. 2021 ) , A Large-scale ImaGe and Noisy-Text Embedding (ALIGN) ( Jia et al. 2021 ) , and InstructBLIP ( Dai et al. 2023 ) , demonstrate excellent performance in a general sense for visual information understanding. They perform well in tasks including not only image–text retrieval ( Fang et al. 2021 ; Ma et al. 2022 ; Luo et al. 2022 ; Yan et al. 2023 ) , image captioning ( Chen et al. 2015 ) , visual question answering ( Antol et al. 2015 ) , cross-modality grounding ( Peng et al. 2023b ) , but also conventional vision tasks including image classification ( Fu et al. 2022 ; Peng et al. 2023a ; Abdelfattah et al. 2023 ) , facial attribute analysis ( Yang et al. 2022 ; Zhou et al. 2024 ) , and image segmentation ( Xu et al. 2022 ; Chen et al. 2023 ) . VLP models are highly effective at capturing semantic information, but this strength also comes with risks. Their powerful ability to analyze semantics raises concerns about privacy and data security. Images shared on community platforms can be easily understood by these models, making it hard to stop them from being indexed by search engines or reused as open data without the user’s permission. For instance, in ( Johan Modin 2022 ) , the authors demonstrate the feasibility of tracking the trajectory of a specific vehicle or person from a gallery of surveillance videos by providing only a textual description to the VLP model. Similarly, by incorporating these powerful VLP models, search engines could more easily retrieve relevant images without the need for handcrafted labels. Under these circumstances, there is significant potential to explore privacy protection approaches in the context of defending against VLP models. This emphasizes the need to protect user data and prevent its misuse. An intuitive idea is to embed certain information into image coding (compression or transcoding) that does not affect visual perception, enabling a universal and efficient way to protect the content of the image. A related research direction focuses on the vulnerability of deep learning models to specific noise patterns. In particular, existing backdoor attack schemes ( Yu et al. 2023 ; Yu et al. 2024 ) follow a similar approach by embedding invisible triggers into input images. These triggers are designed to degrade compression processes and transform them into adversarial attack patterns, effectively misleading downstream machine vision models. Directly applying these methods to address the proposed new problem faces two key challenges: 1) In the context of designing privacy-protecting compression networks, injecting triggers at the input stage inevitably reduces flexibility and compression efficiency. Specifically, this backdoor attack is an irreversible process, leading to a coding practice that requires separate encoding steps—one with trigger injection and one without—in order to generate distinct bitstreams for attacking and normal purposes. 2) Since an ideal privacy-preserving coding could support both visual perception and machine recognition (may under different coding modes), the challenge lies in efficiently coding both types of information and activating them under specific conditions. This issue has not been explored in previous methods. In this paper, we focus on Image Compression problem under the consideration of privacy protection problem and propose a novel Privacy-Shielded Image Compression (PSIC) framework. 1 1 1 Code is available at https://github.com/JiayinXu5499/PSIC. This framework builds on a formulation similar to backdoor attacks and introduces new innovations to significantly improve coding flexibility and efficiency, while also ensuring compactness, human perception compatibility, and encryption requirements, among other valuable attributes. In detail, the proposed PSIC enables a single bitstream to be decoded into two distinct versions through a conditional trigger injection module takes the mode indicator ( encrypted or full ) as an additional input: the encrypted version , produced as default, which embeds invisible attack patterns capable of significantly misleading the targeted VLP model; and the full version , which, with a customizable input condition ( e.g. , keywords), provides the image’s full semantic information. Moreover, to fulfill these mutually exclusive requirements within a single network, the proposed PSIC incorporates an adaptive multi-objective optimization strategy, where the model alternates between training under the rate-distortion and rate-encryption criteria, guided by the corresponding mode indicator. Besides using the intuitive optimization function that minimizes the similarity between the reconstructed image and its corresponding text counterpart (interfering with the fitting to certain labels), we further propose an Uncertainty-Aware Encryption-Oriented (UAEO) optimization function. The proposed UAEO automatically identifies uncertainty among the image-text pairs using the Dempster-Shafer Theory, and to maximize the similarity between cross-modal matches with higher matching uncertainty (forcing fitting to uncertain wrong labels) during the training process. The proposed PSIC scheme is plug-and-play and can be seamlessly integrated into most existing learned image compression (LIC) models. Extensive experiments demonstrate that the proposed scheme effectively conceals privacy information by misleading VLP-based applications, such as text–image retrieval and image captioning, as well as common computer vision tasks like image classification and facial attribute analysis, all while maintaining the same rate-distortion performance as baseline LIC models. We summarize the main contributions as follows: • We propose a flexible image compression network that can adapt to user needs by controlling whether images can be accessed by downstream VLP models, all while maintaining good perceptual

Read the complete text