Unlocking Visual Secrets: Inverting Features with Diffusion Priors for Image Reconstruction
Sai Qian Zhang 1 , Ziyun Li 2 , Chuan Guo 2 , Saeed Mahloujifar 2 , Deeksha Dangwal 2 , Edward Suh 3 , Barbara De Salvo 2 and Chiao Liu 2 · 2024
Read Unlocking Visual Secrets: Inverting Features with Diffusion Priors for Image Reconstruction by Sai Qian Zhang 1 , Ziyun Li 2 , Chuan Guo 2 , Saeed Mahloujifar 2 , Deeksha Dangwal 2 , Edward Suh 3 , Barbara De Salvo 2 and Chiao Liu 2 (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-10448.txt.
Introduction
What a neural network remembers of a photo can leak the photo itself. A 2024 paper by Sai Qian Zhang and co-authors improves a method for rebuilding images from those inner features. Such inversion matters most where networks are split across devices, since the shared features may expose private pictures.
The team uses diffusion models, strong image generators, as a prior guide for the rebuild. They also test extra help from text prompts and from links between frames of video. The diffusion-guided rebuilds came out clearly better than those from older methods. The findings show how much visual detail hides in network features, a warning for anyone who shares them.
Catalog record
| CREATOR | Sai Qian Zhang 1 , Ziyun Li 2 , Chuan Guo 2 , Saeed Mahloujifar 2 , Deeksha Dangwal 2 , Edward Suh 3 , Barbara De Salvo 2 and Chiao Liu 2 |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 67 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2412-10448
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Unlocking Visual Secrets: Inverting Features with Diffusion Priors for Image Reconstruction Sai Qian Zhang 1 , Ziyun Li 2 , Chuan Guo 2 , Saeed Mahloujifar 2 , Deeksha Dangwal 2 , Edward Suh 3 , Barbara De Salvo 2 and Chiao Liu 2 Abstract Inverting visual representations within deep neural networks (DNNs) presents a challenging and important problem in the field of security and privacy for deep learning. The main goal is to invert the features of an unidentified target image generated by a pre-trained DNN, aiming to reconstruct the original image. Feature inversion holds particular significance in understanding the privacy leakage inherent in contemporary split DNN execution techniques, as well as in various applications based on the extracted DNN features. In this paper, we explore the use of diffusion models, a promising technique for image synthesis, to enhance feature inversion quality. We also investigate the potential of incorporating alternative forms of prior knowledge, such as textual prompts and cross-frame temporal correlations, to further improve the quality of inverted features. Our findings reveal that diffusion models can effectively leverage hidden information from the DNN features, resulting in superior reconstruction performance compared to previous methods. This research offers valuable insights into how diffusion models can enhance privacy and security within applications that are reliant on DNN features. I Introduction Inverting visual features within DNNs presents a significant challenge in the realm of privacy for deep learning. The primary goal of feature inversion is to reverse the outputs (or intermediate results) of a pre-trained DNN and reconstruct the original image. This form of privacy attack, known as feature inversion attack , can raise privacy concerns across various domains. Modern systems that perform face recognition [ 1 , 4 , 56 , 6 , 8 , 32 ] , AR/VR applications [ 40 , 20 , 72 , 11 ] , and image or text retrieval [ 74 , 36 , 37 , 58 , 10 ] often store and process auxiliary data in the form of extracted features from the original input. For example, in a face recognition system, the human face is first encoded with a DNN encoder (e.g., FaceNet [ 56 ] , CLIP [ 8 , 57 ] ) and the resultant feature vector is then searched over the database for identity matching via vector comparisons. Feature inversion attacks can be used to reconstruct the face of private users [ 43 ] . Moreover, feature inversion attack also leads to a serious privacy leakage in the Split DNN computing paradigm [ 22 , 48 , 28 , 61 , 62 , 71 , 7 , 15 , 29 , 38 , 47 , 31 , 19 , 69 , 14 , 27 , 44 , 45 , 2 , 3 ] . Within this paradigm, a layer-wise partitioning of the pretrained DNN into two or more blocks, aligning with the computational capabilities of the edge devices, as shown in Figure 1 . During the execution, the user data is first processed using one or more local DNNs that contain the initial layers. The intermediate results are then transmitted to the central server for the execution of subsequent DNN layers. Split DNN computing has been widely adopted to accommodate the execution of increasingly large DNN on resource-constrained devices like mobile phones, and is believed to enhance user privacy by keeping user data on the local device—only the intermediate features are sent to the less secure cloud environment. However, this privacy enhancement turns out to be frail, as recent studies have shown that the intermediate features can be inverted via feature inversion attacks to reconstruct user inputs from the intermediate outputs of parts of the DNN [ 42 , 17 , 23 , 16 , 41 , 58 , 46 ] . Fig. 1: The DNN undergoes layer-wise partitioning and is divided between the edge and the cloud, with the intermediate features being transferred between them. In this example, we focus on the presence of a single edge device. The broad applicability of feature inversion renders it a fundamental problem in ML security and privacy. On the other hand, feature inversion is not an easy task, particularly when dealing with features extracted from later layers of a network. Intuitively, the learned feature contains more high-level semantic information about objects in an image but less information about the raw input as depth increases. As a result, nearly all of the existing feature inversion methods fail when attempting to invert features from later layers of a deep network. This explains why much of the existing research concentrates on feature inversion for shallow DNNs with lower input resolutions [ 42 , 17 , 23 , 41 ] . The recent advancement of generative AI (GenAI) models opens up new possibilities to improve the quality of feature inversion attacks through their comprehensive understanding of image data distributions across real-world scenes. Among the multitude of existing GenAI techniques, Diffusion Models (DMs) [ 24 ] have emerged as a remarkable breakthrough in generative modeling. Through extensive training with vast datasets comprising millions of real-world images, DMs obtain a high-quality, photorealistic image generation capability. In this work, we demonstrate that recent advancements in DMs can be utilized to greatly enhance feature inversion. Instead of inverting DNN features directly to image pixels, we aim to recover the input vector in the latent space of a latent diffusion model (LDM) that, when converted to an image through reverse diffusion and forwarded through the DNN, matches the target DNN features. In addition, another noteworthy feature of DMs is their capacity to take textual descriptions as input and produce synthetic outputs conditioned on these textual prompts. We also demonstrate that this capability enables the attackers 1 1 1 In this paper, we will employ the terms ”attacker” and ”adversary” interchangeably. to specify the prior knowledge of a target image with natural language to utilize their existing knowledge about the victims, if available, by providing a textual description to DMs. Doing so enables the inversion of features that are much deeper into the network. Finally, in practice, as edge devices often process a continuous stream of input frames, we propose another variant that uses the temporal correlation in the features between consecutive input frames to enhance the reconstruction quality. Our main contributions are as follows: • Feature inversion using diffusion model prior. We demonstrate that the exceptional image generation capabilities of DMs can be effectively employed to improve DNN feature inversion. We explore two threat models that closely describe the practical scenarios. To the best of our knowledge, this marks the first research endeavor showing the use of DMs for enhancing DNN feature inversion. • Incorporating textual prior for feature inversion. We demonstrate that incorporating textual prior information about user inputs can significantly enhance the quality of feature inversion. To integrate this textual prior knowledge and achieve improved feature inversion quality, we introduce new training loss terms as a part of the inversion process. • Feature inversion for videos. When processing a sequence of temporally correlated inputs, we show that feature inversion can be further enhanced by considering the temporal correlation among consecutive input frames. • The evaluation results show that our