A Systemic Evaluation of Multimodal RAG Privacy

Ali Al-Lawati, Suhang Wang · 2026

Read A Systemic Evaluation of Multimodal RAG Privacy by Ali Al-Lawati, Suhang Wang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-17644.txt.

Introduction

Ali Al-Lawati and Suhang Wang evaluate privacy in multimodal retrieval-augmented generation. Such pipelines link private datasets to vision tasks like visual question answering. The link boosts model quality on private data. It also risks leaking that data at inference time. The authors run a systemic evaluation of that risk. Their study maps where leaks arise in the pipeline.

Firms want RAG gains without exposing client data. A clear leak map shows what to guard first. Tests can then check if guards work. The work serves teams that deploy vision RAG in health, law, and retail. Privacy by design needs proof, not hope. This evaluation gives a base for both.

Catalog record

CREATORAli Al-Lawati, Suhang Wang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE49 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-17644

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

A Systemic Evaluation of Multimodal RAG Privacy Ali Al-Lawati, Suhang Wang Abstract The growing adoption of multimodal Retrieval-Augmented Generation (mRAG) pipelines for vision-centric tasks (e.g. visual QA) introduces important privacy challenges. In particular, while mRAG provides a practical capability to connect private datasets to improve model performance, it risks the leakage of private information from these datasets during inference. In this paper, we perform an empirical study to analyze the privacy risks inherent in the mRAG pipeline observed through standard model prompting. Specifically, we implement a case study that attempts to infer the inclusion of a visual asset, e.g. image, in the mRAG, and if present leak the metadata, e.g. caption, related to it. Our findings highlight the need for privacy-preserving mechanisms and motivate future research on mRAG privacy. Our code is published online: https://github.com/aliwister/mrag-attack-eval. 1 Introduction Multimodal retrieval-augmented generation (mRAG) 18 has shown great ability in improving the performance of vision-language models (VLMs) 2 and reducing their hallucinations 11 . Generally, given a user prompt that includes an image and a question, a typical mRAG pipeline utilizes a retriever to retrieve relevant images and their metadata, such as captions, from a private database (See Figure 1 ). The retrieved set is further refined using a cross-modal reranker to improve context relevance. The resulting set is then included in the user prompt as input to the VLM to generate a textual response 8 . mRAG enables VLMs to ground their responses on multimodal relevant information, facilitating various tasks that require cross-modal understanding, e.g., visual grounding 37 , visual QA (VQA) 17 , and image captioning 31 . Figure 1: mRAG Pipeline for VLMs Though mRAG can improve multimodal reasoning in VLMs, it also introduces the risk of inadvertently leaking retrieved private information during inference. This may include exposure of sensitive images and their metadata, which can have significant privacy implications. For example, in healthcare, it can reveal the presence of a patient’s medical scan in a clinical retrieval system or disclose confidential diagnostic notes from captioned radiology images 7 , thereby posing serious risks to patient privacy and regulatory compliance. Despite these risks, only a very few studies 40 ; 11 have examined the privacy implications of mRAG. Therefore, in this paper, we address this gap by systemically studying a novel problem from an attacker’s perspective, i.e., assess whether a visual asset is present in the mRAG private image-caption database and, if confirmed, to extract its metadata. Such attack has many real-world applications. For example, an attacker who possesses a patient’s medical scan but lacks the corresponding patient information may attempt to (1) verify whether the scan is in the database, i.e., perform a membership inference attack (MIA), and (2) extract patient information associated with the scan, i.e., conduct image caption retrieval (ICR). Similarly, an artist or image owner may submit their visual asset to mRAG to verify if it is in the database for copyright protection and to retrieve associated private metadata, helping identify incorrect or harmful captioning that could negatively affect the owner. In particular, this perspective requires us to account for the fact that visual assets may not be stored in the mRAG database in their original form. Images may undergo post-processing, such as rotation, cropping, or masking, which confounds not only the VLM’s generation behavior, but also the retrieve-rerank mechanism in the mRAG pipeline. Thus, we raise the following research questions: • ( RQ1 : MIA) Can the presence of a specific image within the mRAG database in original or transformed form (e.g. rotated, cropped, etc) be detected using targeted prompts? • ( RQ2 : ICR) If an image is known to exist in the mRAG database in original or transformed form (e.g. rotated, cropped, etc), can its associated caption be extracted through targeted prompts? These research questions capture the privacy concerns arising from both the image and text modalities within mRAG systems. Following prior work in the context of RAG privacy 11 ; 40 , we adopt a black-box setting, where the attacker can only interact with the system through its API, and is limited to crafting a textual prompt with a target image. The RAG privacy study by 43 is closely related to this work, however, we specifically focus on mRAG for VLMs, which introduces distinct modality challenges not present in text-only RAG. To address these research questions, we conduct comprehensive experiments under various scenarios targeting different forms of leakage. For RQ1 , we investigate whether an attacker is able to identify whether their input image is part of the private database by querying the mRAG pipeline using the input image and an attack prompt. We first evaluate the attack when the input image is an exact copy of the mRAG image. We evaluate the model output (’Yes’ or ’No’) against the ground truth. Next, we transform the images in mRAG database (crop, mask, etc), and examine how each transformation affects attack success. Based on these experiments, we observe that the attacker can achieve high success rate (0.993 F1-score) under exact image setting, and very slight-to-modest reduction in F1-score (0.96 to 0.60 average F1-score) under transformed image setting. Though the attack success rate decreases under image rotation (0.60 F1-score), it still poses a non-negligible risk in real-world deployments. This indicates that mRAG remains vulnerable to MIA even when its images are perturbed. For RQ2 , we explore whether the attacker is able to retrieve the exact caption from the mRAG database when the input image is an exact copy of the mRAG image and how transformations (e.g., crop, mask) affect attack success. We compare the output text with the ground truth using exact-match , and other text metrics. Our experiments show that attack success rate varies depending on image complexity , e.g. success rates on medical imaging datasets are lower than on other (simpler) image datasets (0.41 vs. 0.75 on average exact-match). Also, similar to our findings in RQ1, image transformations further reduce attack performance, resulting in a reduction of up to 72% on exact-match under image rotation . We further consider two practical dimensions that influence attack behavior: prompt structure and retrieval configurations . The first focuses on the prompt formulation itself, assessing whether changes in mRAG context composition affect the model’s susceptibility to leakage. The second dimension examines how variations in context size, candidate pool size, and reranking affect the extent of privacy exposure. Together, these analyses provide a nuanced understanding of how system-level design choices affect privacy. In particular, we observe high sensitivity to image ordering, as placing the input image before the retrieved set substantially reduces leakage compared to putting it after . We also find that rerank provides consistent mitigation on the ICR attack, but its effectiveness is dataset-dependent and retrieval size dependent – attack success rate increases as the size of the retrieved set included in the prompt context increases. Our main contributions are: (i) we conduct a systematic analysis of MIA and ICR attacks on image-centric mRAG under realistic visual transformations; (ii) we perform multiple ablation studies exploring the effects of prompt structure and variations on retrieve–rerank configurations; and (iii) we provide empirical insights on potential mitigation strategies. Our findings highlight an emerging need for privacy-aware mRAG.

Read the complete text