EL-MIA: Quantifying Membership Inference Risks of Sensitive Entities in LLMs

Ali Satvaty, Suzan Verberne, Fatih Turkmen · 2025

Read EL-MIA: Quantifying Membership Inference Risks of Sensitive Entities in LLMs by Ali Satvaty, Suzan Verberne, Fatih Turkmen (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-00192.txt.

Introduction

Ali Satvaty, Suzan Verberne, and Fatih Turkmen propose EL-MIA, a framework for measuring membership inference risk at the level of sensitive entities in language models. Membership attacks ask whether a particular item was in training data, but existing methods detect whole prompts or documents. Private risk often lives smaller: a name, a card number, or another sensitive entity inside otherwise ordinary text.

A benchmark dataset for entity-level evaluation is constructed, and existing methods are compared systematically on it. Privacy readers get a finer audit for language models. Entity-level leakage is what harms people, so measuring at that granularity aligns the audit with the actual risk.

Catalog record

CREATORAli Satvaty, Suzan Verberne, Fatih Turkmen
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE42 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-00192

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

EL-MIA: Quantifying Membership Inference Risks of Sensitive Entities in LLMs Ali Satvaty, Suzan Verberne, Fatih Turkmen Abstract Membership inference attacks (MIA) aim to infer whether a particular data point is part of the training dataset of a model. In this paper, we propose a new task in the context of LLM privacy: entity-level discovery of membership risk focused on sensitive information (PII, credit card numbers, etc). Existing methods for MIA can detect the presence of entire prompts or documents in the LLM training data, but they fail to capture risks at a finer granularity. We propose the “EL-MIA” framework for auditing entity-level membership risks in LLMs. We construct a benchmark dataset for the evaluation of MIA methods on this task. Using this benchmark, we conduct a systematic comparison of existing MIA techniques as well as two newly proposed methods. We provide a comprehensive analysis of the results, trying to explain the relation of the entity level MIA susceptability with the model scale, training epochs, and other surface level factors. Our findings reveal that existing MIA methods are limited when it comes to entity-level membership inference of the sensitive attributes, while this susceptibility can be outlined with relatively straightforward methods, highlighting the need for stronger adversaries to stress test the provided threat model. 1 Introduction LLMs have demonstrated remarkable capabilities across a wide range of natural language processing tasks, but their deployment raises growing privacy concerns Zhao et al. 2025 ; Chang et al. 2024 ; Yan et al. 2024 ; Dong et al. 2024 . A key risk stems from the memorization of personally identifiable information (PII) present in training data Carlini et al. 2021 ; Lukas et al. 2023 ; Zhou et al. 2024 ; Satvaty et al. 2025a . Prior studies have shown that LLMs can regurgitate sensitive data verbatim or in paraphrased form, enabling membership inference attacks (MIAs) that reveal whether a specific record was used during training. Such leakage has serious implications for user privacy, regulatory compliance (e.g., GDPR, CCPA), and the safe use of LLMs in real-world applications. While existing MIA methods have made significant progress in detecting whether entire documents were present in the training set, it is unclear to what extent they can capture risks at a finer granularity, specifically, entity-level membership risk for individual sensitive attributes such as names, dates of birth, addresses or phone numbers Meeus et al. 2025 . This is of practical relevance since attackers often seek to recover or confirm the presence of particular sensitive fields rather than entire text samples. In this work, we introduce a framework for auditing entity-level membership risks in LLMs. Our approach targets the vulnerability of specific sensitive entities in LLM training, enabling more precise privacy risk assessments and supporting the development of stronger defenses. Figure 1: Entity membership inference threat model We construct a benchmark dataset for evaluating slot-level PII MIA, based on the existing AI4Privacy dataset ai4Privacy 2023 . Using the newly created benchmark, we conduct a systematic comparison of existing MIA techniques, assessing their ability to detect membership of individual sensitive fields rather than long input texts. We also propose two novel methods specifically aimed at entity-level MIA attacks. Our approach reduces the noise of the token-loss signal by normalizing across a reference set and omitting the effect of prefix tokens’ loss. By empirical evaluation we compare the effectiveness of existing as well as new methods. We further perform extensive analyses regarding token length, attribute types, number of links, model size, and training dynamics. In summary, our contributions are threefold: (1) we propose entity-level MIA tailored to the sensitive entities as a new threat model in the context of privacy in LLMs; (2) we present a new dataset, built on top of the AI4Privacy benchmark, to evaluate methods on the newly proposed threat model; 1 1 1 We release the code for creating the dataset from the original AI4Privacy data as well as our methods: https://github.com/alistvt/el-mia-data (3) we evaluate the effectiveness of existing and new methods for entity-level MIA and explain the dynamics of the inference susceptibility of the samples based on various cues. Membership unit Work(s) Granularity Sequence-level Duan et al. \sim n-grams Carlini et al. 2021 ; Shi et al. 2024 32–256 tokens Kaneko et al. 2024 ; Liu et al. 2024 ; Mattern et al. 2023 , Mattern et al. 2023 Variable lengths Document-level Meeus et al. 2024a ; Shi et al. 2024 ; Chang et al. 2023 Full articles, books Dataset-level Maini et al. 2024 ; Hayes et al. 2025a Whole benchmarks/datasets Entity-level This work Entities + Templates Table 1: LLM membership inference attacks by prior work, grouped by the unit of membership (sequence, document, dataset, entity). Our proposed model targets entity-level membership , probing whether a specific sensitive value (e.g., a name or phone number) appeared in training, given the respective context. 2 Background and Related Work Membership inference was first studied in genomics, where researchers asked whether an individual’s data contributed to an aggregate dataset Homer et al. 2008 . The idea later migrated to machine learning, with the seminal attack against deep neural networks showing that models can reveal whether a specific example appeared in training Shokri et al. 2017 . Whereas traditional MIAs in machine learning typically operate on a clearly defined unit such as a single record or image, the notion of membership is more ambiguous in the text domain. 2.1 Granularity of text For text data, most existing work has defined the unit of membership inference as sequences of fixed (often truncated) length. For example, Carlini et al. 2021 employ sequences of 256 tokens, whereas Shi et al. 2024 and subsequent studies Kaneko et al. 2024 ; Liu et al. 2024 ; Mozaffari and Marathe ; Wang et al. 2025 ; Xie et al. 2024b ; Ye et al. 2024 ; Zhang and Wu 2024 ; Zhang et al. 2024 rely on random excerpts ranging between 32 and 256 tokens. When sequences are randomly injected, prior work has considered lengths of up to 80 tokens Wei et al. 2024 or 100 tokens Meeus et al. 2024b . In contrast, some research aims to detect membership at a much larger scale, such as an entire book Meeus et al. 2024a ; Shi et al. 2024 ; Chang et al. 2023 or even a whole dataset Maini et al. 2024 ; Hayes et al. 2025a . In copyright-related settings, for instance, the objective is to determine whether the full content of a source (e.g., a news article or book) was used, rather than only specific excerpts. This has led prior work Zhang and Wu 2024 ; Meeus et al. 2024a ; Duarte et al. 2024 to pursue document- or dataset-level membership inference, where signals are aggregated across broader text units. This progression from fixed-length sequences to document- and dataset-level inference is further summarized in Table 1 . Yet, to the best of our knowledge, no prior work has systematically investigated finer-grained units, such as individual entities Meeus et al. 2025 . Our work aims to close this gap by introducing a benchmark for entity-level membership inference, with an emphasis on sensitive entities, as these pose the most significant privacy and security risks

Read the complete text