MGI: Member vs Generated Inference

Bihe Zhao, Michel Meintz, Juangui Xu, Franziska Boenisch, Adam Dziedzic · 2026

Read MGI: Member vs Generated Inference by Bihe Zhao, Michel Meintz, Juangui Xu, Franziska Boenisch, Adam Dziedzic (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-23872.txt.

Introduction

Zhao, Meintz, Xu, Boenisch, and Dziedzic define a new forensic question for generative AI. Was this sample in the model's training data, or did the model create it? Their 2026 paper tackles that question. The two cases are hard to separate because models memorize training data and can regenerate near copies of it. Existing membership inference methods systematically mistake generated samples for training members. Attribution methods make the opposite error. Both lean on likelihood signals that run high for training data and model outputs alike.

Their method, Data Circuit Breaker, combines signals from a generative model's autoencoder and its latent generator in three stages. Across image autoregressive and diffusion models, it separates members from generated samples where older methods fail. It stays effective even for near duplicate reproductions, and generalizes to derivative models trained on generated data.

Catalog record

CREATORBihe Zhao, Michel Meintz, Juangui Xu, Franziska Boenisch, Adam Dziedzic
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE68 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.23872

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

MGI: Member vs Generated Inference Bihe Zhao, Michel Meintz, Juangui Xu, Franziska Boenisch, Adam Dziedzic Abstract As generative models increasingly produce samples that are indistinguishable from human-created content, it becomes difficult to determine whether a given data point was part of a model’s natural training set or was generated by the model itself, especially when models memorize and reproduce training data. We formalize this challenge as Member vs Generated Inference (MGI): given a sample and a target generative model, infer whether the sample is a true training member or a generated output of that model. Focusing on image generation, we show that existing membership inference methods systematically misclassify generated samples as training members, while attribution-based methods often misclassify true members as generated. This failure arises because both approaches rely on likelihood-related signals that are similarly elevated for training examples and for the model’s own outputs. To address MGI, we propose Data Circuit Breaker (DCB), a three-stage method that combines complementary signals from a generative model’s autoencoder and latent generator to distinguish training members from generated samples. Across multiple generative models, including image autoregressive and diffusion models, DCB consistently addresses the shortcomings of membership inference and attribution methods, remains effective even when models reproduce near-duplicates of training samples, and generalizes to challenging model derivative settings in which new models are trained on generated data. 1 Introduction Figure 1 : Overview of the new Member vs Generated Inference (MGI) task. The core challenge is separating genuine training membership from model generation, even across chains of models trained on generated data. Let N=N_{M}\cup N_{N} denote a natural dataset, where N_{M}\cap N_{N}=\varnothing . A generative model \mathcal{M}_{1} is trained on the member set N_{M} , while N_{N} is held out as natural non-member data. After training, \mathcal{M}_{1} produces a generated dataset G=G_{M}\cup G_{N} , with G_{M}\cap G_{N}=\varnothing . Here, G_{M} and G_{N} are both generated by \mathcal{M}_{1} and therefore follow the same generated-data distribution, but they play different roles in downstream settings: G_{M} is used to train a new model \mathcal{M}_{2} , whereas G_{N} is withheld and serves as generated non-member data for \mathcal{M}_{2} . The new model \mathcal{M}_{2} is thus trained on generated members G_{M} rather than natural members N_{M} . The new model \mathcal{M}_{2} in turn generates a new dataset G^{\prime}=G^{\prime}_{M}\cup G^{\prime}_{N} , where G^{\prime}_{M}\cap G^{\prime}_{N}=\varnothing ; samples in G^{\prime}_{M} may be used to train further downstream models such as \mathcal{M}_{3} , while G^{\prime}_{N} remains withheld. Under this setup, MGI asks whether a given sample should be attributed to training data or to model-generated data. For the original model \mathcal{M}_{1} , the task is to distinguish among {N_{M},N_{N},G} , separating true natural training members N_{M} from natural non-members N_{N} (as in the canonical membership inference task) and from model’s \mathcal{M}_{1} generated samples G . For the derivative model \mathcal{M}_{2} , the task becomes: distinguish among {G_{M},G_{N},G^{\prime}} , separating generated training members G_{M} from both generated non-members G_{N} and from model’s \mathcal{M}_{2} generated samples G^{\prime} . We can further incorporate the natural samples N as \mathcal{M}_{2} ’s non-member data, however, the G_{N} represents the most difficult case of the non-member data. Generative models are now trained on massive internet data and generate high-quality samples at an unprecedented speed. These models also inadvertently memorize some of their individual training inputs and later recreate them as outputs 11 ; 3 . The fact that the outputs from generative models are indistinguishable from real data blurs the boundary between a model’s training and generated data . We formalize this challenge as the Member vs Generated inference (MGI) task: given an image and a target generative model, decide whether the sample is a true training member of that model or a generated output by the same model. We illustrate the MGI task in the overview Figure 1 for a direct training and a model derivative setting. In the direct training setting with model \mathcal{M}_{1} , the goal is to distinguish natural training members N_{M} from images G generated by the model. Even in this seemingly simple setting, MGI is fundamentally harder than standard membership inference: generated images are optimized under the same latent distribution as training members, causing their likelihood-based scores to overlap heavily, as we demonstrate in Section 4 . We further explore a more challenging and practically relevant model derivative setting, where the samples generated by \mathcal{M}_{1} are (potentially published online, then scraped from the internet, and) used to train the subsequent model version \mathcal{M}_{2} . In this regime, members are no longer purely natural samples, and simply separating natural from generated content is insufficient. Both membership inference and attribution methods degrade further in the \mathcal{M}_{2} setting, where generated training data introduces compounding ambiguity between membership and generation signals. Focusing on image generation, we firt show that existing membership inference methods 11 ; 29 ; 34 are inadequate for MGI: they are designed to separate training members from held-out natural data, and consequently tend to incorrectly label model-generated (but non-member) samples as members. Conversely, attribution methods that aim to determine whether a sample was generated by a particular generative model 4 are also insufficient, often failing by labeling training members as generated. Both failures stem from the same underlying cause: the outputs for the new powerful generative models are derived directly from the training samples of generative models themselves. As a result, signals based on likelihood or output probabilities are similarly high for both true members and the models’ own outputs, breaking the assumptions underlying prior methods. To address the MGI challenge for modern image generative models, we propose a new method Data Circuit Breaker (DCB). 1 1 1 A circuit breaker is an electrical safety device designed to protect an electrical circuit from damage caused by current in excess of that which the equipment can handle. In our case, DCB can protect new models, for example, from degrading in performance by preventing their training on significant amounts of their own generated data. Our DCB method treats the generation pipeline holistically rather than focusing solely on the latent generator. The key insight is that while the latent generator produces high scores for members and generated samples, the autoencoder introduces measurable artifacts: generated samples, having passed through the full encode-decode pipeline, exhibit lower reconstruction and quantization errors than natural data points under the autoencoder. DCB exploits this by proceeding in three stages: (1) an autoencoder-based filtering step that identifies generated samples, separating them from non-generated data points; (2) a membership inference step on the non-generated samples using the latent generator, where the standard assumption that members score is restored; and (3) a cross-generator attribution step that compares conditional log-probabilities across multiple model versions to distinguish among the generated samples from different generators. Together, these stages enable DCB to solve MGI even in the most difficult cases of training data memorization. Overall, our contributions are as follows: 1. New task. We introduce Member-vs-Generated Inference (MGI) task, which asks whether a given sample is a true training member of a generative model or an output example generated by that same model. 2. Limits of prior work. We demonstrate that existing approaches are insufficient for MGI: Membership inference methods systematically misclassify generated samples as members, while attribution methods often

Read the complete text