MIRAGE : Protecting against Malicious Image Editing via False Moderation
Anshul Nasery 1 , Ramnath Kumar 2 , Cho-Jui Hsieh 2,3 , Sewoong Oh 1 · 2026
Read MIRAGE : Protecting against Malicious Image Editing via False Moderation by Anshul Nasery 1 , Ramnath Kumar 2 , Cho-Jui Hsieh 2,3 , Sewoong Oh 1 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-26199.txt.
Introduction
Anshul Nasery, Ramnath Kumar, Cho-Jui Hsieh, and Sewoong Oh protect personal photos by tripping the safety filters of AI editors. Modern editing tools can alter any portrait at scale with little effort. Older immunization tricks perturb the image against the editor itself. Those tricks need model weights and the attacker's prompt, which commercial systems hide. Every big editor, though, runs a pre-generation moderation check. That shared checkpoint is the attack surface.
MIRAGE perturbs a photo so moderation classifiers read it as policy-violating. Any edit request then triggers an automatic refusal, whatever the prompt says. Alignment is tuned in the representation space of open-source embedding and moderation models. Success against closed commercial editing services tops eighty-eight percent in their tests. The method is prompt-agnostic and needs no access to the target editor. A refusal, normally the annoying outcome, becomes the shield.
Catalog record
| CREATOR | Anshul Nasery 1 , Ramnath Kumar 2 , Cho-Jui Hsieh 2,3 , Sewoong Oh 1 |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 69 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.26199
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
MIRAGE : Protecting against Malicious Image Editing via False Moderation Anshul Nasery 1 , Ramnath Kumar 2 , Cho-Jui Hsieh 2,3 , Sewoong Oh 1 Abstract The proliferation of AI-powered image editing systems raises serious concerns because it allows personal images to be arbitrarily manipulated at scale, with minimal effort, and a lower barrier to entry. Prior work on image immunization adds imperceptible perturbations to an image to protect against unauthorized manipulations. However, these methods usually require access to the model weights and the image manipulating prompt. This significantly limits their use, especially against powerful commercial image-editors such as GPT-Image, Gemini Flash Image (Nano Banana), and Grok Imagine. To address this, we take a system-level view of the problem and identify a previously unexplored attack surface common to all major commercial image editing systems: pre-generation safety moderation. Rather than disrupting the generative model itself, we propose to immunize images by causing these moderation classifiers to flag images as policy-violating, triggering an automatic refusal regardless of the editing prompt. We operationalize this by adding adversarial perturbations to align our image to policy-violating concepts in the representation space of an ensemble of open-source embedding and moderation models. We call our method Mirage , which stands for Moderation Induced Resistance Against Generative Editing. We evaluate Mirage against multiple closed-source image editing APIs and demonstrate success rates of more than 88%. Our approach is simple, prompt-agnostic, and effective, offering a practical path towards protecting personal images from unauthorized AI-powered editing. I Introduction The rapid advancement of AI-powered image editing has fundamentally lowered the barrier to realistic, large-scale photo-manipulation. Systems such as OpenAI’s GPT-Image [ 42 ] , Google’s Gemini [ 27 ] , and xAI’s Grok [ 65 ] allow any user to upload any image and apply sophisticated, semantically meaningful edits through natural language prompts. This includes changing a person’s appearance, altering their surroundings, or placing them in entirely fabricated scenarios. While these capabilities can serve genuine creative tasks, they simultaneously enable a new class of consent violations; individuals’ personal photographs and images can be maliciously edited without their knowledge or agreement, enabling fraud [ 18 ] , harassment [ 24 , 9 , 55 , 8 , 51 ] , defamation [ 5 , 47 ] , political disinformation [ 41 , 50 ] , and identity manipulation [ 52 ] , at a scale previously impossible. In response to this escalating threat, the research community has proposed a series of solutions for image immunization : adding visually imperceptible perturbations to an image that cause the image-editing models to fail. However, all existing methods suffer from the lack of transferability in both the models and the prompts. Popular methods, including PhotoGuard [ 54 ] , EditShield [ 12 ] , and others [ 28 , 19 , 34 , 46 ] , require white-box access to the model weights and also the prompt, that are to be used by the perpetrator. Image perturbations optimized for one open-source model and for one prompt do not reliably transfer to different models and prompts. In Figure 3 , for example, we empirically demonstrate that none of the existing immunization methods are effective against closed-source black-box commercial APIs. This leaves the independent individuals who own and share images and photos almost entirely unprotected against an adversary with easy access to the most powerful and widely-used systems from companies like OpenAI, Google, and xAI. This leads to a fundamental question in making image immunization practical: is there an image immunization method that can protect against the frontier AI-powered image editors like GPT-Image [ 42 ] , Google’s Nano Banana [ 27 ] , and Grok Imagine [ 65 ] ? Further, we want a single immunized image to universally work for all these powerful systems and for all image editing prompts, simultaneously. One could attempt to use black-box adversarial attacks, which rely on zeroth-order optimization methods, to directly immunize images against editing by frontier API systems, e.g., [ 2 , 13 , 29 , 11 , 6 , 63 ] . However, such methods have large, dimension-dependent query complexity [ 20 ] . For images, this means that one needs to query the API thousands of times. This is prohibitively expensive, both in terms of cost (over 50 USD per image) and time (about 15-30 seconds per API call). Alternatively, universal perturbation approaches designed to transfer to any image-editors, such as [ 1 , 31 ] , have been introduced. However, these techniques require a large ensemble of surrogate models that includes models with similar architecture to the target models. With commercial, black-box image editing systems, one cannot make any claims about the architecture of the underlying model, hence such universal perturbations are ineffective in immunizing images, as we see in Fig. 3 . We also provide qualitative examples in Figs. 13 and 14 . Fig. 1 : Overview of the image immunization framework . (Left - Without Immunization): Given a source image (a cat sitting outdoors), an adversary can pair it with a (potentially malicious) instruction ( “Put in a cage” ) and feed it to a black-box image-editing model (e.g., Gemini, OpenAI, or xAI). The model complies with the instruction, producing an image (in which the cat appears behind cage bars). (Right - With Immunization): To protect against such edits, an image owner could immunize their image. Our immunization pipeline takes in a set of unsafe target images \mathcal{T} (representing moderation triggering inputs) along with the source image. It perturbs the source image to produce a visually similar immunized image. When this immunized image is subsequently submitted to the same image-editing model alongside the same instruction, the model refuses to comply and returns a content policy violation message (e.g. “I am sorry, I cannot help.” ). To this end, we take a system-level view of current frontier closed-source image-editing systems and identify a fundamental structural property: all major commercial APIs implement responsible-use policies enforced by a safety classifier. Before any edits are produced, each system passes the input image through a moderation pipeline; if the image is flagged as policy-violating, the system refuses to generate output entirely, regardless of the prompt. We propose to turn this safety mechanism, originally intended to prevent misuse, into a defensive tool for the image owners. We call this new paradigm false moderation : adding visually imperceptible perturbations to an image that cause the safety classifier of a commercial image-editing API to flag the immunized image as policy-violating, producing a refusal that is prompt-agnostic. Attacking closed-source safety classifiers poses a challenge: we do not have direct access to them. We address this through transfer-based adversarial attacks over an ensemble of open-source models [ 73 ] , including CLIP-style vision-language encoders, and open moderation models such as ShieldGemma [ 68 ] . The main idea of our method is summarized in Fig. 1 . We first investigate the terms of use of the systems we want to immunize against, xAI’s Grok [ 64 ] , Google’s Gemini [ 26 ] , OpenAI’s GPT-Image [ 43 ] , and extract text descriptions or images associated with policy-violating content categories. We use these to guide the image perturbation to make the image seem