Low-Effort Jailbreak Attacks Against Text-to-Image Safety Filters
Ahmed B Mustafa, Zihan Ye, Yang Lu, Michael P Pound, Shreyank N Gowda · 2026
Read Low-Effort Jailbreak Attacks Against Text-to-Image Safety Filters by Ahmed B Mustafa, Zihan Ye, Yang Lu, Michael P Pound, Shreyank N Gowda (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-01888.txt.
Introduction
Mustafa and co-authors show text-to-image models remain open to low-effort jailbreaks using only prompts. Filters aim to block harmful content, yet the authors study prompt tricks bypassing filters without model access, tuning or hostile training. They list jailbreak methods: material substitution, artistic reframing, ambiguous action substitution, pseudo-educational framing, lifestyle camouflage. These tricks exploit gaps in safety filters by masking intent in benign contexts. Tests across text-to-image systems show simple wording changes can evade guards and produce banned imagery, with success up to 74.47 percent.
Catalog record
| CREATOR | Ahmed B Mustafa, Zihan Ye, Yang Lu, Michael P Pound, Shreyank N Gowda |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 38439 |
| LICENSE | http://creativecommons.org/publicdomain/zero/1.0/ |
| RIGHTS | CC0 |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.01888
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Low-Effort Jailbreak Attacks Against Text-to-Image Safety Filters Ahmed B Mustafa, Zihan Ye, Yang Lu, Michael P Pound, Shreyank N Gowda Abstract Text-to-image generative models are widely deployed in creative tools and online platforms. To mitigate misuse, these systems rely on safety filters and moderation pipelines that aim to block harmful or policy violating content. In this work we show that modern text-to-image models remain vulnerable to low-effort jailbreak attacks that require only natural language prompts. We present a systematic study of prompt-based strategies that bypass safety filters without model access, optimization, or adversarial training. We introduce a taxonomy of visual jailbreak techniques including artistic reframing, material substitution, pseudo-educational framing, lifestyle aesthetic camouflage, and ambiguous action substitution. These strategies exploit weaknesses in prompt moderation and visual safety filtering by masking unsafe intent within benign semantic contexts. We evaluate these attacks across several state-of-the-art text-to-image systems and demonstrate that simple linguistic modifications can reliably evade existing safeguards and produce restricted imagery. Our findings highlight a critical gap between surface-level prompt filtering and the semantic understanding required to detect adversarial intent in generative media systems. Across all tested models and attack categories we observe an attack success rate (ASR) of up to 74.47%. Disclaimer: This paper contains unsafe imagery that might be offensive to some readers. 1 Introduction Deep learning has seen remarkable progress in recent years across a wide range of domains such as image classification Gowda and Yuan 2018 ; He et al. 2016 ; Szegedy et al. 2015 . More recently, these advances have extended to generative modeling paradigms. Text-to-image (T2I) generative models such as DALL·E Ramesh et al. 2022 , Stable Diffusion Rombach et al. 2022 , Imagen Saharia et al. 2022 , and Midjourney Midjourney, Inc. 2023 have rapidly advanced the ability to synthesize high-quality images from natural language descriptions. These systems are increasingly integrated into creative platforms, search engines, and content generation tools. To mitigate misuse, T2I models are typically deployed with safety filters and moderation pipelines designed to block the generation of harmful, illegal, or policy-violating visual content. Despite these safeguards, recent work has shown that generative models remain vulnerable to adversarial manipulation at the prompt level Yang et al. 2024b ; Zhang et al. 2025 ; Liu et al. 2024a . In particular, prompt-based jailbreak attacks exploit the semantic flexibility of natural language to bypass safety filters and produce restricted imagery. Unlike optimization-based adversarial attacks, these jailbreaks often require no model access, gradient information, or specialized technical knowledge Wei et al. 2023 ; Perez et al. 2022 ; Mustafa et al. 2025 . Instead, they rely on simple linguistic modifications that disguise unsafe intent within benign or ambiguous prompts. This accessibility significantly lowers the barrier for misuse. Online communities frequently share effective prompt patterns that allow users to generate restricted imagery by embedding unsafe content within artistic, educational, or stylistic contexts. As a result, jailbreak attacks can be performed by non-expert users using only natural language prompts. Figure 1 illustrates this phenomenon: while direct requests for unsafe content are typically blocked by safety filters, minor prompt modifications can circumvent moderation and trigger the generation of restricted visual outputs. Figure 1 : Illustration of low-effort prompt-based jailbreak attacks on text-to-image systems. Direct requests for unsafe content are typically blocked by safety filters, but simple prompt modifications can bypass moderation and produce restricted imagery. These attacks require no model access or technical expertise, highlighting the accessibility of jailbreak strategies in modern generative media systems. Although recent studies have explored adversarial attacks against generative models Yang et al. 2024b ; Zhang et al. 2025 , much of this work focuses on automated optimization techniques or token-level perturbations. In contrast, the risks posed by low-effort prompt engineering remain less systematically studied. In this work, we present a systems-level analysis of prompt-based jailbreak attacks that target safety filters in modern T2I models. Our study focuses on attack strategies that require only natural language prompts and can therefore be easily replicated by everyday users. This work is guided by the following research questions: RQ1. How can prompt-based jailbreak strategies against text-to-image safety filters be systematically categorized? RQ2. What vulnerabilities exist within current moderation pipelines that enable these attacks? RQ3. How do different prompt manipulation strategies disguise unsafe intent within seemingly benign prompts? RQ4. How susceptible are modern text-to-image systems to low-effort prompt-based jailbreak attacks? Our contributions are as follows: 1. We introduce a taxonomy of prompt-based jailbreak strategies for text-to-image models, including techniques such as artistic reframing, material substitution, pseudo-educational framing, lifestyle aesthetic camouflage, and ambiguous action substitution. 2. We present a systems analysis of text-to-image moderation pipelines and identify how different stages of the pipeline can be circumvented through simple prompt manipulations. 3. We conduct empirical case studies demonstrating that low-effort prompt modifications can reliably bypass safety filters and produce restricted imagery across multiple state-of-the-art text-to-image systems. Our findings demonstrate that modern generative media systems remain vulnerable to low-effort jailbreak attacks that exploit the gap between surface-level prompt filtering and deeper semantic understanding. These results highlight the need for more robust and context-aware safety mechanisms capable of detecting adversarial intent in text-to-image generation pipelines. 2 Related Work Safety in Text-to-Image Models. Modern text-to-image (T2I) generation systems such as DALL·E Ramesh et al. 2022 , Stable Diffusion Rombach et al. 2022 , Imagen Saharia et al. 2022 , and Midjourney have demonstrated remarkable progress in generating photorealistic imagery from natural language descriptions. Due to their accessibility and widespread deployment, these models incorporate safety filters designed to prevent the generation of harmful or policy-violating visual content. These safeguards typically include prompt filtering, embedding-level safety classifiers, and post-generation image moderation Rombach et al. 2022 ; Saharia et al. 2022 . However, several studies have shown that these mechanisms remain vulnerable to adversarial manipulation through carefully crafted prompts. Adversarial Prompt Attacks on T2I Systems. Recent work has begun exploring jailbreak attacks that specifically target text-to-image models. SneakyPrompt Yang et al. 2024b introduced one of the earliest automated prompt-based attack frameworks, demonstrating that reinforcement learning can generate prompts capable of bypassing safety filters to produce NSFW images. Their work highlighted the vulnerability of prompt moderation systems and showed that small token-level perturbations can evade safety mechanisms. Subsequent research has explored alternative strategies for generating adversarial prompts. Metaphor-based jailbreak attacks Zhang et al. 2025 leverage language models to generate euphemistic descriptions that preserve semantic intent while avoiding explicit unsafe keywords. Jailbreaking Prompt Attack Ma et al. 2024a and EvilPromptFuzzer He et al. 2024 use automated search or LLM-guided prompt generation to discover adversarial prompts capable of bypassing safety filters. Similarly, the Perception-Guided Jailbreak (PGJ) framework Huang et al. 2025 replaces restricted tokens with perceptually similar alternatives that remain semantically aligned with disallowed concepts while avoiding detection. Several works also explore adversarial strategies that manipulate the image generation process through iterative refinement. Chain-of-Jailbreak (CoJ) Wang et al. 2024 demonstrates how multi-step prompting can gradually steer a model toward generating restricted content. ColJailBreak Ma et al. 2024b extends this approach by using inpainting operations to progressively introduce disallowed content into generated images. TREANT Liu et al. employs a tree-based search over prompt transformations to discover effective jailbreak strategies. Atlas Dong et al. 2024 further introduces a multi-agent framework