Z-Erase: Enabling Concept Erasure in Single-Stream Diffusion Transformers

Nanxiang Jiang, Zhaoxin Fan, Baisen Wang, Daiheng Gao, Junhang Cheng, Jifeng Guo, Yalan Qin, Yeying Jin, Hongwei Zheng, Faguo Wu, Wenjun Wu · 2026

Read Z-Erase: Enabling Concept Erasure in Single-Stream Diffusion Transformers by Nanxiang Jiang, Zhaoxin Fan, Baisen Wang, Daiheng Gao, Junhang Cheng, Jifeng Guo, Yalan Qin, Yeying Jin, Hongwei Zheng, Faguo Wu, Wenjun Wu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-25074.txt.

Introduction

Jiang and co-authors erase unwanted concepts from a new kind of image generator. Single-stream diffusion transformers mix text and image tokens in one sequence with shared weights. Old erasure methods, built for split designs, often wreck output on these models. Their Z-Erase first splits the update path so prior methods can run safely. A guided modulation step then balances removal against keeping the rest of the image skill. They prove the method settles at a balanced point. Tests show clean erasure with no collapse.

Catalog record

CREATORNanxiang Jiang, Zhaoxin Fan, Baisen Wang, Daiheng Gao, Junhang Cheng, Jifeng Guo, Yalan Qin, Yeying Jin, Hongwei Zheng, Faguo Wu, Wenjun Wu
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE93239
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.25074

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Z-Erase: Enabling Concept Erasure in Single-Stream Diffusion Transformers Nanxiang Jiang, Zhaoxin Fan, Baisen Wang, Daiheng Gao, Junhang Cheng, Jifeng Guo, Yalan Qin, Yeying Jin, Hongwei Zheng, Faguo Wu, Wenjun Wu Abstract Concept erasure is a vital safety mechanism for removing unwanted concepts from text-to-image (T2I) models. While extensively studied in U-Net and dual-stream architectures ( e.g. , Flux), this task remains under-explored in the recent emerging paradigm of single-stream diffusion transformers ( e.g. , Z-Image). In this new paradigm, text and image tokens are processed as a single unified sequence via shared parameters. Consequently, directly applying prior erasure methods typically leads to generation collapse. To bridge this gap, we introduce Z-Erase , the first concept erasure method tailored for single-stream T2I models. To guarantee stable image generation, Z-Erase first proposes a Stream Disentangled Concept Erasure Framework that decouples updates and enables existing methods on single-stream models. Subsequently, within this framework, we introduce Lagrangian-Guided Adaptive Erasure Modulation , a constrained algorithm that further balances the sensitive erasure-preservation trade-off. Moreover, we provide a rigorous convergence analysis proving that Z-Erase can converge to a Pareto stationary point. Experiments demonstrate that Z-Erase successfully overcomes the generation collapse issue, achieving state-of-the-art performance across a wide range of tasks. 1 Introduction The landscape of text-to-image (T2I) generation has evolved at breakneck speed, rapidly transitioning from the foundational U-Net ( 25 ) architectures to the scalable era of Diffusion Transformers ( 23 ) . Recently, this evolution has reached a new pinnacle with the emergence of single-stream diffusion transformers, a unified framework exemplified by state-of-the-art models like Z-Image ( 32 ) and HunyuanImage-3.0 ( 4 ) . Unlike traditional dual-stream models ( e.g., Flux ( 17 ) ) that process text and pixels separately, this new paradigm fundamentally treats visual and textual data as a single, unified sequence handled by a monolithic transformer backbone ( 32 ) . The efficiency of this architectural grand unification is remarkable: Z-Image Turbo, for instance, generates stunningly photorealistic imagery with only 6B parameters, signaling that the recently emerging pure single-stream framework is not merely an architectural variant, but the blueprint shaping the next generation of foundational models. Figure 1 : We introduce Z-Erase , a concept erasure method tailored for single-stream models. First row : Prior methods adapted via our Stream Disentangled Concept Erasure Framework are tested with the “nudity” concept, showing under-erasure (AC, EraseAnything) or severe artifacts (UCE). Blue boxes reveal the generation collapse caused by naive fine-tuning without our adaptation. Second row : Z-Erase effectively removes target concepts while preserving quality. Original outputs are in yellow boxes. Sensitive content pixelated. However, this generative prowess comes with significant risks. If the training data is not carefully filtered, foundational models can effortlessly absorb and reproduce copyrighted entities, Not-Safe-For-Work (NSFW) material, and biased imagery ( 1 ) . As these models gain broader adoption, the societal risks of such unrestricted generation become acute. In response, concept erasure has emerged as a vital safety alignment strategy ( 16 ; 6 ) . Instead of re-training the entire model, concept erasure selectively removes undesired target concepts while maintaining the model’s utility and performance on normal content. While concept erasure is well-established for Stable Diffusion (SD) ( 25 ) and Flux ( 17 ) series, we find that directly transferring these methods to pure single-stream models leads to consistent generation collapse , as shown in Fig. 1 ( blue boxes). Through careful analysis, we trace the failure to the unified single-stream architecture, as detailed in Section 3 . Unlike previous models that isolate text-image interactions within separate modules, single-stream transformers fuse both modalities into a unified self-attention mechanism with shared weights ( 32 ) . Consequently, optimizing shared parameters to suppress text concepts will inevitably damage visual backbone’s synthesis capability, leading to catastrophic noise outputs. To tackle this issue, we introduce Z-Erase , a concept erasure method tailored for single-stream models. First, to enable existing erasure methods on single-stream models, we propose Stream Disentangled Concept Erasure Framework , a structural intervention that decouples parameter updates in single-stream models. By freezing the visual processing pathway while allowing low-rank adaptations (LoRAs) ( 11 ) only on textual hidden states, we create a safe optimization subspace that protects the image generation backbone. Within this subspace, prior erasure methods can operate on single-stream models. However, even with this structural fix, we find that the unified attention space of single-stream models remains highly sensitive, making it difficult to balance erasure of target concept against preservation of unrelated content, as shown in Fig. 1 (first row). To address this, we further introduce a Lagrangian-Guided Adaptive Erasure Modulation algorithm, which solves this trade-off as a constrained optimization problem by dynamically maximizing erasure only when the preservation loss remains within a strict tolerance. In addition to the algorithm design, we also provide a rigorous theoretical analysis proving that our algorithm can converge to a Pareto stationary point ( 34 ) . Experiments demonstrate that Z-Erase successfully solves this optimization dilemma, ensuring robust ethical safety with minimal and controllable degradation in utility. To the best of our knowledge, Z-Erase is the first effective concept erasure method tailored for the emerging single-stream T2I paradigm. Our main contributions are: • Single-stream attention localization . We identify that generation collapse in single-stream models stems from shared projection weights. Beyond this, we further find that attention maps allow precise token-level localization, enabling selective erasure of targeted content. • Stream disentangled concept erasure framework . We propose a structural intervention for single-stream models. By injecting learnable adaptations exclusively into textual hidden states while freezing the visual backbone, we construct a safe optimization subspace that enables existing erasure methods to work on single-stream models. • Lagrangian-Guided Adaptive Erasure Modulation . To resolve the sensitive trade-off between erasure and preservation, we introduce a dynamic algorithm building upon this framework that maximizes erasure within a strict utility tolerance, and provide a rigorous convergence guarantee to a Pareto stationary point. 2 Related Work Generative diffusion and flow transformers. The evolution of generative models has progressed rapidly, moving from the foundational U-Net ( 26 ) architectures of DDPM ( 10 ) and DDIM ( 30 ) to the scalable era of Diffusion Transformers (DiTs) ( 23 ) and flow matching ( 19 ) . Dominant T2I models ( e.g. , Flux ( 17 ) , SD3 ( 5 ) , LongCat ( 31 ) ) establish the standard by using dual-stream architectures, which process text and visual data separately before fusing them for image generation. Recently, however, Z-Image ( 32 ) has broken this standard by introducing a pure single-stream paradigm. By concatenating text and image tokens at the sequence level to serve as a unified input stream, Z-Image achieves strong performance with remarkable efficiency: ranking among the top open-source models in recent ELO leaderboards with only 6B parameters. Recognizing this shift, we conduct our main experiments on Z-Image to study concept erasure and safety in the next generation of foundational models. Concept erasure. As generative models improve, safety concerns become increasingly important. Concept erasure offers a practical way to mitigate risks like NSFW content and copyright infringement, serving as a more efficient alternative to pre-training filtering ( 25 ) or post-generation filtering (

Read the complete text