Modular Energy Steering for Safe Text-to-Image Generation with Foundation Models

Yaoteng Tan, Zikui Cai, M. Salman Asif, [0.5em] University of California Riverside, [0.3em] {ytan082, sasif}@ucr.edu · 2026

Read Modular Energy Steering for Safe Text-to-Image Generation with Foundation Models by Yaoteng Tan, Zikui Cai, M. Salman Asif, [0.5em] University of California Riverside, [0.3em] {ytan082, sasif}@ucr.edu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-02265.txt.

Description

Tan, Cai and Asif steer text to image generation toward safety at inference time, without retraining. Frozen vision language models supply semantic feedback through clean latent estimates at each sampling step, turning safety into an energy based sampling problem. The modular design works with diffusion and flow matching models and generalizes across visual concepts. It proves robust against NSFW red team benchmarks and steers multiple targets at once, while keeping quality high on benign prompts.

Catalog record

CREATORYaoteng Tan, Zikui Cai, M. Salman Asif, [0.5em] University of California Riverside, [0.3em] {ytan082, sasif}@ucr.edu
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE57832
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.02265

Browse the full library · About the Tower of Babel