Modular Energy Steering for Safe Text-to-Image Generation with Foundation Models
Yaoteng Tan, Zikui Cai, M. Salman Asif, [0.5em] University of California Riverside, [0.3em] {ytan082, sasif}@ucr.edu · 2026
Read Modular Energy Steering for Safe Text-to-Image Generation with Foundation Models by Yaoteng Tan, Zikui Cai, M. Salman Asif, [0.5em] University of California Riverside, [0.3em] {ytan082, sasif}@ucr.edu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-02265.txt.
Description
Tan, Cai and Asif steer text to image generation toward safety at inference time, without retraining. Frozen vision language models supply semantic feedback through clean latent estimates at each sampling step, turning safety into an energy based sampling problem. The modular design works with diffusion and flow matching models and generalizes across visual concepts. It proves robust against NSFW red team benchmarks and steers multiple targets at once, while keeping quality high on benign prompts.
Catalog record
| CREATOR | Yaoteng Tan, Zikui Cai, M. Salman Asif, [0.5em] University of California Riverside, [0.3em] {ytan082, sasif}@ucr.edu |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 57832 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.02265