Rethinking Negative Prompting for Concept Suppression: Unconditional Anchoring and Localized Guidance
Anubhav Jain, Takashi Shibuya, Yuya Kobayashi, Yuhta Takida, Nasir Memon, Julian Togelius, Yuki Mitsufuji · 2024
Read Rethinking Negative Prompting for Concept Suppression: Unconditional Anchoring and Localized Guidance by Anubhav Jain, Takashi Shibuya, Yuya Kobayashi, Yuhta Takida, Nasir Memon, Julian Togelius, Yuki Mitsufuji (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-07658.txt.
Description
Anubhav Jain and co-authors rethink negative prompting for image models in a 2024 paper. Text-to-image tools can make harmful content, so users steer them away with a negative prompt naming what to avoid. That steering can collapse when a tricky prompt makes the two predictions nearly the same.
When the gap vanishes, suppression fails and the unwanted concept can appear. Their method, TraSCE, steers the sampling path with a fixed anchor and local guidance instead. It needs no retraining and acts at generation time. Tests in the paper show stronger suppression in the collapse regime. The work matters for safe public image tools.
Catalog record
| CREATOR | Anubhav Jain, Takashi Shibuya, Yuya Kobayashi, Yuhta Takida, Nasir Memon, Julian Togelius, Yuki Mitsufuji |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 80 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2412-07658