Rethinking Negative Prompting for Concept Suppression: Unconditional Anchoring and Localized Guidance

Anubhav Jain, Takashi Shibuya, Yuya Kobayashi, Yuhta Takida, Nasir Memon, Julian Togelius, Yuki Mitsufuji · 2024

Read Rethinking Negative Prompting for Concept Suppression: Unconditional Anchoring and Localized Guidance by Anubhav Jain, Takashi Shibuya, Yuya Kobayashi, Yuhta Takida, Nasir Memon, Julian Togelius, Yuki Mitsufuji (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-07658.txt.

Description

Anubhav Jain and co-authors rethink negative prompting for image models in a 2024 paper. Text-to-image tools can make harmful content, so users steer them away with a negative prompt naming what to avoid. That steering can collapse when a tricky prompt makes the two predictions nearly the same.

When the gap vanishes, suppression fails and the unwanted concept can appear. Their method, TraSCE, steers the sampling path with a fixed anchor and local guidance instead. It needs no retraining and acts at generation time. Tests in the paper show stronger suppression in the collapse regime. The work matters for safe public image tools.

Catalog record

CREATORAnubhav Jain, Takashi Shibuya, Yuya Kobayashi, Yuhta Takida, Nasir Memon, Julian Togelius, Yuki Mitsufuji
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE80 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2412-07658

Browse the full library · About the Tower of Babel