Safe Autoregressive Image Generation with Iterative Self-Improving Codebooks

Yunqi Xue, Zhijiang Li, Philip Torr, Jindong Gu · 2026

Read Safe Autoregressive Image Generation with Iterative Self-Improving Codebooks by Yunqi Xue, Zhijiang Li, Philip Torr, Jindong Gu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-27147.txt.

Description

Xue and colleagues ask how safe images from autoregressive generators really are. Such models build pictures token by token, picking each small visual piece from a learned codebook. That language-like design reads text prompts well, but harmful pictures can slip through. Their fix repairs the codebook itself, the dictionary that maps codes to visual patterns. The model judges its own outputs, so no human labelling is needed to spot unsafe generations in this method from 2026.

Flagged outputs form harmful and safe image-text pairs. Those pairs map a harmful space inside the codebook, guiding edits that erase harmful mappings. Adaptive fine-tuning inside the safe space then restores picture quality. Rounds repeat until gains stop. Safety improves using only the model's own judgement, with no outside feedback loop. Harmful outputs fall while ordinary generation quality is preserved.

Catalog record

CREATORYunqi Xue, Zhijiang Li, Philip Torr, Jindong Gu
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE56 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.27147

Browse the full library · About the Tower of Babel