Do Text Edits Generalize to Visual Generation? Benchmarking Cross-Modal Knowledge Editing in UMMs

Xin Gao, Cheng Yang, Chufan Shi, Taylor Berg-Kirkpatrick · 2026

Read Do Text Edits Generalize to Visual Generation? Benchmarking Cross-Modal Knowledge Editing in UMMs by Xin Gao, Cheng Yang, Chufan Shi, Taylor Berg-Kirkpatrick (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-00477.txt.

Description

Gao and co-authors test if a text edit to a joint model sticks in its made images. Joint sight-word models can both write and paint from one core. Edits can shift what such a model writes with ease. If those edits reach its art was not known till now.

Their bench, UniKE, holds near three thousand edit marks. Marks span trait and link swaps in a thing's lore. Sight checks on made art grade if the edit took. Text-side wins reach past nine in ten in their tests. Best art-side marks fall far short of that bar. A fix that wakes the edit first lifts all pairs they test. The gap maps to weak ties twixt text traits and art paths.

Catalog record

CREATORXin Gao, Cheng Yang, Chufan Shi, Taylor Berg-Kirkpatrick
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE77 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.00477

Browse the full library · About the Tower of Babel