RelationAdapter: Learning and Transferring Visual Relation with Diffusion Transformers

Yan Gong, Yiren Song, Yicheng Li, Chenglin Li, Yin Zhang · 2025

Read RelationAdapter: Learning and Transferring Visual Relation with Diffusion Transformers by Yan Gong, Yiren Song, Yicheng Li, Chenglin Li, Yin Zhang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-02528.txt.

Description

Editing an image the way an example shows, changing a pose or a layout rather than just a style, is hard for today's image models. Yan Gong, Yiren Song, Yicheng Li, Chenglin Li, and Yin Zhang borrowed a trick from language models in 2025. Show the model a before-and-after pair, and it carries that same change to a new picture.

Their add-on module, RelationAdapter, plugs into a diffusion transformer and learns the relation inside the pair. To train and test it they built a dataset of 218 editing tasks. On that benchmark the module sharply improved how well models grasped and transferred the editing intent, lifting the quality of the results.

Catalog record

CREATORYan Gong, Yiren Song, Yicheng Li, Chenglin Li, Yin Zhang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE40 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-02528

Browse the full library · About the Tower of Babel