Di3PO - Diptych Diffusion DPO for Targeted Improvements in Image Generation

Sanjana Reddy, Ishaan Malhi, Sally Ma, Praneet Dutta · 2026

Read Di3PO - Diptych Diffusion DPO for Targeted Improvements in Image Generation by Sanjana Reddy, Ishaan Malhi, Sally Ma, Praneet Dutta (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-06355.txt.

Description

Tuning a text-to-image model with human preferences needs pairs of better and worse pictures, and making those pairs is slow and noisy. Sanjana Reddy and 3 co-authors present Di3PO, a way to build pairs that differ only in a chosen region. The rest of the picture stays fixed, so training signal points exactly at the flaw.

Standard preference tuning often wastes effort on irrelevant pixel differences between pairs. Di3PO isolates the targeted area for improvement while the surrounding context holds steady. The team demonstrates the method on text rendering, a known weak spot where diffusion models garble letters. Their approach improved results over plain fine-tuning and standard preference optimization baselines.

Catalog record

CREATORSanjana Reddy, Ishaan Malhi, Sally Ma, Praneet Dutta
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE30 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-06355

Browse the full library · About the Tower of Babel