Di3PO - Diptych Diffusion DPO for Targeted Improvements in Image Generation
Sanjana Reddy, Ishaan Malhi, Sally Ma, Praneet Dutta · 2026
Read Di3PO - Diptych Diffusion DPO for Targeted Improvements in Image Generation by Sanjana Reddy, Ishaan Malhi, Sally Ma, Praneet Dutta (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-06355.txt.
Description
Tuning a text-to-image model with human preferences needs pairs of better and worse pictures, and making those pairs is slow and noisy. Sanjana Reddy and 3 co-authors present Di3PO, a way to build pairs that differ only in a chosen region. The rest of the picture stays fixed, so training signal points exactly at the flaw.
Standard preference tuning often wastes effort on irrelevant pixel differences between pairs. Di3PO isolates the targeted area for improvement while the surrounding context holds steady. The team demonstrates the method on text rendering, a known weak spot where diffusion models garble letters. Their approach improved results over plain fine-tuning and standard preference optimization baselines.
Catalog record
| CREATOR | Sanjana Reddy, Ishaan Malhi, Sally Ma, Praneet Dutta |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 30 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-06355