Focus-N-Fix: Region-Aware Fine-Tuning for Text-to-Image Generation

Xiaoying Xing, Avinab Saha, Junfeng He, Susan Hao, Paul Vicol, Moonkyung Ryu, Gang Li, Sahil Singla, Sarah Young, Yinxiao Li, Feng Yang, Deepak Ramachandran · 2025

Read Focus-N-Fix: Region-Aware Fine-Tuning for Text-to-Image Generation by Xiaoying Xing, Avinab Saha, Junfeng He, Susan Hao, Paul Vicol, Moonkyung Ryu, Gang Li, Sahil Singla, Sarah Young, Yinxiao Li, Feng Yang, Deepak Ramachandran (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-06481.txt.

Description

Xiaoying Xing and co-authors fine tuned text to image generators in 2025 with a surgeon's touch, fixing only the regions of a picture that were wrong. Standard reward tuning rewrites the whole model and can quietly spoil what already worked, or teach the model to game the reward.

Their region aware method keeps an image's overall layout while repairing local faults: unsafe content, implausible anatomy, or missed prompt details. Tests showed the flagged regions improved with little or no loss elsewhere, and changes outside the repair zone were usually imperceptible. The authors pitch the approach for product teams that must patch one flaw without re rolling the whole model's character.

Catalog record

CREATORXiaoying Xing, Avinab Saha, Junfeng He, Susan Hao, Paul Vicol, Moonkyung Ryu, Gang Li, Sahil Singla, Sarah Young, Yinxiao Li, Feng Yang, Deepak Ramachandran
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE58 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-06481

Browse the full library · About the Tower of Babel