Unified Text-Image Generation with Weakness-Targeted Post-Training
Jiahui Chen, Philippe Hansen-Estruch, Xiaochuang Han, Yushi Hu, Emily Dinan, Amita Kamath, Michal Drozdzal, Reyhane Askari-Hemmat, Luke Zettlemoyer, Marjan Ghazvininejad · 2026
Read Unified Text-Image Generation with Weakness-Targeted Post-Training by Jiahui Chen, Philippe Hansen-Estruch, Xiaochuang Han, Yushi Hu, Emily Dinan, Amita Kamath, Michal Drozdzal, Reyhane Askari-Hemmat, Luke Zettlemoyer, Marjan Ghazvininejad (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-04339.txt.
Description
Jiahui Chen and nine co-authors teach a single model to think in words and then draw, without being told when to switch, in a 2026 arXiv paper. Most unified text-and-image systems still switch modes by hand, reasoning first and generating an image second, which keeps the two streams loosely coupled. The team post-trains BAGEL, a large mixture-of-transformers model, to make the transition on its own inside one run.
Their post-training uses only self-generated synthetic data, weighted by rewards, and — the paper's central comparison. A dataset aimed squarely at the model's known weaknesses beats both broad caption corpora and data aligned to benchmarks. Weighting both the text and image rewards matters too. The result, they report, is improved image generation across four independent text-to-image benchmarks.
Catalog record
| CREATOR | Jiahui Chen, Philippe Hansen-Estruch, Xiaochuang Han, Yushi Hu, Emily Dinan, Amita Kamath, Michal Drozdzal, Reyhane Askari-Hemmat, Luke Zettlemoyer, Marjan Ghazvininejad |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 54 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-04339