Reinforcing Multimodal Understanding and Generation with Dual Self-rewards
Jixiang Hong, Yiran Zhang, Guanzhong Wang, Yi Liu, Ji-Rong Wen, Rui Yan · 2025
Read Reinforcing Multimodal Understanding and Generation with Dual Self-rewards by Jixiang Hong, Yiran Zhang, Guanzhong Wang, Yi Liu, Ji-Rong Wen, Rui Yan (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-07963.txt.
Description
Hong and co-authors teach a single AI model to get better at both understanding images and creating them, with no outside teacher. Models that merge vision and language often slip: they describe pictures wrongly or draw images that ignore the prompt. Existing fixes lean on human feedback or extra reward models, and usually patch one direction at a time.
Their framework, SUDER, exploits the fact that understanding and generation are mirror tasks. The model samples several answers in one direction, then flips each pair around and scores how likely the reverse looks. Those self-made scores become rewards for training. Across standard benchmarks, the method lifted both skills, with striking gains in text-to-image work. The authors present self-reward as a cheap route to tighter vision-language alignment.
Catalog record
| CREATOR | Jixiang Hong, Yiran Zhang, Guanzhong Wang, Yi Liu, Ji-Rong Wen, Rui Yan |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 44 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-07963