SHAPE : Self-Improved Visual Preference Alignment by Iteratively Generating Holistic Winner
Kejia Chen Jiawen Zhang Jiacong Hu Jiazhen Yang Jian Lou Zunlei Feng Mingli Song · 2025
Read SHAPE : Self-Improved Visual Preference Alignment by Iteratively Generating Holistic Winner by Kejia Chen Jiawen Zhang Jiacong Hu Jiazhen Yang Jian Lou Zunlei Feng Mingli Song (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-04858.txt.
Description
Kejia Chen and co-authors present a self-teaching method to align vision-language models in this 2025 paper. Such models are steered by training on triplets: an image, a better answer, and a worse answer. Human-made preference data are diverse-poor and costly, which limits how well models can be aligned.
Their framework, called SHAPE, turns plain image-text pairs into preference triplets with no human labels. For each pair, varied views of the image are joined with a summary text to form the winning answer, while the original text serves as the loser. The model then improves in rounds. Tests across twelve benchmarks and several model families show clear gains, the authors report.
Catalog record
| CREATOR | Kejia Chen Jiawen Zhang Jiacong Hu Jiazhen Yang Jian Lou Zunlei Feng Mingli Song |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 43 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-04858