S2H-DPO: Hardness-Aware Preference Optimization for Vision–Language Models
Nitish Shukla Surgan Jandial Arun Ross · 2026
Read S2H-DPO: Hardness-Aware Preference Optimization for Vision–Language Models by Nitish Shukla Surgan Jandial Arun Ross (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-18512.txt.
Description
Shukla, Jandial, and Ross spot a gap in multi-image matching: current methods use preset indices for narrow reasoning, skipping global search and self-run cross-image comparison. They offer a Simple-to-Hard method building choice data at three levels: single-image focus, multi-image contrast, and global visual search. Unlike prior work relying on hallucinations or focus tricks, their approach uses harder prompts for chosen and losing pairs across models. Tests on LLaVA and Qwen-VL models show large gains over rivals while keeping single-image skills.
Catalog record
| CREATOR | Nitish Shukla Surgan Jandial Arun Ross |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 37391 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.18512