S2H-DPO: Hardness-Aware Preference Optimization for Vision–Language Models

Nitish Shukla Surgan Jandial Arun Ross · 2026

Read S2H-DPO: Hardness-Aware Preference Optimization for Vision–Language Models by Nitish Shukla Surgan Jandial Arun Ross (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-18512.txt.

Description

Shukla, Jandial, and Ross spot a gap in multi-image matching: current methods use preset indices for narrow reasoning, skipping global search and self-run cross-image comparison. They offer a Simple-to-Hard method building choice data at three levels: single-image focus, multi-image contrast, and global visual search. Unlike prior work relying on hallucinations or focus tricks, their approach uses harder prompts for chosen and losing pairs across models. Tests on LLaVA and Qwen-VL models show large gains over rivals while keeping single-image skills.

Catalog record

CREATORNitish Shukla Surgan Jandial Arun Ross
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE37391
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.18512

Browse the full library · About the Tower of Babel