Visual Instruction Tuning with Chain of Region-of-Interest

Yixin Chen, Shuai Zhang, Boran Han, Bernie Wang · 2025

Read Visual Instruction Tuning with Chain of Region-of-Interest by Yixin Chen, Shuai Zhang, Boran Han, Bernie Wang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-06840.txt.

Description

Yixin Chen and three co-authors present a study from twenty twenty-five on teaching vision language models with sharp images at low cost. Sharp images help models spot and read fine detail. Feeding the whole sharp image swells the token count and the compute bill. Their method, Chain of Region-of-Interest, mimics how human eyes pick out key zones.

The chain finds the most rich zones first and spends its budget there. Long token streams from sharp shots are dodged. Tests on eleven known sets span models from small to large. Scores beat a known rival on near all sets. Their largest tuned model topped some closed rivals on six sets.

Catalog record

CREATORYixin Chen, Shuai Zhang, Boran Han, Bernie Wang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE31 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-06840

Browse the full library · About the Tower of Babel