SIFThinker : S patially-Aware I mage F ocus for Visual Reasoning

Zhangquan Chen, Ruihui Zhao, Chuwei Luo, Mingze Sun, Xinlei Yu, Yangyang Kang, Ruqi Huang · 2025

Read SIFThinker : S patially-Aware I mage F ocus for Visual Reasoning by Zhangquan Chen, Ruihui Zhao, Chuwei Luo, Mingze Sun, Xinlei Yu, Yangyang Kang, Ruqi Huang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-06259.txt.

Description

Zhangquan Chen and six co-authors teach a vision-language model to look where it matters, in a 2025 paper. Such models still fumble tasks needing fine spatial sense, like locating a small object or judging distances. People cope by shifting their gaze and zooming attention step by step.

Their framework interleaves depth-marked boxes with words, so the model reasons while visibly refocusing on prompt-relevant regions. A three-stage strategy first builds training chains of this mixed text and image thinking, yielding a fifty-thousand-example dataset. A reinforced training stage then rewards good focusing directly. Across spatial and fine-grained tests the method beat current leaders. The authors present looking as a skill to train, not a fixed input.

Catalog record

CREATORZhangquan Chen, Ruihui Zhao, Chuwei Luo, Mingze Sun, Xinlei Yu, Yangyang Kang, Ruqi Huang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE46 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-06259

Browse the full library · About the Tower of Babel