VisRef : Visual Refocusing while Thinking Improves Test-Time Scaling in Multi-Modal Large Reasoning Models

Soumya Suvra Ghosal, Youngeun Kim, Zhuowei Li, Ritwick Chaudhry, Linghan Xu, Hongjing Zhang, Jakub Zablocki, Yifan Xing, Qin Zhang, [2pt] University of Maryland, College Park · 2026

Read VisRef : Visual Refocusing while Thinking Improves Test-Time Scaling in Multi-Modal Large Reasoning Models by Soumya Suvra Ghosal, Youngeun Kim, Zhuowei Li, Ritwick Chaudhry, Linghan Xu, Hongjing Zhang, Jakub Zablocki, Yifan Xing, Qin Zhang, [2pt] University of Maryland, College Park (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-00207.txt.

Description

Ghosal and colleagues present VisRef, a test-time scaling framework that re-injects a coreset of visual tokens into reasoning, keeping models grounded in images as textual reasoning extends. Extended text reasoning can degrade vision-dependent performance as attention drifts from visual tokens to textual priors alone. VisRef picks tokens that fit the reasoning context while staying diverse and globally representative of the image. Under fixed test-time compute budgets, it tops rival scaling approaches by up to 6.4% on three visual reasoning benchmarks.

Catalog record

CREATORSoumya Suvra Ghosal, Youngeun Kim, Zhuowei Li, Ritwick Chaudhry, Linghan Xu, Hongjing Zhang, Jakub Zablocki, Yifan Xing, Qin Zhang, [2pt] University of Maryland, College Park
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE52322
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.00207

Browse the full library · About the Tower of Babel