On Test-Time Scaling for Vision-Language Models

Fawaz Sammani, Tzoulio Chamiti, Nikos Deligiannis · 2026

Read On Test-Time Scaling for Vision-Language Models by Fawaz Sammani, Tzoulio Chamiti, Nikos Deligiannis (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-28864.txt.

Description

Sammani, Chamiti and Deligiannis ask whether tricks that make text models think longer also help vision-language models, which answer questions about images. Test-time scaling means spending extra computing effort during use, without retraining, to get better answers. It is well studied for text models but barely analysed for models that also see, so the team ran the first broad study of its kind.

Their tests spanned several models and sizes, nine scaling methods and six benchmarks. Small, strong models gained the most, improving by up to around thirty percent and often matching or beating much larger models. Giving a model more compute than it needed backfired, because the models lost focus. They also found that visual information enters early in the reasoning chain. After that the chain runs mostly on text, and the image's contribution fades sharply, a pattern with direct lessons for deployment.

Catalog record

CREATORFawaz Sammani, Tzoulio Chamiti, Nikos Deligiannis
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE67 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.28864

Browse the full library · About the Tower of Babel