The Perceptual Bandwidth Bottleneck in Vision-Language Models: Active Visual Reasoning via Sequential Experimental Design

Anjie Liu, Ziqin Gong, Yan Song, Yuxiang Chen, Xiaolong Liu, Hengtong Lu, Kaike Zhang, Chen Wei, Jun Wang · 2026

Read The Perceptual Bandwidth Bottleneck in Vision-Language Models: Active Visual Reasoning via Sequential Experimental Design by Anjie Liu, Ziqin Gong, Yan Song, Yuxiang Chen, Xiaolong Liu, Hengtong Lu, Kaike Zhang, Chen Wei, Jun Wang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-01345.txt.

Description

Anjie Liu and eight co-authors argue that vision-language models fail fine tasks not for lack of smarts but for lack of visual bandwidth. A wide view keeps context but loses small detail, so hard questions need the model to gather the right detail first, step by step.

They cast this hunt for evidence as sequential experimental design, where each step picks the next patch to inspect. Since exact reasoning over huge images is infeasible, they use a proxy goal that trades coverage against sharpness. Their method, FOVEA, needs no training and refines the model's own crop choices through probing. On high-resolution benchmarks it beats direct answers and step-by-step agent baselines, with the largest gains on remote-sensing tasks where the target must be searched for.

Catalog record

CREATORAnjie Liu, Ziqin Gong, Yan Song, Yuxiang Chen, Xiaolong Liu, Hengtong Lu, Kaike Zhang, Chen Wei, Jun Wang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE90 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.01345

Browse the full library · About the Tower of Babel