LAGO: Language-Guided Adaptive Object-Region Focus for Zero-Shot Visual–Text Alignment

Junyi Hu, Qiji Zhou, Lei Zhang, Yue Zhang · 2026

Read LAGO: Language-Guided Adaptive Object-Region Focus for Zero-Shot Visual–Text Alignment by Junyi Hu, Qiji Zhou, Lei Zhang, Yue Zhang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-08156.txt.

Description

Hu and three colleagues improve zero shot recognition, where a model classifies an image by picking the most compatible label with no task specific training. In fine grained settings the telling evidence sits in local parts or textures, not the whole image, so whole image matching fails. Recent local methods compare descriptions against many regions, but they rely on random or redundant crops that raise cost and add weak candidates.

The team proposes LAGO for efficient and robust zero shot local visual text alignment. It first finds object centred candidates without class labels, giving a stable starting point. It then refines those regions with language guidance scaled by confidence, avoiding an error amplifying loop. Object level, contextual and full image evidence combine through a dual channel aggregation strategy. Across standard zero shot benchmarks and distribution shift settings, LAGO tops performance while needing far fewer regions at inference time.

Catalog record

CREATORJunyi Hu, Qiji Zhou, Lei Zhang, Yue Zhang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE80 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.08156

Browse the full library · About the Tower of Babel