LAGO: Language-Guided Adaptive Object-Region Focus for Zero-Shot Visual–Text Alignment
Junyi Hu, Qiji Zhou, Lei Zhang, Yue Zhang · 2026
Read LAGO: Language-Guided Adaptive Object-Region Focus for Zero-Shot Visual–Text Alignment by Junyi Hu, Qiji Zhou, Lei Zhang, Yue Zhang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-08156.txt.
Description
Hu and three colleagues improve zero shot recognition, where a model classifies an image by picking the most compatible label with no task specific training. In fine grained settings the telling evidence sits in local parts or textures, not the whole image, so whole image matching fails. Recent local methods compare descriptions against many regions, but they rely on random or redundant crops that raise cost and add weak candidates.
The team proposes LAGO for efficient and robust zero shot local visual text alignment. It first finds object centred candidates without class labels, giving a stable starting point. It then refines those regions with language guidance scaled by confidence, avoiding an error amplifying loop. Object level, contextual and full image evidence combine through a dual channel aggregation strategy. Across standard zero shot benchmarks and distribution shift settings, LAGO tops performance while needing far fewer regions at inference time.
Catalog record
| CREATOR | Junyi Hu, Qiji Zhou, Lei Zhang, Yue Zhang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 80 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.08156