Seeing Through Words: Controlling Visual Retrieval Quality with Language Models

Jianglin Lu Simon Jenni Kushal Kafle Jing Shi Handong Zhao Yun Fu · 2026

Read Seeing Through Words: Controlling Visual Retrieval Quality with Language Models by Jianglin Lu Simon Jenni Kushal Kafle Jing Shi Handong Zhao Yun Fu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-21175.txt.

Description

Real search queries are often just one or two words, too thin to specify what images a user wants. Jianglin Lu, Simon Jenni, Kushal Kafle, Jing Shi, Handong Zhao, and Yun Fu address that thinness in this 2026 arXiv paper via quality-controllable retrieval. A generative language model completes short queries into descriptive forms capturing pose, scene, and aesthetics.

Completion is conditioned on discretized quality levels from relevance and aesthetic scoring, so enrichment is quality-aware as well as meaningful. The framework works with any pretrained vision-language model unchanged, keeps enriched queries readable, and lets users steer results toward preferred quality levels. Experiments show clear retrieval gains with effective quality control.

Catalog record

CREATORJianglin Lu Simon Jenni Kushal Kafle Jing Shi Handong Zhao Yun Fu
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE63 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-21175

Browse the full library · About the Tower of Babel