CLAIR: CLIP-Aided Weakly Supervised Zero-Shot Cross-Domain Image Retrieval

Chor Boon Tan, Conghui Hu, Gim Hee Lee · 2025

Read CLAIR: CLIP-Aided Weakly Supervised Zero-Shot Cross-Domain Image Retrieval by Chor Boon Tan, Conghui Hu, Gim Hee Lee (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-12290.txt.

Description

Chor Boon Tan and co-authors improve image search across mismatched collections in a 2025 paper. A user might sketch a chair and want the matching photo, but labeled training pairs across such domains are scarce. Large vision models can guess labels for unlabeled images, yet their guesses are noisy, which poisons training.

Their system, CLAIR, scores each guessed label by how well the model's words and images agree, then trains with contrast signals between single images, groups, and domains. A neat closed-form map, built from word vectors alone, carries features from one domain into the other. Extra learnable prompts help the system face categories it never saw. Tests on four sketch and photo benchmarks show the refined labels and maps beat plain guessing, a step toward search that works anywhere.

Catalog record

CREATORChor Boon Tan, Conghui Hu, Gim Hee Lee
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE47 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-12290

Browse the full library · About the Tower of Babel