CLAIR: CLIP-Aided Weakly Supervised Zero-Shot Cross-Domain Image Retrieval
Chor Boon Tan, Conghui Hu, Gim Hee Lee · 2025
Read CLAIR: CLIP-Aided Weakly Supervised Zero-Shot Cross-Domain Image Retrieval by Chor Boon Tan, Conghui Hu, Gim Hee Lee (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-12290.txt.
Description
Chor Boon Tan and co-authors improve image search across mismatched collections in a 2025 paper. A user might sketch a chair and want the matching photo, but labeled training pairs across such domains are scarce. Large vision models can guess labels for unlabeled images, yet their guesses are noisy, which poisons training.
Their system, CLAIR, scores each guessed label by how well the model's words and images agree, then trains with contrast signals between single images, groups, and domains. A neat closed-form map, built from word vectors alone, carries features from one domain into the other. Extra learnable prompts help the system face categories it never saw. Tests on four sketch and photo benchmarks show the refined labels and maps beat plain guessing, a step toward search that works anywhere.
Catalog record
| CREATOR | Chor Boon Tan, Conghui Hu, Gim Hee Lee |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 47 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-12290