Single-Sample Black-Box Membership Inference Attack against Vision-Language Models via Cross-modal Semantic Alignment
Jiaqing Li, Yajuan Lu, Xiaochuan Shi, Gang Wu, ZhongYuan Wang, Chao Liang · 2026
Read Single-Sample Black-Box Membership Inference Attack against Vision-Language Models via Cross-modal Semantic Alignment by Jiaqing Li, Yajuan Lu, Xiaochuan Shi, Gang Wu, ZhongYuan Wang, Chao Liang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-17341.txt.
Description
Li and colleagues attack membership inference for vision-language models in the strict black-box, single-sample setting, where internal scores are hidden and statistics are thin. They observe that member images align far more tightly with their captions than non-members do, a trace of training memorization. Scoring that alignment in a joint embedding space, their method reaches an AUC of 0.821 against LLaVA-1.5 and stays robust under image perturbations.
Catalog record
| CREATOR | Jiaqing Li, Yajuan Lu, Xiaochuan Shi, Gang Wu, ZhongYuan Wang, Chao Liang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 81530 |
| LICENSE | http://creativecommons.org/publicdomain/zero/1.0/ |
| RIGHTS | CC0 |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.17341