Single-Sample Black-Box Membership Inference Attack against Vision-Language Models via Cross-modal Semantic Alignment

Jiaqing Li, Yajuan Lu, Xiaochuan Shi, Gang Wu, ZhongYuan Wang, Chao Liang · 2026

Read Single-Sample Black-Box Membership Inference Attack against Vision-Language Models via Cross-modal Semantic Alignment by Jiaqing Li, Yajuan Lu, Xiaochuan Shi, Gang Wu, ZhongYuan Wang, Chao Liang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-17341.txt.

Description

Li and colleagues attack membership inference for vision-language models in the strict black-box, single-sample setting, where internal scores are hidden and statistics are thin. They observe that member images align far more tightly with their captions than non-members do, a trace of training memorization. Scoring that alignment in a joint embedding space, their method reaches an AUC of 0.821 against LLaVA-1.5 and stays robust under image perturbations.

Catalog record

CREATORJiaqing Li, Yajuan Lu, Xiaochuan Shi, Gang Wu, ZhongYuan Wang, Chao Liang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE81530
LICENSEhttp://creativecommons.org/publicdomain/zero/1.0/
RIGHTSCC0
SOURCEarXiv

Source: https://arxiv.org/abs/2605.17341

Browse the full library · About the Tower of Babel