Hierarchical Refinement of Universal Multimodal Attacks on Vision-Language Models
Peng-Fei Zhang, Zi Huang · 2026
Read Hierarchical Refinement of Universal Multimodal Attacks on Vision-Language Models by Peng-Fei Zhang, Zi Huang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-10313.txt.
Description
Peng-Fei Zhang and Zi Huang build attacks that can fool many sight and text models at once. A small change to an image can flip a model's call. Such tests show how frail a model is. Past attacks were made for one case at a time. That makes them slow to run at scale.
A broad attack works on new cases with no fresh build. The team refine such attacks in stages. Each stage hones the change for a wider set of cases. The aim is a cheap, broad test of model frailty. Labs can then rank models by how well they stand up.
Catalog record
| CREATOR | Peng-Fei Zhang, Zi Huang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 72 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-10313