Hierarchical Refinement of Universal Multimodal Attacks on Vision-Language Models

Peng-Fei Zhang, Zi Huang · 2026

Read Hierarchical Refinement of Universal Multimodal Attacks on Vision-Language Models by Peng-Fei Zhang, Zi Huang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-10313.txt.

Description

Peng-Fei Zhang and Zi Huang build attacks that can fool many sight and text models at once. A small change to an image can flip a model's call. Such tests show how frail a model is. Past attacks were made for one case at a time. That makes them slow to run at scale.

A broad attack works on new cases with no fresh build. The team refine such attacks in stages. Each stage hones the change for a wider set of cases. The aim is a cheap, broad test of model frailty. Labs can then rank models by how well they stand up.

Catalog record

CREATORPeng-Fei Zhang, Zi Huang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE72 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-10313

Browse the full library · About the Tower of Babel