Benchmarking Unified Face Attack Detection via Hierarchical Prompt Tuning
Ajian Liu, Haocheng Yuan, Xiao Guo, Hui Ma, Wanyi Zhuang, Changtao Miao, Yan Hong, Chuanbiao Song, Jun Lan, Qi Chu, Tao Gong, Yanyan Liang, Weiqiang Wang, Jun Wan · 2025
Read Benchmarking Unified Face Attack Detection via Hierarchical Prompt Tuning by Ajian Liu, Haocheng Yuan, Xiao Guo, Hui Ma, Wanyi Zhuang, Changtao Miao, Yan Hong, Chuanbiao Song, Jun Lan, Qi Chu, Tao Gong, Yanyan Liang, Weiqiang Wang, Jun Wan (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-13327.txt.
Introduction
Ajian Liu and a large team benchmarked unified face attack detection in two thousand twenty-five. Two guard systems exist today: one spots fake presentation media, the other spots deepfake edits. Training them apart leaves gaps that new attacks can slip through, and no single system yet handles both kinds well.
The team built UniAttackDataPlus, a vast set with thousands of identities and dozens of fake types across hundreds of thousands of videos. They also built a prompt-tuned vision-language method that sorts attacks in steps, pruning prompts as it goes. The work gives the field a tougher test and a new way to meet it.
Catalog record
| CREATOR | Ajian Liu, Haocheng Yuan, Xiao Guo, Hui Ma, Wanyi Zhuang, Changtao Miao, Yan Hong, Chuanbiao Song, Jun Lan, Qi Chu, Tao Gong, Yanyan Liang, Weiqiang Wang, Jun Wan |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 76 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-13327
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Benchmarking Unified Face Attack Detection via Hierarchical Prompt Tuning Thanks: Ajian Liu and Haocheng Yuan are co-first authors. The corresponding author is Jun wan. Ajian Liu, Jun Wan and Zhen Lei are with the State Key Laboratory of Multimodal Artificial Intelligence Systems (MAIS), Institute of Automation, Chinese Academy of Sciences (CASIA), Beijing 100190, China (e-mail: {ajian.liu, jun.wan, zhen.lei}@ia.ac.cn). Haocheng Yuan is with the Department of Computer Science, College of Computing, City University of Hong Kong, Hong Kong, China. Hui Ma and Yanyan Liang are with the School of Computer Science and Engineering, Faculty of Innovation Engineering, Macau University of Science and Technology, Macau, China. Xiao Guo and Xiaoming Liu are with the Department of Computer Science and Engineering, Michigan State University, USA. Wanyi Zhuang, Changtao Miao, Qi Chu and Tao Gong are with the School of Cyber Science and Technology, University of Science and Technology of China, Hefei 230022, China. Yan Hong, Chuanbiao Song, Jun Lan and Weiqiang Wang are with the Ant Group, Zhejiang 310024, China. Jiankang Deng is with Imperial College London, London, UK. Ajian Liu, Haocheng Yuan, Xiao Guo, Hui Ma, Wanyi Zhuang, Changtao Miao, Yan Hong, Chuanbiao Song, Jun Lan, Qi Chu, Tao Gong, Yanyan Liang, Weiqiang Wang, Jun Wan Abstract Presentation Attack Detection (PAD) and Face Forgery Detection (FFD) are proposed to protect face data from physical media-based Presentation Attacks (PAs) and digital editing-based DeepFakes (DFs), respectively. However, isolated training of these two models significantly increases vulnerability towards unknown attacks, burdening deployment environments. The lack of a Unified Face Attack Detection (UAD) model to simultaneously handle attacks in these two categories is mainly attributed to two factors: (1) A benchmark that is sufficient for models to explore is lacking. Existing UAD datasets only contain limited attack types and samples, leading to the model’s confined ability to address abundant advanced threats. In light of these, through an explainable hierarchical way, we propose the most extensive and sophisticated collection of forgery techniques available to date, namely UniAttackDataPlus ( UniAttackData+ ). Our UniAttackData+ encompasses 2,875 2,875 identities and their 54 54 kinds of corresponding falsified samples, in a total of 697,347 697,347 videos. (2) The absence of a trustworthy classification criterion. Current methods endeavor to explore an arbitrary criterion within the same semantic space, which fails to exist when encountering diverse attacks. Thus, we present a novel Visual-Language Model-based Hierarchical Prompt Tuning Framework ( HiPTune ) that adaptively explores multiple classification criteria from different semantic spaces. Specifically, we construct a Visual Prompt Tree ( VP-Tree ) to explore various classification rules hierarchically. Then, by adaptively pruning the prompts, the model can select the most suitable prompts guiding the encoder to extract discriminative features at different levels in a coarse-to-fine manner. Finally, to help the model understand the classification criteria in visual space, we propose a Dynamically Prompt Integration ( DPI ) module to project the visual prompts to the text encoder to help obtain a more accurate semantics. Extensive experiments on 12 datasets have verified the potential to inspire further innovations in the UAD field. The UniAttackDataPlus dataset can be found at https://sites.google.com/view/face-anti-spoofing-challenge/dataset-download/uniattackdata-iccv2025, and the codes can be found at https://github.com/HaochengYUAN-Allen/UniAttackDataPlus-HiPTune. I Introduction Face data are widely used in fields such as facial payment, mobile unlocking, and access authentication, due to the discriminative and easily obtainable facial biometric features. However, attackers can forge or steal identities in two ways to engage in illicit activities. As shown in the upper left of Fig. 1 (a), attackers can deceive face recognition systems by using physical media to impersonate others before information collection, a method known as physical attacks or presentation attacks. Additionally, attackers may employ digital forgery (commonly referred to as deepfake) to edit or manipulate collected images for fraudulent purposes. To address the aforementioned threats, Face Anti-Spoofing, also known as Presentation Attack Detection (PAD), and Face Forgery Detection (FFD) have been proposed to ensure the security of facial data. Essentially, both methods are formulated as binary classification tasks, where the model determines the authenticity of an image by outputting a probability indicating whether it is real or fake. Fig. 1: (a) The Physical and Digital Attack construction approaches. Physical Presentation Attacks aim to steal identity information before the capture devices, and Digital Attacks attempt to edit the existing image to falsify the face data. (b) Our UniAttackData+ is constructed in an explainable hierarchical way. The coarse-to-fine categories provide researchers with prior knowledge, which is helpful for the model designs. (c) A comparison of HiFAB with existing FAS, FFD, and UAD datasets shows that HiFAB surpasses all others in terms of attack types and video quantity. The radius of the circle represents the scale of the dataset, which is the number of videos contained in the dataset, corresponding to the horizontal axis of the figure. (Note: GrandFake is image-based) The vertical axis represents the number of attack types included in the dataset. (d) Sample demonstrations of the UniAttackData+. The samples are selected from the second level of the structure. The number following each category name indicates the number of attack types included. Researchers have proposed a wide variety of attack methods and have constructed multiple databases to advance the development of defense algorithms. Common physical presentation attacks are generally categorized into two types: 2D attacks ( i.e. , print attack [ 1 ] and video attack [ 2 ] ), and 3D attacks ( i.e. , mask [ 3 ] and fake head [ 4 ] ). Most models [ 5 , 6 , 7 , 8 , 9 , 10 , 11 ] achieve authenticity classification by analyzing image texture details, focusing on inconsistent edges, color distortion, screen moiré patterns, and mask pouring traces. However, their generalization severely deteriorates when faced with unknown domain datasets. Currently, domain generalization based PAD algorithms have become a hot research topic, such as UDG-FAS [ 12 ] , SA-FAS [ 13 ] , IADG [ 14 ] , FLIP-MCL [ 15 ] , GAC-FAS [ 16 ] , and TTDG-V [ 17 ] . Digital attack methods can be broadly classified into three categories: editing, adversarial attacks, and generative attacks. Digital editing attacks aim to modify image attributes [ 18 , 19 ] ( e.g. , changing facial expressions, age) or perform face swapping [ 20 , 21 ] ( e.g. , replacing the current face with another), video-driven manipulation [ 22 , 23 ] ( e.g. , using a video to drive facial expressions). Adversarial attacks can be divided into pixel-level [ 24 , 25 , 26 , 27 ] and semantic-level attacks [ 28 , 29 , 30 ] , which either modify or erase relevant pixels or alter high-dimensional semantics to manipulate the original facial data. Digital generative attacks [ 31 , 32 , 33 ] , the most recent and innovative type, involve generating entirely new facial data using generative models. To combat digital attacks, researchers [ 34 , 35 , 36 ] typically focus on detecting inconsistencies in pixel-level and semantic-level information to achieve robust classification performance. Fig. 2: The dashed lines represent the classification criteria that separate real and fake faces in the feature space. (a) Existing models are trained to draw a single ”line” in the