Concept Discovery in Deep Neural Networks for Explainable Face Anti-Spoofing

Haoyuan Zhang, Xiangyu Zhu, Li Gao, Jiawei Pan, Kai Pang, Guoying Zhao, Stan Z. Li, Zhen Lei · 2024

Read Concept Discovery in Deep Neural Networks for Explainable Face Anti-Spoofing by Haoyuan Zhang, Xiangyu Zhu, Li Gao, Jiawei Pan, Kai Pang, Guoying Zhao, Stan Z. Li, Zhen Lei (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-17541.txt.

Introduction

Haoyuan Zhang and co-authors teach face anti-spoofing systems to explain their verdicts, in a 2024 paper. Face recognition guards phones and doors, and spoof detectors block photos, masks, and replays. Existing detectors reach high accuracy but answer only fake or real, never why, which erodes trust when a user is turned away.

The authors define explainable face anti-spoofing as a task in its own right. Their method discovers spoof traces, the visual concepts that betray an attack, and grounds explanations in them. To judge explanation quality, they built a benchmark with expert-annotated traces. Against earlier explainability methods, theirs produced more reliable explanations in both numbers and examples. The work argues security systems owe users reasons, and shows how to extract them from the model's own evidence.

Catalog record

CREATORHaoyuan Zhang, Xiangyu Zhu, Li Gao, Jiawei Pan, Kai Pang, Guoying Zhao, Stan Z. Li, Zhen Lei
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE18 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2412-17541

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Concept Discovery in Deep Neural Networks for Explainable Face Anti-Spoofing Haoyuan Zhang, Xiangyu Zhu, Li Gao, Jiawei Pan, Kai Pang, Guoying Zhao, Stan Z. Li, Zhen Lei Abstract With the rapid growth usage of face recognition in people’s daily life, face anti-spoofing becomes increasingly important to avoid malicious attacks. Recent face anti-spoofing models can reach a high classification accuracy on multiple datasets but these models can only tell people “this face is fake” while lacking the explanation to answer “why it is fake”. Such a system undermines trustworthiness and causes user confusion, as it denies their requests without providing any explanations. In this paper, we incorporate XAI into face anti-spoofing and propose a new problem termed X-FAS (eXplainable Face Anti-Spoofing) empowering face anti-spoofing models to provide an explanation. We propose SPED (SPoofing Evidence Discovery), an X-FAS method which can discover spoof concepts and provide reliable explanations on the basis of discovered concepts. To evaluate the quality of X-FAS methods, we propose an X-FAS benchmark with annotated spoofing evidence by experts. We analyze SPED explanations on face anti-spoofing dataset and compare SPED quantitatively and qualitatively with previous XAI methods on proposed X-FAS benchmark. Experimental results demonstrate SPED’s ability to generate reliable explanations. I Introduction Due to the vulnerability of face recognition systems to attack, academia and industry have paid extensive attention to face anti-spoofing technology [ 1 ] . Nowadays, face anti-spoofing technologies [ 2 , 3 , 4 , 5 ] have already reached a high level of defense against physical attacks such as print, replay, makeup and 3D masks, etc. However, these technologies can only answer the question “whether the photograph provided was fake” while lacking the evidence to support its results which brings doubts and implicit bias. When a facial recognition system rejects an image for security reasons, it is considered necessary for the system to provide an explanation. Without such an explanation, the interaction can become not only frustrating and uncomfortable for users, but also lack transparency and trustworthiness. Thus an X-FAS (eXplainable Face Anti-Spoofing) system is advocated to provide user-friendly face anti-spoofing results by generating explanations based on face anti-spoofing models, which is the goal of this paper. We believe X-FAS is crucial as it can make the anti-spoofing system more comprehensive and significantly enhance the user experiences and reliability of the systems. Fig. 1: X-FAS method provide explanations on top of classification result. Imp indicates the importance of the concept . The field of XAI (eXplainable Artificial Intelligence) [ 6 , 7 , 8 , 9 ] has emerged to demystify the inner workings of black-box models and offer insights into their decision-making processes. These techniques examine the basis of the model’s results and present in the form of heatmaps of interesting regions. Recent XAI methods [ 10 , 11 ] begin to find the importance of concept discovering, for example, CRAFT [ 12 ] can find and mark saw blade in a image of class “chain saw”, making XAI provides not only a heatmap but also the corresponding activated concept. Fig. 2: The structure of proposed SPED. The left part (orange box) shows the pipeline of SPED, we first discover concepts from a give dataset and reveal evidence from a single image input. The right part (green box) shows the detailed method of SPED of how to discover concepts and reveal evidence. In this paper, we introduce SPED (SPoofing Evidence Discovery), an X-FAS method that can discover spoof concepts and provide explanations of attack images. Given a well-trained face anti-spoofing model, SPED can discover spoof concepts from a given spoof dataset and analyze the importance of each concept without changing the anti-spoofing model, thus keep the original performance. With the help of discovered concept basis, SPED can mark the attention region of each concept if the input image is judged as a fake sample during inference. Examples are shown in Fig. 1 , SPED find multiple activated concepts in attack images and provide the corresponding attention regions. To perform evaluation on X-FAS methods, we present an X-FAS benchmark to evaluate the quality of the generated explanations. Experiments show that SPED can discover key spoof concepts and provide a heatmap of corresponding concepts in face anti-spoofing tasks which increase the trustworthiness of users. Our main contributions can be described as follows: 1. We propose a new problem termed X-FAS (e X plianable F ace A nti- S poofing) that generates reliable explanations on top of face anti-spoofing classification results and introduce an X-FAS method SPED ( SP oofing E vidence D iscovery) which can discover spoof concepts and provide attention region of each concept in attack images. 2. We propose an X-FAS benchmark with expert annotations to evaluate the quality of explanations generated by X-FAS methods. The analysis of SPED explanations on face anti-spoofing dataset and results on X-FAS benchmark show the efficacy of SPED and demonstrate the ability to discover concepts and provide explanation of attack samples. II Method In order to discover concepts of the attack image on faces and show the activated spoof concept and its region on the input sample, we separate the method into three parts which are concept discovery, importance analysis, and attribution estimation. The whole pipeline and detail of SPED can be seen in the left and right part of Fig. 2 respectively. II-A Preliminaries Consider a general supervised learning setting, where (\boldsymbol{x}_{1},\cdots,\boldsymbol{x}_{N})\in\mathcal{X}^{N}\in\mathbb{R}^{N\times D} are N inputs images and (y_{1},\cdots,y_{n})\in\mathcal{Y}^{N} their associated labels. We are given a well trained predictor \boldsymbol{f}:\mathcal{X}\rightarrow\mathcal{Y} which maps the input \boldsymbol{x} to the predicted class \boldsymbol{f}(\boldsymbol{x}) . We decompose the neural network \boldsymbol{f} into two components \boldsymbol{g} and \boldsymbol{h} where \boldsymbol{g} maps input \boldsymbol{x} to intermediate logits \boldsymbol{g}(\boldsymbol{x}) and the second maps the intermediate logtis \boldsymbol{g}(\boldsymbol{x}) to output \boldsymbol{h}(\boldsymbol{g}(\boldsymbol{x})) . The original function \boldsymbol{f} is reconstructed as \boldsymbol{f}=\boldsymbol{h}\circ\boldsymbol{g} . II-B Concept discovery The process of concept discovery is illustrated in the right part of Fig. 2 with pink arrow. Firstly, we gather a set of images that one wish to explain. There should be commonalities between these images, such as attack images with the same spoof strategy. We assume \pi(\cdot) is a straightforward crop and resize function to create sub-regions and get a auxiliary dataset \mathbf{X}\in\mathbb{R}^{N^{\prime}\times d} . To discover concepts, we feed \mathbf{X} to the network to obtain activations \mathbf{A}=\boldsymbol{g}(\mathbf{X})\in\mathbb{R}^{N^{\prime}\times hw\times C} where hw indicates the shape of activation map and C indicates the number of channel. We apply Semi-NMF (Semi Non-negative Matrix Factorization) [ 13 ] to factorize activation maps since the non-negative constraint on the coefficients brings better interpretability while remain the capability to process negative values. Semi-NMF decompose the average pooled activations \mathbf{A} into a product of concept coefficients \mathbf{U}\in\mathbb{R}^{N^{\prime}\times K} and concept basis \mathbf{W}\in\mathbb{R}^{C\times K} by solving: \displaystyle(\mathbf{U},\mathbf{W})=\mathop{\arg\min}\limits_{\mathbf{U}\geq 0,\mathbf{W}}\|\mathbf{A}-\mathbf{U}\mathbf{W}^{\intercal}\|^{2}_{F}, (1) where K indicates the number of concepts to discover and \|\cdot\|^{2}_{F} denotes the Frobenius norm. According to Ding et al. [ 13 ] , the objective can be solved by iterativley updating \mathbf{U} and \mathbf{W} as follows: \displaystyle\mathbf{W}=\boldsymbol{X}^{\intercal}\mathbf{U}(\mathbf{U}^{\intercal}\mathbf{U})^{-1}, (2) \displaystyle\mathbf{U}=\mathbf{U}\cdot\sqrt{\frac{(\boldsymbol{X}\mathbf{W})^{+}+\mathbf{U}(\mathbf{W}^{\intercal}\mathbf{W})^{-}}{(\boldsymbol{A}\mathbf{W})^{-}+\mathbf{U}(\mathbf{W}^{\intercal}\mathbf{W})^{+}}}, (3) where the separated positive and negative parts of a matrix \mathbf{M} is: \displaystyle\mathbf{M}^{+}=(|\mathbf{M}|+\mathbf{M})/2,\ \ \ \mathbf{M}^{-}=(|\mathbf{M}|-\mathbf{M})/2 II-C Importance analysis The process of concept discovery is illustrated in the right part of Fig. 2 with gray arrow. We

Read the complete text