ColFigPhotoAttnNet: Reliable Finger Photo Presentation Attack Detection Leveraging Window-Attention on Color Spaces

Anudeep Vurity, Emanuela Marasco, Raghavendra Ramachandra, Jongwoo Park · 2025

Read ColFigPhotoAttnNet: Reliable Finger Photo Presentation Attack Detection Leveraging Window-Attention on Color Spaces by Anudeep Vurity, Emanuela Marasco, Raghavendra Ramachandra, Jongwoo Park (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-05247.txt.

Introduction

Phones that unlock with a finger photo can be fooled by fake images, so the phone needs a way to spot such attacks. Anudeep Vurity, Emanuela Marasco, Raghavendra Ramachandra, and Jongwoo Park tackle that problem in a 2025 paper on finger photo attack detection.

The team first tested how well current systems hold up when photos come from a phone model they were not trained on, and found that performance drops. They then built a new network that pays close attention to color channels in small windows of the image. Tests on three public data sets, using phones such as the iPhone 13 Pro and Google Pixel 3, showed the new design stayed reliable across devices.

Catalog record

CREATORAnudeep Vurity, Emanuela Marasco, Raghavendra Ramachandra, Jongwoo Park
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE33 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-05247

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

ColFigPhotoAttnNet: Reliable Finger Photo Presentation Attack Detection Leveraging Window-Attention on Color Spaces Anudeep Vurity, Emanuela Marasco, Raghavendra Ramachandra, Jongwoo Park Abstract Finger photo Presentation Attack Detection (PAD) can significantly strengthen smartphone device security. However, these algorithms are trained to detect certain types of attacks. Furthermore, they are designed to operate on images acquired by specific capture devices, leading to poor generalization and a lack of robustness in handling the evolving nature of mobile hardware. The proposed investigation is the first to systematically analyze the performance degradation of existing deep learning PAD systems, convolutional and transformers, in cross-capture device settings. In this paper, we introduce the ColFigPhotoAttnNet 1 1 1 The implementation of ColFigPhotoAttnNet can be accessed at https://github.com/avurity/ColFigPhotoAttnNet architecture designed based on window attention on color channels, followed by the nested residual network as the predictor to achieve a reliable PAD. Extensive experiments using various capture devices, including iPhone13 Pro, GooglePixel 3, Nokia C5, and OnePlusOne, were carried out to evaluate the performance of proposed and existing methods on three publicly available databases. The findings underscore the effectiveness of our approach. 1 Introduction The demand for robust security and seamless user identity verification is allowing growth in mobile biometric adoption. Smartphone cameras enable contactless biometric fingerprint capture for reliable identity verification in various practical applications, including mobile voting, BFSI (Banking, Financial Services, and Insurance), and healthcare sectors [ 52 , 11 , 1 ] . Government initiatives promote the integration of these technologies into public services and enterprises. Through the Mobile Biometric Application (MBA) program, FBI agents and federal task force officers (TFOs) use mobile devices (e.g., cell phones and tablets) to confirm an individual’s identity in situations and locations where mobile biometric identification is necessary, such as mass arrests and natural disasters. Figure 1 : On the left, it shows the bona fide and attack capture mechanisms. On the right, there are examples of each scenario. Although finger photo recognition can effectively secure these devices, the technology is vulnerable to presentation attacks (PAs). Examples of bona fide and PAs are illustrated in Figure 1 . Although PAD algorithms can fortify the system against these threats, they are not designed to handle devices’ fast innovation and continuous evolution [ 41 , 9 ] . Modern smartphones have changed the photography function significantly, with upgraded cameras featuring high-definition, night mode, and anti-shake characteristics. These changes contribute to PAD performance degradation. In critical applications impacting human beings, creating trustworthy decision-making systems is essential [ 29 , 42 , 30 ] . Capture bias is related to how the images are acquired both in terms of the used device and the collector’s preferences regarding point of view, lighting conditions, etc. [ 46 , 47 , 22 ] . If not addressed, this concern can increase mistrust of the technology [ 19 ] . The development of attention mechanisms brought many benefits to several computer vision tasks and was inspired by the ability of humans to find salient characteristics in intricate views [ 49 , 14 , 53 ] . Attention ”implies the withdrawal from some things to deal effectively with others” and makes humans perceive, comprehend, and distinguish more effectively [ 20 ] . This paper discusses a new hybrid architecture that combines multiple CNNs, each leveraging attention to different color spaces. The corresponding embeddings are then integrated by feature-level fusion [ 38 , 5 , 10 , 26 ] . Incorporating various color spaces in the PAD design is motivated by excellent results obtained in previous research [ 32 , 35 , 54 , 13 ] . The contribution of this paper is summarized as follows: • We propose the ColFigPhotoAttnNet architecture that combines multiple CNNs, each leveraging attention to different color spaces. This design aims to achieve robust finger photo PAD. • Our study is the first to systematically analyze the performance of existing SOTA deep learning PAD systems, including convolutional and transformer-based models, in cross-capture device settings. To assess their generalization and robustness, we evaluated the proposed and existing methods using various capture devices, including iPhone 13 Pro (iPhone), Google Pixel 3 (google), Nokia C5 (Nokia), and OnePlus One (OPO). • We extensively evaluate the performance of PAD systems in both inter-capture and intra-capture device scenarios. The rest of the paper is organized as follows: Section 2 describes the review of the literature, Section 3 discusses the proposed approach, Section 4 presents our experimental results, and finally Section 5 draws conclusions. 2 Literature Review In this literature, we are only focusing on finger photo PAD research. Early studies explored PAD using handcrafted features, such as reflection properties, texture-based features like micro-textures, gradients, and light reflections, often classified using machine learning algorithms, particularly Support Vector Machines (SVMs) [ 15 , 21 , 28 , 17 ] . In 2022, Marasco et al. introduced a framework that segments the finger region based on the distal phalange and converts it into multiple color spaces. Local patches around minutiae points are extracted and fed into an ensemble of pre-trained CNN architectures. Deeply learned features from these CNNs are combined using late fusion to make a global decision for distinguishing live versus spoof finger photo presentations. This method leverages texture patterns and minutiae information across diverse color representations for robust presentation attack detection [ 32 ] . In 2023, Li et al. conducted a comparative evaluation involving deep learning models like DenseNet 021, ResNet50, Efficient Net, Vision transformers, etc. Their study aimed to identify the most robust solution against this specific type of spoof attack [ 23 ] . Also, in the same year, Li et al. performed a detailed survey on deep learning techniques employed on finger photo PAD, showing that state-of-the-art methods have employed popular architectures like DenseNet variants, MobileNets-V2, MobileNet-V3, Efficient Net variants, and Vision Transformers [ 24 ] . As PAD models, Purnapatra et al. fine-tuned two deep learning architectures, DenseNet and NasNetMobile. By adapting the pre-trained weights of these models to the finger photo PAD task, they achieved impressive results with an Attack Presentation Classification Error Rate (APCER) of 0.00%, Bona fide Presentation Classification Error Rate (BPCER) of 0.18% against the known attack types in their dataset [ 37 ] . The authors explored incorporating color during the presentation attack instrument (PAI) casting process to obtain skin-colored PAIs. Adami et al. proposed an unsupervised finger PAD method combining an autoencoder and convolutional block attention. This unsupervised approach achieved a BPCER of 0.96% and APCER of 1.6% [ 2 ] . In 2024, the researchers benchmarked the detection performance of eight popular pre-trained deep neural network models across three different finger photo segmentation schemes on a public finger photo dataset with four different presentation attack instruments [ 25 ] . The researchers proposed an explainable PAD framework using Grad-CAM and SNR metrics to quantify key features for detecting finger photo presentation attacks [ 51 ] . CNNs represent the prevailing architectural paradigm in computer vision, including architectures of MobileNet family [ 40 , 18 ] , VGG [ 43 ] , ResNet [ 16 ] , and EfficientNet [ 44 ] . More recently, different variants of Vision Transformers leveraging various attention mechanisms, exhibited superior performance in multiple tasks, including classification,

Read the complete text