LatentPrintFormer: A Hybrid CNN-Transformer with Spatial Attention for Latent Fingerprint identification

Arnab Maity, Manasa, Pavan Kumar C, Raghavendra Ramachandra · 2025

Read LatentPrintFormer: A Hybrid CNN-Transformer with Spatial Attention for Latent Fingerprint identification by Arnab Maity, Manasa, Pavan Kumar C, Raghavendra Ramachandra (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-08119.txt.

Introduction

Arnab Maity and co-authors propose LatentPrintFormer for identifying people from latent fingerprints left at scenes. Latent prints are partial, noisy, and low quality, which makes matching them far harder than clean scans. Their model joins a convolutional network for local ridge detail with a transformer for global structure.

A spatial attention module highlights good ridge regions and suppresses background noise. Features from both backbones fuse into a single embedding, and matches are chosen by cosine similarity. On two public data sets, the system beats three leading latent fingerprint methods in identification rates at rank ten.

Catalog record

CREATORArnab Maity, Manasa, Pavan Kumar C, Raghavendra Ramachandra
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE27 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-08119

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

LatentPrintFormer: A Hybrid CNN-Transformer with Spatial Attention for Latent Fingerprint identification Arnab Maity, Manasa, Pavan Kumar C, Raghavendra Ramachandra Abstract Latent fingerprint identification remains a challenging task due to low image quality, background noise, and partial impressions. In this work, we propose a novel identification approach called LatentPrintFormer. The proposed model integrates a CNN backbone (EfficientNet-B0) and a Transformer backbone (Swin Tiny) to extract both local and global features from latent fingerprints. A spatial attention module is employed to emphasize high-quality ridge regions while suppressing background noise. The extracted features are fused and projected into a unified 512-dimensional embedding, and matching is performed using cosine similarity in a closed-set identification setting. Extensive experiments on two publicly available datasets demonstrate that LatentPrintFormer consistently outperforms three state-of-the-art latent fingerprint recognition techniques, achieving higher identification rates across Rank-10. 1 Introduction Fingerprint recognition is widely regarded as one of the most reliable biometric methods, with applications in personal authentication, national ID systems, and forensic investigations. While rolled and slap fingerprints are captured under controlled conditions with high-quality ridge detail, forensic scenarios often involve latent fingerprints unintentionally left on surfaces and later developed using chemical or physical methods. Latent fingerprints are typically partial, noisy, and low in contrast, often affected by background clutter, occlusions, and distortions. These factors make matching latent prints to rolled ones significantly more difficult. Traditionally, latent fingerprint recognition has relied on minutiae-based algorithms that extract and compare local ridge features such as bifurcations and ridge endings using geometric matching. In recent years, deep learning has gained significant traction in addressing the challenges of latent fingerprint matching. Grosz and Jain demonstrated the benefits of combining local and global features through the fusion of embeddings [ 10 ] , while their AFR-Net introduced attention mechanisms to enhance key ridge features in noisy prints [ 9 ] . Other efforts focus on image enhancement; for example, Yadav et al. employed fluorescent carbon quantum dots combined with machine learning to improve latent print visualization and matching [ 28 ] . These studies reflect ongoing progress toward more robust and automated latent fingerprint recognition systems. Despite recent advances, latent fingerprint matching remains highly challenging due to low image quality, noise, and partial impressions. In this study, we evaluate several state-of-the-art fingerprint matching algorithms to identify their limitations on latent prints. To address these challenges, we propose a lightweight hybrid architecture that combines convolutional and transformer-based features, enhanced by a spatial attention mechanism for more reliable representation. 2 Related Work Recent advancements in latent fingerprint recognition span several key areas of the biometric pipeline, including segmentation, minutiae extraction, quality assessment, and matching. Table 1 summarizes notable methods and their distinctive features, covering both traditional and deep learning-based approaches. For non-overlapped latent fingerprint segmentation, Cao et al. [ 2 ] introduced a coarse-to-fine dictionary learning framework that leverages TV decomposition, ridge structure modeling, and SSIM-based scoring, leading to a multi-stage Gabor based enhancement pipeline. Sankaran et al. [ 20 ] proposed an Adaptive Random Decision Forest (RDF) architecture with saliency-guided segmentation and RELIEF-based feature selection to improve ridge extraction. Deep learning models have also shown promise: Stojanović et al. [ 22 ] used CNN-based ROI classification with neighborhood smoothing, while Nguyen et al. [ 16 ] developed SegFinNet, a fully convolutional network combining visual attention with fusion voting for one-shot, non-patch-based segmentation. Additionally, Zhang et al. [ 30 ] presented a Directional TV (DTV) method using an augmented Lagrangian solver for orientation-aware decomposition and structured noise removal . In minutiae extraction, Su and Srihari [ 24 ] applied Gaussian Process Regression on orientation maps to estimate core points with being affected by rotation and translation. Sankaran et al. [ 21 ] created a stacked denoising sparse autoencoder (SDSAE) followed by binary classifiers to differentiate minutiae from non-minutiae areas, using ten print patches for training. Tang et al. [ 27 ] suggested a hybrid architecture combining FCN and CNN that uses multi-task learning for minutiae localization and orientation estimation without need for preprocessing. Also Tang et al. [ 26 ] proposed FingerNet that takes a comprehensive approach by integrating enhancement, orientation estimation, and minutiae detection into a single end-to-end CNN-based pipeline. Numerous methods have been developed for latent fingerprint comparison/identification. Deshpande et al. [ 6 ] proposed CNNAI, a CNN-based matcher that uses local minutiae descriptors and hash indexing for efficient search. Paulino et al. [ 18 ] introduced a non-deep-learning approach combining Minutia Cylinder Codes (MCC) with a Hough transform voting mechanism for alignment-free matching. Cao and Jain [ 1 ] presented a ConvNet-based template matcher that leverages both minutiae and texture features, demonstrating robustness to incomplete impressions. Grosz et al. [ 8 ] developed a minutiae-guided Vision Transformer (ViT) that uses minutiae heatmaps and grayscale ridge images to produce fixed-length embeddings, enabling over 2.5 million comparisons per second. Jain and Feng [ 11 ] introduced the Extended Feature Fusion Matcher, which incorporates manually annotated extended features based on the CDEFFS standard. Pan et al. [ 17 ] proposed the Dense Minutia Descriptor (DMD), a dual-branch CNN that generates spatially aware 3D descriptors with score normalization across overlapping regions. Finally, Cao et al. [ 3 ] presented an end-to-end latent search pipeline combining autoencoders, CNNs, and template fusion for fast retrieval using product quantization. Table 1: Overview of existing latent fingerprints techniques Method Architecture Key Features Non Overlapped Latent Fingerprint Segmentation Coarse-to-fine Dictionary [ 2 ] Dictionary Learning + Sparse Coding TV decomposition, ridge structure dictionary, SSIM-based quality scoring, coarse-to-fine enhancement with Gabor filters Adaptive RDF [ 20 ] Random Decision Forest (RDF) Saliency-guided segmentation, RELIEF-based feature selection Deep Learning Based ROI Segmentation [ 22 ] CNN Block-wise ROI classification, Neighborhood Smoothing SegFinNet [ 16 ] FCNN Visual attention, fusion voting, non-patch based, one-shot segmentation DTV [ 30 ] Directional TV + Augmented Lagrangian Solver Orientation-aware decomposition, structure noise removal Overlapped Latent Fingerprint Segmentation Orientation-Guided Separation [ 5 ] Fourier Transform + Relaxation Labeling Singularity-guided enhancement, relaxation labeling Model-Based Overlap Separation [ 31 ] Orientation Field Modeling + Polynomial Regression Iterative orientation field reconstruction, model-based prediction and regularization ANFIS [ 12 ] ANFIS Classifier + Feature Engineering + Orientation Field Reconstruction Fuzzy inference, orientation-guided separation, feature-based classification Neural Network-Based Separation [ 23 ] Neural Network and Fourier Analysis Local orientation modeling, iterative refinement and smoothing Minutiae Extraction Core Point Prediction via Gaussian Processes [ 24 ] Gaussian Process Regression on Orientation Maps Probabilistic core point estimation, rotation and translation invariant Minutiae Detection via SDSAE [ 21 ] Stacked Denoising Sparse Autoencoder (SDSAE) + Binary Classifiers Learns minutiae/non-minutiae descriptors from tenprint patches, patch-wise binary classification of latent prints Minutiae Extraction via FCN + CNN [ 27 ] FCN + CNN Multi-task loss for location and orientation, end-to-end minutiae detection without preprocessing FingerNet [ 26 ] CNN End-to-end enhancement, orientation estimation Quality Assessment LFIQ [ 29 ] Feature-based scoring system using ridge quality Ridge quality estimation via ridge amplitude and continuity, finger position estimation using orientation field and curvature-based core detection Deep Latent Quality Estimator [ 7 ] Deep Neural Network Patch-wise quality classification, automated segmentation using 8x8 patch classification Verification/Identification CNNAI [ 6 ] CNN Local minutiae-based, rotation-scale invariant, hash indexing MCC + Hough Transform [ 18 ] Non-DL

Read the complete text