Bi-Encoder Contrastive Learning for Fingerprint and Iris Biometrics

Matthew So, Judah Goldfeder, Mark Lis, Hod Lipson · 2025

Read Bi-Encoder Contrastive Learning for Fingerprint and Iris Biometrics by Matthew So, Judah Goldfeder, Mark Lis, Hod Lipson (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-22937.txt.

Introduction

Matthew So, Judah Goldfeder, Mark Lis, and Hod Lipson test a common belief that body traits used for ID are unrelated to each other. They train paired neural networks on fingerprints and iris images from 274 people. The data held about one hundred thousand fingerprints and seven thousand iris images.

Their iris model scored well at matching one eye to the other, which suggests the left and right irises of one person do share patterns. Fingerprint results also hinted at links within one person. The study raises fresh questions for biometric security, since traits long treated as separate may carry shared clues.

Catalog record

CREATORMatthew So, Judah Goldfeder, Mark Lis, Hod Lipson
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE14 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2510-22937

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Bi-Encoder Contrastive Learning for Fingerprint and Iris Biometrics Matthew So, Judah Goldfeder, Mark Lis, Hod Lipson Abstract There has been a historic assumption that the biometrics of an individual are statistically uncorrelated. We test this assumption by training Bi - Encoder networks on three verification tasks, including fingerprint-to-fingerprint matching, iris-to-iris matching, and cross-modal fingerprint-to-iris matching using 274 subjects with ∼ \sim 100k fingerprints and 7k iris images. We trained ResNet - 50 and Vision Transformer backbones in Bi-Encoder architectures such that the contrastive loss between images sampled from the same individual is minimized. The iris ResNet architecture reaches 91 ROC AUC score for iris-to-iris matching, providing clear evidence that the left and right irises of an individual are correlated. Fingerprint models reproduce the positive intra - subject suggested by prior work in this space. This is the first work attempting to use Vision Transformers for this matching. Cross - modal matching rises only slightly above chance, which suggests that more data and a more sophisticated pipeline is needed to obtain compelling results. These findings continue challenge independence assumptions of biometrics and we plan to extend this work to other biometrics in the future. Code available: https://github.com/MatthewSo/bio_fingerprints_iris \workshoptitle Imageomics 1 Introduction Biometric traits such as fingerprints, voice, iris texture, hand geometry, and face have a history of being assumed to be statistically independent when sampled from a single individual. Even modern security systems and forensic workflows explicitly encode this assumption in their decision rules and probabilistic models ( Daugman 2004 ; Hollingsworth et al. 2011 ; Risch and Devlin 1992 ) . Recent evidence, however, questions this assumption. Guo et al. reported statistically significant intra-subject patterns in fingerprints and proposed a ResNet-style architecture that predicts same subject fingerprint pairs with better than random chance ( Guo et al. 2024 ) . This result has generated substantial interest across the biometrics community ( Starr 2024 ; Baily 2024 ) . A similiar independence assumption has persisted in the iris recognition space. Daugman’s foundational work framed the left and right irises of an individual as fundamentally random and uncorrelated ( Daugman and Downing 2001 ) , and Hollingsworth et al. reaffirmed that the left and right irises of the same person have uncorrelated irises when they assert, “it is generally accepted that the left and right irises of the same person have uncorrelated iris codes” ( Hollingsworth et al. 2011 ) . In ( Fang et al. 2019 ) , researchers experiment with matching genetically identical irises using grayscaled versions of the images on different channels of a CNN. They were able to demonstrate the predictive power of CNNs to match the irises of matching vs non-matching individuals. In this paper we extend the empirical investigation of intra subject biometric dependence in three key ways: 1. We attempt to replicate the fingerprint study of Guo et al. under a low-data regime, while also evaluating additional deep learning architectures. 2. We conduct an analysis of potential correlations between an individual’s two irises using contrastive loss with bi-encoder networks. 3. We examine cross-biometric correlation, and propse a framework to learn the extent to which patterns in fingerprints and irises can indicate a shared origin. Together, these efforts are aimed toward the development of a more nuanced understanding of biometric uniqueness. The work here is a jumping-off point for further research that will have direct implications for the design and security analysis of next generation biometric systems. 2 Problem Formulation and Approach Fundamentally, the problem we are trying to solve is determining if two images (two fingerprints, two irises, one iris/one fingerprint) come from the same individual or come from two different individuals. Formally, we treat biometric verification as a binary decision task. Given two images x_{1}\in\mathcal{X}_{1} , x_{2}\in\mathcal{X}_{2} ( \mathcal{X}_{1} may be the same, in the case of iris-to-iris matching, or different, in the case of fingerprint-to-iris matching, from \mathcal{X}_{2} ), the goal is to estimate f:\mathcal{X}_{1}\times\mathcal{X}_{2}\;\longrightarrow\;\{0,1\}, where f(x_{1},x_{2})=1 denotes a valid pair and 0 an invalid pair. Bi-Encoder (also known as Siamese networks) networks are excellent model candidates for this type of matching problem on images, and a similar approach was taken in Guo et al ( Malhotra 2023 ) . In classic Bi-Encoder architectures, we train a network that takes in two images (generally in the same representational space) and learns embeddings of the images ( Koch et al. 2015 ) . During training, one calculates the loss using a Contrastive Loss function that calculates a distance metric between the embeddings and then penalizes matching pairs with high distances and non-matching pairs with low distances. The contrastive loss in our formulation is calculated as: \displaystyle\mathcal{L}(x_{1},x_{2},y)=(1-y)\,\lVert g(z_{1})-g(z_{2})\rVert_{2}^{2}+y\,\bigl[\max(0,\,m-\lVert g(z_{1})-g(z_{2})\rVert_{2})\bigr]^{2} where g is the embedding network, m is the margin and y is the true label for x_{1} and x_{2} This results in embeddings that should be similar for matching pairs and far apart for non-matching pairs. In attempting to create networks to predict whether two random irises belong to the same individual (iris-to-iris) or two random fingerprints belong to the same individual (fingerprint-to-fingerprint), we used a traditional Bi-Encoder architecture. In tackling the one iris and one fingerprint problem, our first attempt involved a naive Bi-Encoder/Two Tower hybrid network approach that involved training two networks simultaneously, both of which had not previously seen fingerprint or iris data during pre-training. We also attempted to use the pretrained Bi-Encoder models from the iris-to-iris and fingerprint-to-fingerprint specific task models. 3 Methodology 3.1 Dataset We use a de-identified multi-biometric dataset collected by West Virginia University and Clarkson University, which links records via subject identifiers and enables cross-trait analysis while preserving privacy ( Crihalmeanu et al. ) . For this study we selected subjects with both fingerprint and iris data, yielding 274 individuals with \sim 100k fingerprint images and 7k iris images. 3.2 Data Preparation All images were grouped by subject and split at the subject level into train / val / test sets (80%/10%/10%), preventing identity leakage across splits. For each task we constructed balanced (1:1) positive/negative pair sets within each split: • Iris–iris: all left–right iris combinations from the same subject (label 1 ); negatives were left–right pairs from different subjects in the same split (label 0 ). • Fingerprint–fingerprint: pairs of different fingers from the same subject (label 1 ); negatives drawn from different subjects (label 0 ). • Iris–fingerprint: each iris of a subject paired with each fingerprint of the same subject (label 1 ); negatives paired with fingerprints from randomly sampled other subjects (label 0 ). Because image counts per subject vary, we normalized subject frequency by additional sampling of under-represented identities so that each individual contributes equally to training. When comparing multiple backbones, the exact same subject lists for train/val/test were reused across models to avoid cross-model leakage. 3.3 Training We train Bi-Encoder models with ResNet-50 and Vision Transformer backbones ( He et al. 2015 ; Dosovitskiy et al. 2020 ) . The final classification layer is replaced by a projection head (fully connected + batch normalization) producing the embedding. Models are optimized with Adam (initial LR 3\times 10^{-4} ) and a step-decay scheduler (step size =5 epochs, \gamma=0.1 ). We apply light augmentations (color jitter, small rotations, normalization) during training and disable augmentation at

Read the complete text