diffDeMorph: Extending Reference-Free Demorphing to Unseen Faces

Nitish Shukla, Arun Ross · 2025

Read diffDeMorph: Extending Reference-Free Demorphing to Unseen Faces by Nitish Shukla, Arun Ross (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-14527.txt.

Introduction

Nitish Shukla and Arun Ross tackle a forgery problem in face photos, in a 2025 paper. A morph blends two people's faces into one image that matches both, a trick used to fool identity checks. Undoing a morph without any reference photo is called reference-free demorphing, and older methods worked only when the test photos resembled their training data.

Their method, diffDeMorph, uses a diffusion model to pull the two source faces back out of the blend. It is the first to hold up across morph-making styles and photo types, beating prior methods by a wide margin under a shared test protocol. The team trained it on computer-made faces yet tested it on real morphs, which keeps private photos out of training. Tests spanned six datasets and two face-matching systems.

Catalog record

CREATORNitish Shukla, Arun Ross
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE25 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-14527

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

diffDeMorph: Extending Reference-Free Demorphing to Unseen Faces Nitish Shukla, Arun Ross Abstract A face morph is created by combining two face images corresponding to two identities to produce a composite that successfully matches both the constituent identities. Reference-free (RF) demorphing reverses this process using only the morph image, without the need for additional reference images. Previous RF demorphing methods are overly constrained, as they rely on assumptions about the distributions of training and testing morphs such as the morphing technique used (e.g., landmark-based) and face image style (e.g., passport photos). In this paper, we introduce a novel diffusion-based approach, referred to as diffDeMorph, that effectively disentangles component images from a composite morph image with high visual fidelity. Our method is the first to generalize across morph techniques and face styles, beating the current state of the art by ≥ 59.46 % \geq 59.46\% under a common training protocol across all datasets tested. We train our method on morphs created using synthetically generated face images and test on real morphs, thereby enhancing the practicality of the technique. Experiments on six datasets and two face matchers establish the utility and efficacy of our method. † † address: Michigan State University, USA 1 Introduction A face morph is created by combining two face images corresponding to two identities in order to create a composite image that has high biometric similarity with the constituent identities [ 26 ] . Such images can be used to launch morph attacks, where, for example, a single ID card may be shared by multiple individuals. Traditionally, face morphs have been created by first extracting landmarks from faces and then aligning them for composition [ 1 , 11 ] . However, more recently, deep-learning based techniques have been successfully used in generating high-quality morphs [ 4 , 9 , 2 ] . Figure 1: Comparing diffDeMorph with existing reference-free demorphing methods under a common training protocol. Our method produces significantly better results in terms of visual fidelity and biometric match to the ground truth images. Note that our training protocol reflects a viable real-world use case. Facial demorphing is the inverse of this process. The goal is to recover the images used to create the morphs. Although Morph Attach Detection (MAD) techniques can flag morph images, they do not reveal any information about the images used to create the morph. Hence, the need for demorphing arises. Original facial demorphing methods were reference-based (RB) [ 10 , 21 ] , i.e., they require an image of one of the constituent identities in addition to the morph to recover the second image. More recently, reference-free (RF) demorphing methods, which require only the morph image, have been proposed with varying degrees of success [ 23 , 3 , 24 ] . RF demorphing is an inherently complex task due to the lack of constraints in image space as well as the absence of prior information such as the morph technique used. Indeed, given a single image, there are an infinite number of possible decompositions. Thus, the goal is to learn an applicable prior that can be generalized across morph distributions. Due to inherent complexities, previous methods for RF demorphing [ 23 , 3 , 24 ] operated under strict assumptions. While [ 23 ] and [ 24 ] assumed that train and test morphs are created using a common set of face images, [ 3 ] assumed that train and test morphs have similar passport-style face images. Moreover, all three methods assumed that the test morphs are generated using the same morph technique as the training morphs. Such assumptions significantly limit the generalization of these methods, leading to poor performance in real-world demorphing scenarios. In [ 23 ] , the authors proposed a diffusion-based method for demorphing. Although their method uses diffusion during the training phase, the backward sampling during inference lacks any generative aspect, which essentially reduces the denoising network to an equivalent auto-encoder. Moreover, they also assume that the train and test morphs are created from a common pool of face images, which is a strong assumption limiting the applicability of their method. In this work, we address the aforementioned limitations by i) introducing a morph-guided denoiser which conditions the denoising process on the morph image in the RGB domain, and ii) relaxing any constraints on the distribution of train/test morphs. Our method operates under a considerably more challenging and realistic protocol. In summary, our contribution is as follows: • We propose a novel diffusion-based demorphing method, referred to as diffDeMorph, which reconstructs the constituent images conditioned on the morph in the RGB domain. Our method outperforms the current state of the art by a significant margin under a common training protocol. • To the best of our knowledge, our method is the first to perform demorphing with no assumptions about image style/morphing technique used to create test morphs, thereby enhancing the practical utility of the method. • We further explore various scenarios arising in the real world in terms of train/test distribution (see Section 6 ). Our method consistently outperforms existing methods with excellent visual fidelity. 2 BACKGROUND 2.1 Face Demorphing Throughout this paper, we denote the morph image as x and the constituent images as i_{1},i_{2} such that x=\mathcal{M}(i_{1},i_{2}) , where, \mathcal{M} is a black-box morphing operator. The goal of \mathcal{M} is to ensure that \mathcal{B}(x,i_{k})>\tau , k\in\{1,2\} , with respect to a face matcher \mathcal{B} that produces similarity scores and a threshold \tau . Demorphing attempts to invert the morphing process. A demorphing operator, \mathcal{DM}(=\mathcal{M}^{-1}) , inputs the morph image, x , and reconstructs the constituent images, o_{1},o_{2}=\mathcal{DM}(x) , satisfying the conditions: \mathcal{B}(o_{1},o_{2})<\theta (1) \min_{j\in\{1,2\}}\max_{\begin{subarray}{c}k\in\{1,2\}\\ k\neq j\end{subarray}}\{\ \ \mathcal{B}(o_{j},i_{k}),\mathcal{B}(o_{j},i_{j})\ \ \}>\epsilon (2) where, \theta and \epsilon are similarity thresholds. Eqn. ( 1 ) enforces the reconstructed outputs to appear dissimilar to each other (to avoid the morph replication problem [ 25 ] ) and Eqn. ( 2 ) ensures that each reconstructed output matches with its corresponding ground truth image. In the literature, demorphing has been explored under various scenarios based on the composition of the training and testing morphs [ 24 , 25 ] . Consider a set of face images, \mathcal{Y} , that is used to generate the train and test morphs. Scenario 1: Train and test morphs are generated from pairs of identities in \mathcal{Y} . This means that some train and test morphs will be created from the same identity pairs. Scenario 2: Here, \mathcal{Y} is divided into two sets with disjoint identities, \mathcal{Y}_{1} and \mathcal{Y}_{2} . The train morphs are created from pairs of identities in \mathcal{Y}_{1} . Each test morph is created using one identity in \mathcal{Y}_{1} and another identity in \mathcal{Y}_{2} . Scenario 3: Here, \mathcal{Y} is divided into two sets with disjoint identities, \mathcal{Y}_{1} and \mathcal{Y}_{2} . The train morphs are created from pairs of identities in \mathcal{Y}_{1} . The test morphs are created from pairs of identities in \mathcal{Y}_{2} . Note that the datasets used in this paper consist of a single face image per identity, with only neutral face images from the FRLL dataset being used to generate the test morphs. Consequently, the terms “images” and “identities” are sometimes used interchangeably. In this paper, we focus on

Read the complete text