rPPG-SysDiaGAN: Systolic-Diastolic Feature Localization in rPPG Using Generative Adversarial Network with Multi-Domain Discriminator
Banafsheh Adami, Nima Karimian · 2025
Read rPPG-SysDiaGAN: Systolic-Diastolic Feature Localization in rPPG Using Generative Adversarial Network with Multi-Domain Discriminator by Banafsheh Adami, Nima Karimian (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-01220.txt.
Introduction
Banafsheh Adami and Nima Karimian wrote a 2025 paper on recovering the heartbeat's shape from face video using a generative adversarial network. Remote photoplethysmography reads tiny color changes in skin to track vital signs without contact. Existing methods often recover only heart rate, blurring the systolic and diastolic features that carry extra health information.
Their network judges candidate signals with three discriminators at once: one in the time domain, one in frequency, and one on the signal's second derivative. Four loss functions shape training, penalizing noise-driven wobbles, misalignment, and wrong spacing between the systolic and diastolic phases. Sparsity and variance terms tune heart rate and spread energy correctly. The goal is a faithful waveform, not just a number. Such detail could widen camera-based health monitoring.
Catalog record
| CREATOR | Banafsheh Adami, Nima Karimian |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 36 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-01220
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
rPPG-SysDiaGAN: Systolic-Diastolic Feature Localization in rPPG Using Generative Adversarial Network with Multi-Domain Discriminator Banafsheh Adami, Nima Karimian Abstract Remote photoplethysmography (rPPG) offers a novel approach to noninvasive monitoring of vital signs, such as respiratory rate, utilizing a camera. Although several supervised and self-supervised methods have been proposed, they often fail to accurately reconstruct the PPG signal, particularly in distinguishing between systolic and diastolic components. Their primary focus tends to be solely on extracting heart rate, which may not accurately represent the complete PPG signal. To address this limitation, this paper proposes a novel deep learning architecture using Generative Adversarial Networks by introducing multi-discriminators to extract rPPG signals from facial videos. These discriminators focus on the time domain, the frequency domain, and the second derivative of the original time domain signal. The discriminator integrates four loss functions: variance loss to mitigate local minima caused by noise; dynamic time warping loss to address local minima induced by alignment and sequences of variable lengths; Sparsity Loss for heart rate adjustment, and Variance Loss to ensure a uniform distribution across the desired frequency domain and time interval between systolic and diastolic phases of the PPG signal. 1 Introduction Continuously monitoring vital signs without interrupting patients is crucial in healthcare. Traditional methods (e.g., contact PPG, ECG) limit comfort and hygiene due to skin contact [ 21 ] . The combination of computer vision and deep learning has paved the way for remote photoplethysmography (rPPG), a revolutionary method to measure physiological data without physical contact [ 38 ] . Remote photoplethysmography (rPPG) leverages cameras to capture minute changes in facial color [ 27 ] . These variations translate into an rPPG signal, which acts like a contactless version of the traditional PPG signal. This allows for the measurement of vital signs such as heart rate (HR) [ 29 , 30 ] . Early rPPG research relied on manual methods for processing the signal and extracting key features. However, with the rise of deep learning, researchers have developed supervised and unsupervised techniques. These techniques utilize various network architectures and training methods to estimate rPPG signals directly from facial video data [ 4 , 43 , 35 , 8 ] . Current deep learning methods for rPPG excel in estimating heart rate and some aspects of heart rate variability, but struggle to capture the full details of the PPG signal waveform. This includes important features such as systolic and diastolic waves. Although these methods are promising, they need improvement to accurately represent the complete picture of physiological information. To address this limitation, we propose a new deep learning architecture called Swin-AUnet. This approach uses a generative adversarial network (GAN) to create rPPG signals that mimic the shape and features of real PPG signals. Our system analyzes the signal in multiple ways, including its timing, frequency, and rate of change. By considering these different aspects and incorporating physiological knowledge, Swin-AUnet can capture the finer details of the PPG waveform, including the peaks and valleys that correspond to systolic and diastolic blood pressure. It is important to note that our method is supervised, as it relies on ground truth PPG signals during training to guide the learning process and ensure accurate rPPG estimation. Our main contributions in this paper are as follows: 1) Our system analyzes the rPPG signal in multiple ways, including its timing (original signal and its rate of change) and frequency content. This comprehensive analysis helps the model create a more accurate representation of the PPG signal. Notably, we’re the first to incorporate the second derivative of the PPG signal for rPPG estimation from facial videos. 2) We employ a combination of loss functions in both the time and frequency domains. These functions guide the model during training, ensuring that it prioritizes key aspects such as accurate timing, distribution of information between frequencies, and sparsity (appropriate heart rate). Although using multiple functions might seem complex, each one plays a specific role in achieving a faithful reconstruction. 3) We incorporate Dynamic Time Warping (DTW) as a loss function. This helps align the reconstructed rPPG signal with the real PPG signal, even if there are slight shifts over time. This makes the model more robust to variations in the PPG waveform. 4) We use a wavelet transform to analyze the frequency content of the PPG signal. This allows us to examine both high-frequency and low-frequency components simultaneously, providing a richer understanding of the signal’s behavior. The specific wavelet function used (DB4 in our case) is chosen because it closely resembles the patterns observed in PPG signals. This allows it to effectively capture the key features that differentiate a real PPG signal from a remote one. 5) Previous rPPG research often focused solely on heart rate, which does not provide a complete picture of cardiovascular health. In contrast, our approach uses a second derivative loss function to capture the shape and features of the PPG waveform. This allows for the reconstruction of crucial details like the systolic and diastolic phases, offering valuable insights into the condition of the blood vessel and other hemodynamic parameters. Figure 1: (A) The proposed architecture (GAN) includes one generator and three discriminators: one for the time domain, one for the frequency domain, and one for the second derivative of the time domain signal. (B) Dynamic Time Warping (DTW) illustrates that time series are vertically shifted; however, the ranges of feature values (y-axis values) remain consistent or aligned. (C) Sparsity Loss is used for heart rate adjustment, and Variance Loss ensures a uniform distribution across the desired frequency domain and the time interval between systolic and diastolic phases of the PPG signal. 2 Related Work 2.1 Traditional Verkruysse et al. [ 38 ] pioneered the use of remote photoplethysmography (rPPG) for physiological measurement in 2008. Since then, various conventional handcrafted methodologies have been developed in the field. Unlike simple averaging of color channels throughout the detected facial area, more effective techniques to extract subtle rPPG signals involve selective integration of information from different color channels [ 27 , 28 ] and specific regions of interest (ROI). Furthermore, adaptive temporal filtering techniques, as proposed by Li et al. [ 13 ] , have also contributed to signal recovery. To enhance the signal-to-noise ratio of recovered rPPG signals, various signal decomposition methods have been introduced, including Independent Component Analysis (ICA) [ 27 ] and matrix completion [ 37 ] . Moreover, color space projection methods like chrominance subspace [ 6 ] and skin-orthogonal space [ 40 ] have been developed to address challenges related to skin tone and head motion. While these approaches have made notable progress in the early stages, they still have limitations. Specifically, they require empirical knowledge to design components, such as hyperparameters in signal processing filtering, and lack supervised learning models that can handle data variations, particularly in demanding environments with significant interference. 2.2 Supervised In recent years, deep learning (DL) techniques for remote photoplethysmography (rPPG) measurement have gained significant traction. Studies [ 4 , 33 , 15 , 26 , 11 ] have utilized 2D convolutional neural networks (2DCNN) with two consecutive video frames as input to accurately estimate rPPG. Other DL-based approaches [ 24 , 18 , 23 , 19 , 7