Beyond Single-Channel: Multichannel Signal Imaging for PPG-to-ECG Reconstruction with Vision Transformers
Xiaoyan Li, Shixin Xu, Faisal Habib, Arvind Gupta, Huaxiong Huang · 2025
Read Beyond Single-Channel: Multichannel Signal Imaging for PPG-to-ECG Reconstruction with Vision Transformers by Xiaoyan Li, Shixin Xu, Faisal Habib, Arvind Gupta, Huaxiong Huang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-21767.txt.
Introduction
Xiaoyan Li and co-authors rebuild the heart's electrical trace from a fingertip pulse signal, in a 2025 biomedical paper. Turning PPG into ECG is attractive for wearables, but fine waveform details are easy to lose. Their method feeds a vision transformer a four-channel picture of the pulse. The channels hold the raw signal, its two rates of change, and the area beneath it, so both timing and shape cues survive.
The transformer's attention links beats to each other and to their own parts. Across tests the method cut reconstruction error by up to 29 percent against strong one-dimensional baselines. New error measures on clinically meaningful intervals backed the gain, pointing to more faithful traces.
Catalog record
| CREATOR | Xiaoyan Li, Shixin Xu, Faisal Habib, Arvind Gupta, Huaxiong Huang |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 63 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-21767
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Beyond Single-Channel: Multichannel Signal Imaging for PPG-to-ECG Reconstruction with Vision Transformers Xiaoyan Li, Shixin Xu, Faisal Habib, Arvind Gupta, Huaxiong Huang Abstract Reconstructing ECG from PPG is a promising yet challenging task. While recent advancements in generative models have significantly improved ECG reconstruction, accurately capturing fine-grained waveform features remains a key challenge. To address this, we propose a novel PPG-to-ECG reconstruction method that leverages a Vision Transformer (ViT) as the core network. Unlike conventional approaches that rely on single-channel PPG, our method employs a four-channel signal image representation, incorporating the original PPG, its first-order difference, second-order difference, and area under the curve. This multi-channel design enriches feature extraction by preserving both temporal and physiological variations within the PPG. By leveraging the self-attention mechanism in ViT, our approach effectively captures both inter-beat and intra-beat dependencies, leading to more robust and accurate ECG reconstruction. Experimental results demonstrate that our method consistently outperforms existing 1D convolution-based approaches, achieving up to 29% reduction in PRD and 15% reduction in RMSE. The proposed approach also produces improvements in other evaluation metrics, highlighting its robustness and effectiveness in reconstructing ECG signals. Furthermore, to ensure a clinically relevant evaluation, we introduce new performance metrics, including QRS area error, PR interval error, RT interval error, and RT amplitude difference error. Our findings suggest that integrating a four-channel signal image representation with the self-attention mechanism of ViT enables more effective extraction of informative PPG features and improved modeling of beat-to-beat variations for PPG-to-ECG mapping. Beyond demonstrating the potential of PPG as a viable alternative for heart activity monitoring, our approach opens new avenues for cyclic signal analysis and prediction. Journal: Pattern Recognition 1 Introduction Electrocardiograms (ECGs) are essential tools for diagnosing and monitoring cardiovascular health, providing crucial insights into heart rate variability (HRV), heart rate, and key waveform features. These include the QRS complex, PR interval, ST segment, TP interval, and QT interval, which are vital for understanding the heart’s electrical activity and diagnosing various cardiac conditions [ 1 , 2 ] . For example, a normal PR interval ranges from 120 to 200 milliseconds. Prolonged PR intervals may indicate first-degree atrioventricular (AV) block or delayed conduction through the AV node, suggesting potential cardiac conduction issues [ 3 ] . Conversely, shortened PR intervals might imply conditions such as Wolff-Parkinson-White (WPW) syndrome or Lown-Ganong-Levine syndrome, where accessory pathways bypass the normal AV nodal delay [ 3 ] . Similarly, prolonged ST segments are indicative of myocardial ischemia or acute myocardial infarction, resulting from delayed repolarization, or may reflect ventricular conduction defects that affect the timing of repolarization [ 2 ] . On the other hand, abnormally short ST segments can be a sign of hyperkalemia, which typically shortens ventricular repolarization, or congenital short QT syndrome, a rare but serious condition associated with a high risk of arrhythmias [ 3 ] . Building on these diagnostic capabilities, recent research has explored using ECG signals for noninvasive serum electrolyte prediction and monitoring [ 4 , 5 ] . Despite the clinical significance of detailed waveform features, much of the existing research on ECG reconstruction from photoplethysmography (PPG) has primarily focused on estimating HRV and heart rate [ 6 , 7 ] . However, these approaches often struggle to accurately recover smaller, yet diagnostically important, waveform components such as the T and P waves [ 8 ] . To address this limitation, we propose a novel method that emphasizes the precise reconstruction of these critical ECG features. By prioritizing accurate prediction and measurement of complete waveforms, our approach aims to enable more comprehensive evaluation and enhanced diagnostic capability. Reconstructing ECG signals from PPG addresses several limitations of traditional ECG monitoring, including restricted mobility, skin irritation, and the reliance on offline data processing [ 9 ] . As a non-invasive, wearable-compatible technology, PPG offers significant advantages for long-term and real-time cardiovascular monitoring [ 10 ] . For instance, Gil et al. [ 11 ] demonstrated the value of PPG in assessing vascular and respiratory functions, while Chua et al. [ 12 ] explored its application in nocturnal blood pressure estimation. Nevertheless, ECG remains the clinical gold standard due to its superior resolution of key waveform components crucial for cardiac diagnostics. The intrinsic physiological relationship between ECG and PPG, where cardiac electrical activity governs peripheral blood volume changes [ 13 ] , underpins the rationale for PPG-to-ECG reconstruction models. Drawing from established approaches in ECG analysis, the task of mapping the complex, non-linear relationship between ECG and PPG signals can be framed as a pattern recognition problem, with the objective of learning temporal and morphological correspondences between the two modalities [ 2 ] . This task is challenging due to signal artifacts and the inherent physiological differences: ECG captures the heart’s electrical activity, while PPG measures peripheral blood volume changes. Recent advances in pattern recognition, especially deep learning for time-series and physiological signal analysis, have shown significant promise in addressing these challenges [ 14 , 15 ] . A variety of deep learning models have been proposed for PPG-to-ECG translation. For example, Zhu et al. [ 16 ] developed a convolutional neural network (CNN) to reconstruct ECG waveforms from single-channel PPG. Tang et al. [ 17 ] introduced an alignment-based LSTM model emphasizing temporal synchronization between PPG and ECG cycles. Tian et al. [ 9 ] proposed a joint dictionary learning framework to model cross-domain correspondences. Chiu et al. [ 18 ] employed attentional neural networks to reconstruct QRS complexes from PPG input. More recently, Shome et al. [ 19 ] proposed a region-disentangled diffusion model to selectively enhance high-information ECG segments, such as the QRS complex. However, most existing methods rely on single-channel PPG signals, which limits their capacity to capture waveform variability across cardiac cycles. To overcome this limitation, we propose a multi-channel pattern recognition approach using 2D signal representations. Specifically, we generate a four-channel PPG image by stacking padded PPG cycles and computing three derived features: the first-order difference, the second-order difference, and the area under the curve (AUC). This enriched representation allows the model to capture both local waveform structures and inter-beat variability, thereby improving the accuracy and fidelity of ECG signal reconstruction. Traditional CNNs have demonstrated strong performance in signal processing tasks, including ECG reconstruction. However, their reliance on localized filters and limited receptive fields constrains their capacity to capture long-range dependencies and global contextual patterns. Recent advances in self-attention-based models, particularly Transformers [ 20 ] , have addressed these limitations by effectively modeling sequential dependencies through global context. These models have shown strong performance across a wide range of time-series applications [ 21 , 22 ] . Vision Transformers (ViTs) [ 23 ] , an extension of the Transformer architecture for image-based analysis, further enhance this capability by capturing spatial structures in data-rich image representations. Building on these advancements, we propose a novel ECG reconstruction method that applies a ViT architecture to four-channel image-like representations of PPG signals. Unlike conventional 1D CNN-based models, which operate on raw PPG sequences, our method restructures the input as a 3D tensor of size X\times Y\times Z : the X - Y plane captures a 2D signal image formed by stacking individually padded PPG cycles along temporal and morphological dimensions, while Z