Compact Latent Manifold Translation: A Parameter-Efficient Foundation Model for Cross-Modal and Cross-Frequency Physiological Signal Synthesis
Bo Cui Department of Biomedical Signals, Systems, Xiaowen Song Department of Biomedical Signals, Systems, Yaowen Zhang Department of Biomedical Signals, Systems, Shunzhe Zhang Department of Applied Mathematics, B.J.F. van Beijnum Department of Biomedical Signals, Systems, Monique Tabak Department of Biomedical Signals, Systems, Ying Wang Department of Biomedical Signals, Systems · 2026
Read Compact Latent Manifold Translation: A Parameter-Efficient Foundation Model for Cross-Modal and Cross-Frequency Physiological Signal Synthesis by Bo Cui Department of Biomedical Signals, Systems, Xiaowen Song Department of Biomedical Signals, Systems, Yaowen Zhang Department of Biomedical Signals, Systems, Shunzhe Zhang Department of Applied Mathematics, B.J.F. van Beijnum Department of Biomedical Signals, Systems, Monique Tabak Department of Biomedical Signals, Systems, Ying Wang Department of Biomedical Signals, Systems (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-13248.txt.
Introduction
Cui and colleagues present CLMT, a compact model that turns one body signal into another across devices. Heart traces and pulse traces differ in form and sampling rate, which blocks shared analysis. A universal tokenizer splits signals into discrete tokens, and a translator maps those tokens across forms and rates. The small model beats much larger baselines, lifting heartbeat detection sharply and rebuilding fast sampled signals with near perfect correlation.
Catalog record
| CREATOR | Bo Cui Department of Biomedical Signals, Systems, Xiaowen Song Department of Biomedical Signals, Systems, Yaowen Zhang Department of Biomedical Signals, Systems, Shunzhe Zhang Department of Applied Mathematics, B.J.F. van Beijnum Department of Biomedical Signals, Systems, Monique Tabak Department of Biomedical Signals, Systems, Ying Wang Department of Biomedical Signals, Systems |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 56040 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.13248
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Compact Latent Manifold Translation: A Parameter-Efficient Foundation Model for Cross-Modal and Cross-Frequency Physiological Signal Synthesis Bo Cui Department of Biomedical Signals, Systems, Xiaowen Song Department of Biomedical Signals, Systems, Yaowen Zhang Department of Biomedical Signals, Systems, Shunzhe Zhang Department of Applied Mathematics, B.J.F. van Beijnum Department of Biomedical Signals, Systems, Monique Tabak Department of Biomedical Signals, Systems, Ying Wang Department of Biomedical Signals, Systems Abstract The analysis of physiological time series, such as electrocardiograms (ECG) and photoplethysmograms (PPG), is persistently hindered by modality and frequency gaps stemming from heterogeneous recording devices. Existing foundation models typically rely on continuous latent spaces, which frequently suffer from severe modality entanglement, lack high-fidelity cross-frequency generative capacity, and impose high computational costs that prohibit edge-device deployment. In this paper, we propose Compact Latent Manifold Translation (CLMT), a highly parameter-efficient (0.09B) unified framework that bridges these gaps through a novel two-stage discrete translation paradigm. First, we introduce a Universal Tokenizer utilizing Hierarchical Residual Vector Quantization (RVQ) to decouple heterogeneous signals into isolated, well-structured discrete latent manifolds, effectively preventing inter-modality interference. Second, a Context-Prompted Latent Translator maps these discrete tokens across modalities by integrating static physiological priors, reframing complex signal synthesis as a pure latent sequence translation task. Extensive evaluations demonstrate that our 0.09B model significantly outperforms massive baselines. In cross-modal PPG-to-ECG synthesis, it resolves temporal phase drift and dramatically improves the clinical R-peak detection F1-score from 0.37 (baseline) to 0.83. Furthermore, in extreme cross-frequency super-resolution (25Hz to 100Hz), it successfully recovers high-frequency diagnostic landmarks, achieving an unprecedented Pearson correlation of 0.9956. By learning a universal discrete language for biological signals with a fraction of the computational footprint, our approach sets a new trajectory for edge-deployable, multi-modal medical foundation models. 1 Introduction The proliferation of wearable technology has transformed continuous physiological monitoring into a pillar of digital health 8 . However, the inherent heterogeneity of biosignal data remains a fundamental barrier to developing robust foundation models 10 ; 4 . Clinical devices (e.g., 250–500Hz ECG 27 ) and consumer wearables (e.g., 50Hz PPG 9 ) present vast physical and temporal discrepancies. Unifying these streams requires effective cross-modal and cross-frequency alignment 14 . Traditional sequence processing forces strict temporal alignment via specialized models 10 or aggressive resampling 9 , causing severe temporal distortion 28 and the irreversible loss of high-frequency diagnostic landmarks (e.g., QRS morphological variations). Current state-of-the-art (SOTA) foundation models (e.g., CSFM 10 , PhysioOmni 14 ) utilize continuous Transformer architectures optimized primarily for representation. They lack generative cross-frequency capacity: their reliance on fixed-size continuous patching structurally prevents synthesizing high-frequency details from low-frequency prompts. Furthermore, continuous joint spaces entangle features of different physical origins, hindering precise cross-modal mapping (e.g., synthesizing clinical-grade ECG from PPG). While specialized generative frameworks like PPGFlowECG 9 attempt modality alignment, they remain constrained to single-frequency domains. To address these challenges, we propose Compact Latent Manifold Translation (CLMT), a unified framework for heterogeneous biosignals. Our core innovation is a Universal Tokenizer based on Hierarchical Residual Vector Quantization (RVQ), which maps multimodal signals into a shared discrete manifold. This hierarchical structure effectively decouples physiological dynamics: top-level quantizers capture shared macro-rhythms across modalities, while bottom-level quantizers preserve sensor-specific high-frequency morphologies. Within this decoupled space, we introduce a Context-Prompted Latent Translator for cross-modal mapping (PPG \rightarrow ECG) and a Latent Sequence MAE for cross-frequency super-resolution (25Hz \rightarrow 100Hz). Crucially, these lightweight modules are trained via continuous feature distillation against a strictly frozen Universal Tokenizer. During inference, routing continuous predictions through the frozen codebook induces a discrete "snapping" effect. This forcefully aligns outputs with established physiological priors, completely circumventing the regression-to-the-mean blurring inherent to continuous generative models. Our core contributions are summarized as follows: (1) Representation Paradigm Shift: We propose a Universal Tokenizer that projects heterogeneous sampling rates and modalities into a hierarchical discrete latent space, eliminating the dependence on resampling-based alignment. (2) Hierarchical Decoupling Mechanism: Through Hierarchical RVQ, we achieve multi-scale separation of macro-rhythms and micro-morphologies, preventing feature entanglement and ensuring clear manifold isolation. (3) Exceptional Efficiency and Snapping Generation: By freezing the Stage 1 Tokenizer, downstream adaptations require minimal optimization (total framework footprint: 0.09B). The frozen codebook’s snapping effect synthesizes sharp clinical landmarks (boosting R-peak F1-score to 0.83), significantly outperforming massive SOTA continuous baselines. 2 Related Works 2.1 Generative Models for Physiological Time-Series While universal time-series models (e.g., TimesNet 24 , PatchTST 17 ) set general benchmarks, the stringent electrophysiological constraints of biosignals necessitate domain-specific foundation paradigms. Currently, developing such models faces a tripartite challenge: high-fidelity cross-modal translation, generative cross-frequency synthesis (super-resolution), and compact edge deployment 10 ; 15 . The research landscape remains fragmented across these dimensions. Multi-modal architectures like PhysioOmni 14 introduce unified representations but lack the generative mechanism for high-frequency morphological synthesis. Conversely, specialized generative frameworks 3 ; 9 ; 25 bridge the modality gap but are restricted to single-frequency domains, failing to reconstruct clinical-grade landmarks from low-power wearable sensors. Regarding super-resolution (SR), Multi-scale MAE 28 focuses primarily on anomaly detection rather than unified cross-manifold generation. Finally, while CSFM 10 demonstrates validated cross-modal performance, its massive parameter footprint and lack of dedicated SR layers hinder edge deployment. CLMT addresses these gaps through a unified, parameter-efficient discrete manifold. 2.2 Discrete Representation and Vector Quantization Discrete representation learning, pioneered by VQ-VAE 21 and advanced by audio codecs 7 ; 5 , effectively compresses continuous features into discrete codewords. Recently, BioCodec 2 and BrainRVQ 6 successfully extended Residual Vector Quantization (RVQ) to neurophysiological data to capture multi-scale dynamics. However, existing biosignal tokenizers predominantly rely on single-level quantization, which fails to capture the multi-scale, cross-modal properties of heterogeneous signals. CLMT distinguishes itself by utilizing hierarchical RVQ to explicitly decouple physiological dynamics based on their distinct electrophysiological and hemodynamic origins. Because heterogeneous signals (ECG and PPG) share a fundamental cardiac cycle but diverge in sensor-specific micro-morphologies, our top-level quantizers encode the shared macro-rhythm, while subsequent layers capture modality-specific high-frequency features. This hierarchical decoupling establishes a unified latent alignment, preserving fundamental rhythms while structurally preparing the space for high-fidelity, modality-specific synthesis. 2.3 Masked Modeling in Time Series Masked Autoencoding (MAE) has successfully transitioned from computer vision 12 ; 22 to ECG analysis 27 ; 26 ; 23 ; 19 . However, current biosignal MAE architectures (e.g., MMAE-ECG 28 ) primarily function as multivariate imputation frameworks. They reconstruct masked segments relying on local contextual cues within a continuous latent space. This continuous operation inevitably leads to statistical averaging, causing the loss of sharp, high-frequency morphological landmarks strictly essential for clinical diagnosis. CLMT departs from this imputation convention by deploying MAE within a highly decoupled, discrete latent manifold. By completing masked latent sequences and routing the continuous predictions back through the frozen codebook, our model induces a discrete "snapping" effect. This architectural shift transforms the MAE from a context-based interpolator into a powerful generative framework capable of extreme cross-frequency super-resolution (e.g., 25Hz to 100Hz), successfully recovering diagnostic landmarks that continuous-space models inherently blur. 3 Method 3.1 Overview We propose a two-stage framework for modeling physiological time series across modalities and sampling rates. Given an input signal \mathbf{X}^{(m)}\in\mathbb{R}^{C\times T} , where m\in\left\{\mathrm{ECG},\mathrm{PPG}\right\} denotes the signal modality. C is the number of input channels (e.g., C=1 in our setting), and T is the number of the temporal samples. In addition, each sample is