Latent Mode Decomposition
Manuel Morante, Naveed ur Rehman · 2025
Read Latent Mode Decomposition by Manuel Morante, Naveed ur Rehman (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-17797.txt.
Introduction
Manuel Morante and Naveed ur Rehman present a new way to pull shared rhythms out of many signals at once. Sensors often record several channels that mix the same waves in different strengths. Older decomposition tools are slow, touchy about settings, and weak at modeling how channels link. Their 2025 method first posits latent modes: hidden waves that blend sparse coding with classic mode splitting. Each channel is then a light mix of those shared waves.
Working in the smaller latent space cuts noise and cost. A variational solver keeps the fit honest while favoring few, clean modes with steady frequencies. Tests on made-up and real data check the gains. The authors aim the tool at fields like brain recording and machine monitoring, where many channels carry one story.
Catalog record
| CREATOR | Manuel Morante, Naveed ur Rehman |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 56 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-17797
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Latent Mode Decomposition Manuel Morante, Naveed ur Rehman Abstract We introduce Variational Latent Mode Decomposition (VLMD), a new algorithm for extracting oscillatory modes and associated connectivity structures from multivariate signals. VLMD addresses key limitations of existing Multivariate Mode Decomposition (MMD) techniques—including high computational cost, sensitivity to parameter choices, and weak modeling of interchannel dependencies. Its improved performance is driven by a novel underlying model, Latent Mode Decomposition (LMD), which blends sparse coding and mode decomposition to represent multichannel signals as sparse linear combinations of shared latent components composed of AM-FM oscillatory modes. This formulation enables VLMD to operate in a lower-dimensional latent space, enhancing robustness to noise, scalability, and interpretability. The algorithm solves a constrained variational optimization problem that jointly enforces reconstruction fidelity, sparsity, and frequency regularization. Experiments on synthetic and real-world datasets demonstrate that VLMD outperforms state-of-the-art MMD methods in accuracy, efficiency, and the interpretability of extracted structures. I Introduction Nonstationary signal decomposition techniques constitute an essential tool in Signal Processing for analyzing complex signals. Among them, Mode Decomposition (MD) has emerged as a fundamental framework, enabling the extraction of meaningful intrinsic oscillatory components [ 1 ] . Over the last couple of decades, a wide range of MD methods and algorithms have been developed and successfully applied across a wide range of interdisciplinary applications, such as biomedical signal analysis, structural health monitoring, and financial time-series analysis. This particular trend dates back to the late nineties with the introduction of Empirical Mode Decomposition (EMD) [ 1 ] , which was followed by the development of other similar alternatives, such as Synchro-squeezed Transform (SST) [ 2 ] , Variational Mode Decomposition (VMD) [ 3 ] and Sliding-window Singular Spectrum Analysis (SSA) [ 4 ] . Originally designed for single-channel time series analysis, some of these methods were later extended to handle multivariate time series. Notable multivariate algorithms include Multivariate Empirical Mode Decomposition (MEMD) [ 5 ] , multivariate nonlinear chirp mode decomposition [ 6 ] , iterative filtering [ 7 ] , as well as Multivariate Variational Mode Decomposition (MVMD) [ 8 ] . A more comprehensive comparison of both univariate and multivariate approaches is presented in [ 9 ] . Formally, those Multivariate Mode Decomposition (MMD) approaches share the same fundamental idea; they assume that a multivariate signal of interest accepts a representation as a linear combination of a set of a particular family of amplitude- and frequency-modulated (AM-FM) functions, where all the channels share a well-defined instantaneous frequency [ 5 , 8 ] . In other words, we can decompose a multivariate signal of interest –with C number of channels, \boldsymbol{x}(t)=[x_{1}(t),x_{2}(t),\ldots,x_{C}(t)]^{\mathsf{T}} – into a linear combination of K principal multivariate oscillations as follows: \boldsymbol{x}(t)=\sum_{k=1}^{K}\boldsymbol{u}^{(k)}(t), (1) where the \boldsymbol{u}^{(k)}(t) , often referred to as the Intrinsic Modes (IMs), constituent modes, or modes, belong to a family of AM-FM functions of the form: \boldsymbol{u}^{(k)}(t)=\boldsymbol{a}^{(k)}(t)\cos(\phi^{(k)}(t)), (2) where \boldsymbol{a}^{(k)}(t)=[a_{1}(t),a_{2}(t),\ldots,a_{C}(t)] and \phi^{(k)}(t) are the instantaneous amplitudes and instantaneous phase associated with the k -th mode respectively [ 8 ] . In addition, to ensure these functions represent meaningful oscillations, the amplitudes are always nonnegative, i.e., a_{c}^{(k)}(t)\geq 0\;\forall t , and the instantaneous frequency, \omega_{k}(t)=\partial_{t}\phi^{(k)}(t) , remains positive and exhibits a considerably slower temporal variation compared to the instantaneous phase \phi^{(k)}(t) [ 3 , 8 , 2 ] . Intuitively, we can interpret the oscillatory components in Eq. ( 2 ) as a kind of harmonic-like functions, since they remain concentrated around a central frequency, \omega_{k} , while accounting for nonstationary and nonlinear behavior through amplitude and frequency modulations [ 3 , 2 ] . Notwithstanding their success, these algorithms face critical limitations in real-world settings. When signals exhibit rich spectral content or moderate nonstationarity, their decomposition accuracy degrades significantly. Moreover, noise contamination, which is common in practical applications, can severely distort the extracted modes, producing misleading or unusable results [ 10 ] . For example, in MVMD, the decomposition outcome is highly sensitive to user-defined parameters such as the regularization strength and the assumed number of modes. These parameters are typically selected heuristically, which undermines robustness and reproducibility [ 9 ] . Another major limitation is their considerable computational cost. Both MEMD and MVMD operate directly in high-dimensional signal spaces, even though the intrinsic structure of the multivariate signal often lies on a lower-dimensional manifold. In MEMD, mode alignment is achieved through projections along numerous directions (typically 64–128), each requiring a separate univariate EMD computation followed by an averaging step. This redundant processing across projections leads to significant memory and runtime costs [ 11 ] . MVMD, on the other hand, formulates a high-dimensional variational problem over all channels and modes simultaneously [ 8 ] . It requires iterative updates of complex-valued analytic signals, mode estimates, and dual variables, resulting in an optimization procedure whose computational cost scales poorly with both the number of channels and the signal length [ 9 ] . These factors make existing algorithms impractical for modern high-dimensional multichannel datasets, where scalability and efficiency are essential. These limitations stem from a deeper issue: existing MMD methods are direct extensions of their univariate counterparts. As a result, they inherit design assumptions that prioritize temporal structure while neglecting the spatial or cross-channel dependencies intrinsic to multivariate signals. Although such methods can align modes across channels based on shared frequency content [ 5 , 8 ] , they lack the modeling capacity to capture the rich inter-channel dynamics present in modern multichannel data, limiting their descriptive and analytical power. To address the above limitations, we propose a new model for MMD, named Latent Mode Decomposition (LMD), that leverages principles from sparse coding and matrix factorization. Unlike existing MMD approaches, LMD assumes that the observed multichannel signal is not formed independently across channels, but instead arises from a sparse linear combination of a small set of shared latent components , each composed of a set of AM-FM latent modes . The advantages of the proposed formulation are threefold. First, it provides a principled way to capture interchannel dependencies by explicitly modeling shared latent structures via matrix factorization. Second, representing a signal through a reduced set of latent components improves the model’s robustness to noise and enables the model’s operation in a lower dimensional space instead of a higher dimensional space, in which MEMD and MVMD operate. Finally, the assumption that the latent components are composed of a linear combination of AM-FM latent modes ensures that the model yields meaningful and interpretable output. Building on the LMD model, we propose a simple and efficient algorithm, termed Variational Latent Mode Decomposition (VLMD), to extract latent AM-FM modes and their associated connectivity structures from multivariate data . To achieve that, we design a variational optimization problem that jointly enforces three key criteria: i) reconstruction fidelity of each observed channel using a shared latent dictionary; ii) sparsity of the mixing coefficients via an \ell_{1} -norm penalty; and iii) constrained frequency behavior of the latent modes, inspired by the bandwidth-regularized formulation in MVMD [ 8 ] . To efficiently solve the proposed optimization problem, we derive closed-form update rules for latent components, oscillatory modes, and their associated center frequencies by leveraging the Alternating Direction Method of Multipliers (ADMM). The resulting VLMD algorithm offers several key advantages over state-of-the-art