LCS: A Learnlet-Based Sparse Framework for Blind Source Separation

V. Bonjean, A. Gkogkou, J.-L. Starck, P. Tsakalides · 2025

Read LCS: A Learnlet-Based Sparse Framework for Blind Source Separation by V. Bonjean, A. Gkogkou, J.-L. Starck, P. Tsakalides (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-15475.txt.

Introduction

V. Bonjean and three co-authors present a learnlet based sparse approach for blind source splitting in astrophysics. Splitting extracts meaningful signals from multi band observations without prior templates. Classic methods enforce thinness with fixed wavelet dictionaries, which can miss complex real signals. Their Learnlet Component Separator replaces fixed wavelets with a learned transform.

The transform is a structured convolutional network shaped like a multiscale wavelet form. It keeps wavelet interpretability and thinness while gaining learned adaptability. An iterative method integrates the form into component splitting. The hybrid design bridges classical signal processing and deep learning. Tests target astrophysical data where components overlap heavily. Better splitting directly raises maps used for cosmological and galactic science.

Catalog record

CREATORV. Bonjean, A. Gkogkou, J.-L. Starck, P. Tsakalides
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE44 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-15475

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

LCS: A Learnlet-Based Sparse Framework for Blind Source Separation V. Bonjean, A. Gkogkou, J.-L. Starck, P. Tsakalides Abstract Blind source separation (BSS) plays a pivotal role in modern astrophysics by enabling the extraction of scientifically meaningful signals from multi-frequency observations. Traditional BSS methods, such as those relying on fixed wavelet dictionaries, enforce sparsity during component separation, but may fall short when faced with the inherent complexity of real astrophysical signals. In this work, we introduce the Learnlet Component Separator (LCS), a novel BSS framework that bridges classical sparsity-based techniques with modern deep learning. LCS utilizes the Learnlet transform—a structured convolutional neural network designed to serve as a learned, wavelet-like multiscale representation. This hybrid design preserves the interpretability and sparsity-promoting properties of wavelets while gaining the adaptability and expressiveness of learned models. The LCS algorithm integrates this learned sparse representation into an iterative source separation process, enabling effective decomposition of multi-channel observations. While conceptually inspired by sparse BSS methods, LCS introduces a learned representation layer that significantly departs from classical fixed-basis assumptions. We evaluate LCS on both synthetic and real datasets, demonstrating superior separation performance compared to state-of-the-art methods (average gain of about 5 dB on toy model examples). Our results highlight the potential of hybrid approaches that combine signal processing priors with deep learning to address the challenges of next-generation cosmological experiments. 1 Introduction The separation of astrophysical components from multi-frequency sky observations is a fundamental task in observational cosmology and astrophysics. It enables the isolation of a source signal from a complex mixture of astrophysical foregrounds and instrumental noise. A prominent example is the extraction of the Cosmic Microwave Background (CMB) from multi-band observations, which played a central role in the success of the Planck mission ( 27 ) . Traditional component separation methods in this context include Principal Component Analysis (PCA), which removes the most dominant modes in the frequency domain ( 22 ) , and ICA-based approaches ( 20 ) , which exploit the statistical independence of components. While simple and model-agnostic, these methods risk partial loss of the cosmological signal. More sophisticated techniques were developed for Planck including internal linear combination techniques like NILC ( 12 , Needlet Independent Linear Combination,) and MILCA ( 19 , Modified Internal Linear Combination Algorithm,) , blind source separation methods such as SMICA ( 13 , Spectral Matching ICA,) , self-supervised deep learning methods ( 7 ) , and sparse techniques like GMCA ( 6 , Generalised Morphological Component Analysis,) . These methods disentangle sources from multi-channel observations by leveraging assumptions such as statistical independence, spectral diversity, or sparse representability. In particular, sparse component separation has proven to be a powerful approach for modeling structured, non-Gaussian emissions such as foregrounds exhibiting filamentary or localized morphologies. GMCA exploits the assumption that astrophysical components can be sparsely represented in a certain transform domain. The typically used domains are wavelets and specifically starlet, biorthogonal, or mexican hat and they are all chosen based on the complexity of the image under study. By promoting sparsity via morphological diversity, GMCA has been shown to achieve accurate CMB and foreground reconstruction in both simulated and real data in astrophysical applications and beyond ( 5 ; 4 ; 37 ; 36 ) . However, a key limitation stems from the fixed nature of the wavelet dictionary: while efficient and interpretable, it may not optimally capture the statistical structure of all signal types or adapt to data variability, particularly in non-Gaussian or non-stationary regimes. In astrophysics, the need for efficient and robust component separation techniques extends beyond the CMB. With the upcoming deployment of radio interferometers like the Square Kilometre Array ( 35 , SKA,) , there is a renewed interest in separating diffuse emission from target cosmological signals. In particular, HI intensity mapping aims to detect the 21-cm emission from neutral hydrogen across cosmic time, offering a promising probe of large-scale structure, dark energy, and the epoch of reionization ( 8 ; 31 ) . However, this faint cosmological signal is contaminated by foregrounds several orders of magnitude brighter, including Galactic synchrotron and free-free emission, as well as extragalactic point sources ( 2 ) . Effective foreground cleaning is thus essential for recovering the HI signal with high fidelity. Recent works ( 10 ; 23 ; 24 ; 32 ; 9 ; 25 , Gkogkou et al., in prep.) have explored deep learning-based priors, regularization schemes, and learned sparse representations to tackle the challenge of foreground removal in simulated SKA data. In parallel, the field of signal processing and machine learning has made a significant progress in data-driven sparse modeling. A classical approach in sparse coding is the Iterative Shrinkage-Thresholding Algorithm ( 3 , ISTA,) , which solves linear inverse problems with sparsity constraints by iteratively applying a soft-thresholding operation to promote sparse solutions. While ISTA is based on convex optimization and offers well-characterized convergence guarantees, its iterative nature often results in slow convergence in practice. To address this, 17 introduced the Learned ISTA (LISTA), a neural network architecture that unrolls the ISTA iterations into a fixed-depth feedforward network. By learning the optimal parameters of each iteration (such as the dictionary and thresholding functions) from data, LISTA achieves significantly faster convergence and better adaptability to specific signal classes, while maintaining the interpretability of sparse coding. Building upon these ideas, 15 developed LPALM (Learned Proximal Alternating Linearized Minimization), a hybrid framework that combines deep supervised learning with optimization-based sparse component separation. LPALM extends the principles of LISTA by integrating it into a proximal optimization loop tailored for separating astrophysical sources, demonstrating promising results in the identification of elemental components in supernova remnants on X-Ray data. Expanding on the concept of hybrid methods offering both interpretability and learning capability, we investigate the use of neural networks designed to enhance classical signal transforms. Among them, the Learnlet transform ( 28 ) introduces a neural network architecture designed to emulate wavelet-like behavior while learning filters and thresholding parameters directly from data. This approach preserves the interpretability and multiscale structure of classical wavelets, while offering greater adaptability to complex signal distributions. Unlike traditional wavelet-based dictionaries, the learned filters - the learnlets - can adapt to complex and noisy environments, improving the robustness of source separation. While they have already demonstrated effectiveness in deconvolving astronomical images 1 , their integration into structured component separation frameworks remains largely unexplored. In this work, we introduce the Learnlet Component Separator (LCS), a novel BSS algorithm that embeds a learned sparse representation—called the Learnlet transform—into an iterative separation procedure. The Learnlet transform is a structured convolutional neural network (CNN) designed to emulate a wavelet-like multiscale behavior while allowing for data-driven adaptation. Its architecture preserves key characteristics of traditional wavelet bases, such as locality, multiresolution decomposition, and interpretability, while improving upon them through learned filter banks optimized via deep learning for the specific signal class. The LCS algorithm iteratively estimates the sources that are mixed in each frequency channel by leveraging the sparsity-promoting capabilities of the Learnlet transform within a sources-mixing matrix estimation loop. This design allows LCS to combine the robustness and theoretical grounding of sparse representation methods with the adaptability and expressive power of deep neural networks. In this paper, we describe the architecture of LCS,

Read the complete text