λ \lambda Split: Self-Supervised Content-Aware Spectral Unmixing for Fluorescence Microscopy

Federico Carrara, Talley Lambert, Mehdi Seifi, Florian Jug · 2026

Read λ \lambda Split: Self-Supervised Content-Aware Spectral Unmixing for Fluorescence Microscopy by Federico Carrara, Talley Lambert, Mehdi Seifi, Florian Jug (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-23647.txt.

Introduction

Carrara and three co-authors present λSplit, a learning model that unmixes fluorescence microscope spectra. Classic unmixing works pixel by pixel with least squares, and wilts under noise and overlap. λSplit learns a spread of plausible concentration maps with a variational autoencoder. A spectral mixer layer keeps each guess true to how images form. That prior also scrubs noise on its own. Across 66 test cases from three real datasets, λSplit beats ten rival methods. It holds up when noise is high or spectra crowd together.

Catalog record

CREATORFederico Carrara, Talley Lambert, Mehdi Seifi, Florian Jug
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE105548
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.23647

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

λ \lambda Split: Self-Supervised Content-Aware Spectral Unmixing for Fluorescence Microscopy Federico Carrara, Talley Lambert, Mehdi Seifi, Florian Jug Abstract In fluorescence microscopy, spectral unmixing aims to recover individual fluorophore concentrations from spectral images that capture mixed fluorophore emissions. Since classical methods operate pixel-wise and rely on least-squares fitting, their performance degrades with increasingly overlapping emission spectra and higher levels of noise, suggesting that a data-driven approach that can learn and utilize a structural prior might lead to improved results. Learning-based approaches for spectral imaging do exist, but they are either not optimized for microscopy data or are developed for very specific cases that are not applicable to fluorescence microscopy settings. To address this, we propose λ \lambda Split, a physics-informed deep generative model that learns a conditional distribution over concentration maps using a hierarchical Variational Autoencoder. A fully differentiable Spectral Mixer enforces consistency with the image formation process, while the learned structural priors enable state-of-the-art unmixing and implicit noise removal. We demonstrate λ \lambda Split on 3 3 real-world datasets that we synthetically cast into a total of 66 66 challenging spectral unmixing benchmarks. We compare our results against a total of 10 10 baseline methods, including classical methods and a range of learning-based methods. Our results consistently show competitive performance and improved robustness in high noise regimes, when spectra overlap considerably, or when the spectral dimensionality is lowered, making λ \lambda Split a new state-of-the-art for spectral unmixing of fluorescent microscopy data. Importantly, λ \lambda Split is compatible with spectral data produced by standard confocal microscopes, enabling immediate adoption without specialized hardware modifications. Keywords Spectral Unmixing ⋅ \cdot Hierarchical Variational Inference 1 Introduction Fluorescence microscopy is a fundamental tool for biomedical discovery in the life sciences, enabling us to visualize selected biological structures labeled with fluorescent markers called fluorescent probes (FPs). The most common way to image biological samples is arguably multiplexed imaging, where multiple FPs labeling different structures in a sample are imaged one at a time using appropriate bandpass filtering (see fig. 1 ). Due to the emission properties of FPs, the limited spectral range of visible light, and the available microscopy hardware, multiplexed imaging is, in practice, used to image 2 to 4 structures in their respective image channels. In addition to this limitation, sequential acquisitions also increase the required imaging time and, for live samples, lead to channels that do not correspond to the same time point. Last but not least, repeated rounds of imaging can lead to increased light exposure and, therefore, a higher degree of photobleaching and phototoxic effects, which are naturally undesired [ 1 , 2 , 3 , 4 ] . These limitations motivate other approaches to image multiple fluorescently labeled structures in a biological sample, i.e., spectral imaging approaches. Figure 1: Spectral Imaging and Unmixing in a nutshell. A biological sample is labeled with F fluorescent probes (FPs) whose emission spectra typically overlap. While for multiplexed imaging each FP is imaged in isolation using F appropriate band-pass filters (see Multiplexed Imaging Channels), spectral imaging, instead, acquires L spectral bands in which photons of all FPs are unfiltered and therefore mixed (see Spectral Imaging Bands). Note that multiplexed imaging can suffer from bleed-through artifacts due to overlapping emission spectra. To retrieve all F unmixed concentration maps (right) we propose \lambda Split, a self-supervised method that leverages on learned structural priors to achieve state-of-the-art results even when spectra overlap considerably, when imaging noise is high, and when the spectral dimensionality L is lowered. Spectral fluorescence microscopy does not image FPs one at a time but instead collects all emitted light at once [ 5 , 6 ] . To later recover the individual FP emissions (fluorophore concentrations), the emitted light is collected in a fixed number of spectral bands. Here, the signal at each spatial location is not a single intensity value but a spectral measurement that quantifies how much light was collected over a set of wavelength intervals (bands), as shown in fig. 1 . Spectral imaging shifts the burden from hardware-based channel separation to computational separation of fluorophore emissions. This separation is commonly addressed through spectral unmixing, where classical approaches estimate fluorophore contributions independently at each pixel using least-squares fitting to reference spectra [ 7 ] . While conceptually simple, such pixel-wise formulations degrade when spectra overlap considerably, when noise levels are high, or when the spectral dimensionality is lowered (i.e., when fewer bands are being imaged). Learning-based approaches offer an alternative by incorporating spatial context and data-driven structural priors. However, existing methods either do not account for the optics and noise characteristics of fluorescence microscopy, or they are tailored to narrowly defined acquisition settings. To address these limitations, we introduce \lambda Split, a physics-informed deep generative framework for spectral unmixing in fluorescence microscopy that leverages a fully differentiable spectral mixing module (i.e., the Spectral Mixer), which enables self-supervised training. Our approach achieves robust unmixing and implicit denoising across challenging imaging conditions, as we demonstrate experimentally on a total of 66 benchmarks we defined for this work. Importantly, \lambda Split operates directly on spectral acquisitions produced by standard point-scanning confocal microscopes, enabling immediate integration into existing experimental workflows without hardware modifications. 2 Problem Setting A spectral image can be represented as S\in\mathbb{R}^{L\times Z\times Y\times X} , where (Z,Y,X) denotes the spatial dimensions and L denotes the spectral dimension, i.e., the number of spectral bands. Depending on the microscope configuration, L can vary substantially: some systems provide relatively dense spectral sampling with a number of contiguous, equispaced, narrow bands of up to 32 , while others rely on coarser spectral measurements, leading to only 4 or 5 bands that can even be flexibly tuned to cover arbitrary wavelength intervals. The measured spectral signal at each spatial location arises from the union of all photons emitted by FPs that are present at that location. Because FPs typically exhibit relatively broad and overlapping emission spectra (see, e.g., fig. S.2 ), the signal in each spectral band contains contributions from multiple fluorescent sources. The goal of spectral unmixing is therefore to recover, from an observed spectral acquisition S , a set of images representing the spatial concentration maps of the individual FPs, also referred to as the unmixed images U [ 7 ] . The spectral image formation process can be described by a linear mixing model: S=MU+\varepsilon, (1) where U\in\mathbb{R}^{F\times Z\times Y\times X} denotes the unknown fluorophore concentration maps for F FPs, M\in\mathbb{R}^{L\times F} is the mixing matrix whose columns correspond to the discretized emission spectra of the fluorophores, and \varepsilon represents pixel noise. The unmixing problem at hand is inherently an ill-posed inverse problem. Overlap between emission spectra makes the unmixing harder, and together with additional noise introduces ambiguities for this inverse problem. Additionally, a limited number of spectral bands (lower spectral dimensionality) can render the system underdetermined, particularly in regimes where L<F . These challenges are further amplified in realistic biological samples, where fluorophores may be spatially co-localized, and experimental conditions can induce spatial and spectral variability. 3 Related Work Classical spectral unmixing. A widely used approach is linear unmixing (LU), which estimates fluorophore concentration maps by solving a least-squares problem given reference spectra [ 7 ] . Common variants, non-negative

Read the complete text