Multi-Temporal Frames Projection for Dynamic Processes Fusion in Fluorescence Microscopy Journal: arXiv
Hassan Eshkiki, Sarah Costa, Mostafa Mohammadpour, Farinaz Tanhaei, Christopher H. George, Fabio Caraffini · 2026
Read Multi-Temporal Frames Projection for Dynamic Processes Fusion in Fluorescence Microscopy Journal: arXiv by Hassan Eshkiki, Sarah Costa, Mostafa Mohammadpour, Farinaz Tanhaei, Christopher H. George, Fabio Caraffini (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-10392.txt.
Introduction
Hassan Eshkiki and co authors fuse many frames of a cell film into one clean still. Glow based microscopy films live cells. The films are oft noisy. Glow can wax and wane in time. A single frame may miss a trait that the next frame shows.
The team project frames from many times into one image. Their frame keeps the true cell facts of the film. Noise drops as frames join. Traits that blink in time stay clear in the still. The work helps labs read live cell films with more trust. It also cuts the need to pick one best frame.
Catalog record
| CREATOR | Hassan Eshkiki, Sarah Costa, Mostafa Mohammadpour, Farinaz Tanhaei, Christopher H. George, Fabio Caraffini |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 58 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-10392
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Multi-Temporal Frames Projection for Dynamic Processes Fusion in Fluorescence Microscopy Journal: arXiv Hassan Eshkiki, Sarah Costa, Mostafa Mohammadpour, Farinaz Tanhaei, Christopher H. George, Fabio Caraffini Abstract Fluorescence microscopy is widely employed for the analysis of living biological samples; however, the utility of the resulting recordings is frequently constrained by noise, temporal variability, and inconsistent visualisation of signals that oscillate over time. We present a unique computational framework that integrates information from multiple time-resolved frames into a single high-quality image, while preserving the underlying biological content of the original video. We evaluate the proposed method through an extensive number of configurations (n = 111) and on a challenging dataset comprising dynamic, heterogeneous, and morphologically complex 2D monolayers of cardiac cells. Results show that our framework, which consists of a combination of explainable techniques from different computer vision application fields, is capable of generating composite images that preserve and enhance the quality and information of individual microscopy frames, yielding 44 % 44\% average increase in cell count compared to previous methods. The proposed pipeline is applicable to other imaging domains that require the fusion of multi-temporal image stacks into high-quality 2D images, thereby facilitating annotation and downstream segmentation. 1 Introduction Fluorescence microscopy (FM) is an established technique for visualising dynamic processes in living cells and organisms with high spatial and temporal resolution. The availability of fluorescent probes with distinct spectral properties makes this method highly versatile, enabling researchers to observe cellular behaviour and molecular components, including proteins, nucleic acids, and signalling molecules, like calcium ions ( Ca^{2+} ), in real time [ 34 ] . Despite its widespread use, FM faces several technical challenges. Photobleaching and phototoxicity remain significant limitations, as prolonged exposure to excitation light can degrade fluorophores and damage living samples, potentially introducing artefacts and reducing image quality [ 25 ] . To address these issues, advanced imaging modalities, such as Confocal Laser Scanning Microscopy (CLSM), have been developed. CLSM improves optical sectioning by capturing images in discrete focal planes within the biological sample, which reduces out-of-focus light and enables the accurate reconstruction of its structure [ 37 ] . This is particularly valuable for studying subcellular organisation and live cellular processes, including changes in whole-cell morphology and contractility [ 5 ] , and intracellular dynamics, such as protein-protein interactions and molecular signalling mechanisms [ 19 ] in living cells and tissue models. However, like conventional FM, CLSM is affected by the prolonged exposure of biological samples to focused laser beams, which limits the permissible imaging time to avoid damaging living samples, at the expenses of image quality [ 25 ] . Other limitations of CLSM include optical scattering, which causes background noise [ 22 ] , motion and focus shifts, which blur object boundaries [ 38 ] , and illumination variability, that leads to inconsistent contrast [ 27 ] . Analysing high-dimensional data from live-cell CLSM experiments remains challenging, especially in tissue models that contain densely packed, heterogeneous, and aggregated cells with undefined boundaries [ 7 , 12 ] . Extracting quantitative information from these models requires segmenting individual cellular structures within the acquired images. However, image-quality issues, which are common in microscopy [ 27 ] , and the complexity of cellular networks often degrade the performance of existing segmentation algorithms, like [ 45 ] , which are usually trained on static, high-contrast datasets acquired under controlled imaging conditions and containing mainly cells characterised by a high degree of sphericity and distinct edges. When presented with real-world data, these models cause oversegmentation [ 7 ] , or fail to detect cells altogether [ 17 ] , producing inaccurate measurements and driving flawed biological conclusions. Without an accurate system for automated cell segmentation, CLSM recordings are often segmented manually using a frame-by-frame approach. This process, other than being extremely time-consuming, is highly prone to segmentation errors, particularly when the Fluorescence Intensity (FI) of cells within the recordings oscillates over time, as in the case of Ca^{2+} signalling experiments [ 22 ] , making cells inconsistently visible in each frame, or when subtle, low-intensity structural features are obscured by noise. To address these challenges, we have developed a systematic workflow designed to generate preprocessing pipelines that enable the fusion of multi-temporal frame sequences acquired from FM recordings into high-quality composite images for downstream segmentation and analysis. We evaluate our approach using a challenging dataset of CLSM Ca^{2+} signalling experiments performed on dynamic, heterogeneous and morphologically complex cardiac cell networks, thereby constituting an exemplar case study. By using a combination of z-projection and image enhancement methods, our pipeline aims at effectively resolving issues related to noise, contrast, temporal dynamicity and inconsistent visibility, allowing the visualisation of oscillatory signals occurring at different temporal intervals within these cells into a comprehensive two-dimensional (2D) representation of the living sample. By doing this, we seek to bridge the gap between raw FM data acquisition and their exploitation for meaningful biological analysis. 2 Related work 2.1 Classical Preprocessing Methods in Microscopy Preprocessing plays a pivotal role in the preparation of imaging data for downstream segmentation and analysis [ 17 ] . Numerous methodologies, ranging from traditional filtering techniques to advanced Computer Vision (CV) methods integrated with Deep Learning (DL) pipelines [ 1 , 3 ] , have been devised to address the challenges inherent in raw microscopy data. The overarching goal of these approaches is to enhance any suboptimal quality of images, thus mitigating the risk of poor segmentation accuracy, especially in semantic (i.e., foreground vs background) segmentation tasks [ 27 ] . Classical image enhancement methods, including Histogram Equalisation (HE) [ 1 ] , Gamma Correction (GC) [ 6 ] , and noise filtering techniques [ 3 ] , remain fundamental and widely used approaches. HE, for example, has been shown to effectively improve foreground-to-background contrast in ophthalmoscopy images, enhancing the visualisation of vascular microstructures at the back of the eye and demonstrating the improved diagnostic potential of optical images when the appropriate preprocessing methods are applied [ 35 ] . In cardiac cell imaging, the application of contrast stretching in conjunction with Gaussian Filtering (GF) has been proven to enhance the segmentation of low-contrast electron microscopy scans of cardiomyocyte (CM) z-disks [ 28 ] . These are nanoscopic structures involved in cardiac contraction, often difficult to visualise even with sophisticated super-resolution technologies. Z-disks segmentation particularly improves when probability-weighted mean curves are used to inform histogram-based thresholding, providing a systematic approach to detect low-contrast structures within high-resolution but noisy microscopy datasets [ 28 ] . The application of GF for histograms smoothing has also been associated with the effective suppression of intensity noise in FM images [ 17 ] . Furthermore, when coupled with Rosin’s thresholding and ellipse fitting, this approach successfully separated overlapping cells in segmentation tasks [ 17 ] , highlighting the continued utility of histogram-based and noise filtering methods in handling biological complexity. 2.2 Hardware-Based Tools Alongside traditional methods, hardware-based and interactive tools have emerged as powerful means of improving microscopy data quality during both acquisition and annotation. ImageJ [ 42 ] and Fiji [ 41 ] are widely used software for the post-acquisition processing of multi-dimensional microscopy datasets. Despite the extensive availability of contrast enhancement, de-noising and segmentation plugins, these platforms were