Missing Data in Signal Processing & Machine Learning: Models, Methods & Modern Approaches

A. Hippert-Ferrer, A. Sportisse, A. Javaheri, M. N. El Korso, D. P. Palomar · 2025

Read Missing Data in Signal Processing & Machine Learning: Models, Methods & Modern Approaches by A. Hippert-Ferrer, A. Sportisse, A. Javaheri, M. N. El Korso, D. P. Palomar (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-01696.txt.

Introduction

Alexandre Hippert-Ferrer, Aude Sportisse, Amirhossein Javaheri, Mohammed Nabil El Korso, and Daniel P. Palomar wrote this two thousand twenty-five guide on how to deal with missing data. Gaps in signals are the norm in signal work and machine learning. Staff in the field need a clear map of the ways to cope. The team sorts those ways by three tasks. One fills in the gaps. One works out values in spite of the gaps. One makes forecasts in spite of the gaps.

The guide is not theory. It draws on method and test results from case studies on real uses. It ends with paths for work to come. The hope is that the frame leads both fields to build new methods. It should also help them deal well with new tasks full of gaps. Readers get a clear way in to a spread-out set of past work.

Catalog record

CREATORA. Hippert-Ferrer, A. Sportisse, A. Javaheri, M. N. El Korso, D. P. Palomar
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE108 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-01696

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Missing Data in Signal Processing & Machine Learning: Models, Methods & Modern Approaches A. Hippert-Ferrer, A. Sportisse, A. Javaheri, M. N. El Korso, D. P. Palomar Abstract Introduction Missing data appears when parts of the data are not available for a given variable or a given observation. It is an ubiquitous problem in a wide range of scientific disciplines, including sensor networks, geophysical data analysis, radar and image processing, remote sensing, ecological statistics and biomedical studies, just to name a few [ 1 , 2 , 3 , 4 , 5 ] . A quick search with the keyword “missing data” on IEEE Xplore, GeoRef and BioMed Central databases accumulates, respectively, 37838, 21512 and 181590 results concerning research articles, as by May, 2025. Signal processing is no exception to the rule, where missing data mainly come from sensor malfunction, hidden or impossible measurements, human errors and natural hazards, all of which can hinder a thorough understanding, analysis, and interpretation of the signal. One of the earliest work on missing data was published in 1932 by Wilks, who mentioned the need to extract as much information as possible from fragmentary answers of questionnaires in social sciences and government statistics. Therefore, it is not surprising that the first discipline to witness this issue was mathematical statistics. This led Wilks to derive efficient estimators for the parameters of a normal bivariate distribution when the data contain missing values [ 6 ] . This work was extended to the multivariate case by Lord in 1955 [ 7 ] . Since the early 1970’s, the literature in missing data has flourished with the development of computational capacity, leading to major developments in signal processing and its related fields, such as statistical inference [ 2 ] , data analysis [ 8 ] and machine learning [ 9 ] . In particular, the formulation of a missing-data theory framework by Rubin in [ 10 ] , which describes the relation between missingness and data values in the so-called missing-data mechanisms, has allowed tremendous advancements in statistical analysis. As a consequence, in the past 30 years, a vast body of literature in signal processing (SP) & machine learning (ML) has flourished, not only with the adaptation of classical approaches to the case of incomplete signals (vectors, images, tensors, time series), but also with the development of new methodologies and algorithms in core SP & ML subfields, such as compressive sensing, parameter estimation, graph signal processing, subspace tracking, filtering, regression and classification, sparse signal recovery or time series analysis. Therefore, a tutorial paper aiming to summarize the existing and novel strategies in the SP & ML literature addressing various problems related to missing data, such as parameter estimation, matrix completion, missing data imputation and learning with missing values, as well as showing their potential applications, is an urgent desideratum . This tutorial aims to provide practitioners with vital tools, in an accessible way, to answer the question: How to deal with missing data? There are many strategies to handle incomplete signals. In this paper, we propose to group these strategies based on three tasks commonly considered by SP & ML practitioners: i) Imputation : one might want to replace missing entries with predicted values; ii) Estimation : one might want to infer an unknown parameter or a signal from incomplete data; iii) Learning : one might want to predict a target variable (e.g., labels) from incomplete data. To do so, this article is written in a way to a) highlight the main methodological advances of the missing data literature in SP & ML, and their applications, through detailed case studies with real-world scenarios; b) provide a clear representation of the common adopted strategies, which can be categorized into imputation , estimation and/or learning 1 1 1 Note that the proposed categories are widely permeable to each other, which is illustrated in the document. ; c) reinterpret the main statistical findings through a consistent formalism that is more familiar to the SP community, and make this framework accessible to the majority of the SP & ML readers. It is worth mentioning that due to space limitation, we do not pretend completeness, but rather focus on recent and promising techniques handling incomplete signals tailored for SP & ML practitioners. For specific topics related to missing data, as speech recognition, image inpainting, and remote sensing, the reader can consult, [ 11 , 12 ] and [ 1 ] , respectively. Concerning theoretical and methodology aspects, one tutorial-style paper was published more than 20 years ago in two parts, one focusing on iterative algorithms [ 13 ] and the other on maximum likelihood approaches [ 14 ] . There also exists a survey of modern techniques for low-rank matrix recovery with missing values [ 15 ] and subspace tracking with missing values [ 16 ] . Finally, two recent overviews focusing on missing-data imputation approaches in machine learning and their implementation can be found in [ 17 , 18 ] . As outlined above, the objective of this tutorial is to highlight and address several key advances that have emerged from modern engineering problems faced by the SP & ML communities in real-life applications. In particular, this work focuses on three critical issues that are increasingly encountered in practice. First, handling missing values with irregular data : this requires taking into account the complex structure of SP & ML data settings, i.e., due to heterogeneity, outliers or model mismatch. Ignoring these factors can introduce substantial biases, distort estimates, and undermine predictive performance. A second challenge is low-rank modeling with missing values , which is closely related to subspace learning, principal component analysis, and matrix completion. This approach has gained prominence as an effective strategy for handling incomplete data in SP & ML problems. Based on the assumption that data matrices exhibit low-dimensional structures, these techniques enable not only the recovery of missing entries but also provide computationally and memory-efficient solutions in high-dimensional contexts. Finally, a particularly critical but often overlooked issue is the case of informative missingness , where the absence of data conveys information about the underlying signal. For example, a sensor might fail to report values above a given threshold, making the missingness informative. If unaccounted for, such mechanisms can severely bias the results. Structure of the tutorial : Rather than organizing the manuscript strictly around these aforementioned SP & ML challenges, we have chosen to structure the tutorial based on the strategies and methodologies recommended for handling incomplete data. This approach improves clarity by presenting general methods first, before illustrating their application to specific SP & ML problems. It also highlights methodological connections between seemingly distinct challenges. In addition, it facilitates the integration of recent developments in robust, low-rank, and MNAR-aware techniques. This structure allows the tutorial to remain methodologically focused while addressing the key SP & ML challenges within each methodological category enhancing accessibility for a broader readership. p number of variables or dimensions n number of observations or samples \bm{x}_{j} / \bm{m}_{j} the j -th sample/mask (column of \bm{X} / \bm{M} ) \odot element-wise (Hadamard) product \bm{X} p\times n data matrix [\bm{X}]_{i,:} the i -the row of \bm{X} \bm{X}_{\sf m} / \bm{X}_{\sf o} missing / observed part of

Read the complete text