Evaluation of Missing Data Imputation for Time Series Without Ground Truth

Rania Farjallah, Bassant Selim, Brigitte Jaumard, Samr Ali, Georges Kaddoum, Emails : [email protected], [email protected], [email protected], [email protected], [email protected] · 2025

Read Evaluation of Missing Data Imputation for Time Series Without Ground Truth by Rania Farjallah, Bassant Selim, Brigitte Jaumard, Samr Ali, Georges Kaddoum, Emails : [email protected], [email protected], [email protected], [email protected], [email protected] (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-05775.txt.

Introduction

Filling gaps in time series data is hard to judge when the true values are missing, and a 2025 paper by Rania Farjallah and co-authors takes on that problem. Their work grows out of tasks such as running 5G mobile networks, where gaps in the data can hurt the models that rely on it.

The team proposes two checks that need no ground truth: one based on the Wasserstein distance and one on the Jensen-Shannon divergence. Both compare how closely the filled data matches the shape of the data that was observed. The authors ran the checks across several filling methods and found both scores track fill quality well. That gives teams a way to grade fills using the data's own inner structure.

Catalog record

CREATORRania Farjallah, Bassant Selim, Brigitte Jaumard, Samr Ali, Georges Kaddoum, Emails : [email protected], [email protected], [email protected], [email protected], [email protected]
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE25 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-05775

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Evaluation of Missing Data Imputation for Time Series Without Ground Truth Rania Farjallah, Bassant Selim, Brigitte Jaumard, Samr Ali, Georges Kaddoum, Emails : [email protected], [email protected], [email protected], [email protected], [email protected] Abstract The challenge of handling missing data in time series is critical for maintaining the accuracy and reliability of ml ( ml ) models in applications like 5g ( 5g ) network management. Traditional methods for validating imputation rely on ground truth data, which is inherently unavailable. This paper addresses this limitation by introducing two statistical metrics, the wd ( wd ) and jsd ( jsd ), to evaluate imputation quality without requiring ground truth. These metrics assess the alignment between the distributions of imputed and original data, providing a robust method for evaluating imputation performance based on internal structure and data consistency. We apply and test these metrics across several imputation techniques. Results demonstrate that wd and jsd are effective metrics for assessing the quality of missing data imputation, particularly in scenarios where ground truth data is unavailable. Index Terms—Missing Data Imputation, Time Series Data, Machine Learning, Wasserstein Distance, Jensen-Shannon Divergence. I Introduction As data traffic and application demands surge with the deployment of 5g networks, communication systems face unprecedented challenges in complexity. Applications like real-time video streaming, autonomous vehicles, and iot ( iot ) devices require high data throughput, ultra-low latency, and reliable, adaptive resource management. To meet these demands, machine learning ( ml ) and dl ( dl ) techniques have become indispensable for optimizing network performance. These models enable adaptive traffic forecasting, real-time bandwidth allocation, efficient energy management, and proactive congestion control, which identifies and mitigates network bottlenecks to prevent performance degradation [ 1 , 2 ] . However, the accuracy of these ml -driven optimizations depends heavily on high-quality, complete data—an ideal that is often unattainable, as real-world datasets are typically riddled with missing values or inconsistencies. Consequently, effective data filling strategies are essential to ensure that ml models function reliably and unlock the full potential of 5g network capabilities. While imputation might seem similar to prediction, it differs in the availability of ground truth. Prediction forecasts future values using observed data, whereas imputation reconstructs missing values without access to ground truth. In practice, 5g network datasets, such as performance measurement counters, frequently contain missing values due to factors like system failures, storage constraints, and synchronization issues within the network’s data collection infrastructure [ 3 ] . These data gaps can undermine the accuracy of ml models used for network management tasks, such as traffic forecasting and resource allocation, thereby impacting overall network performance. Traditional imputation methods, such as deletion or simple filling techniques, often fall short because they do not account for the dependencies and correlations among metrics in 5g network data. Advanced ml -based imputation methods offer more accurate results by modeling these relationships; however, they introduce a new challenge: the need for reliable validation mechanisms to ensure that imputed values faithfully represent the missing data. Existing imputation methods typically assume access to ground truth data to validate their performance, but in data-filling tasks, this original data is inherently missing. Without ground truth, assessing the accuracy of imputed values becomes challenging, highlighting the need for alternative metrics to evaluate model performance effectively. This paper explores the use of statistical tools as validation metrics for evaluating imputation performance. These tools measure differences or distances between distributions, a common approach in synthetic data evaluation. By comparing distributional differences between imputed data and the original data, they provide a practical method for assessing imputation accuracy without relying on ground truth. To validate the proposed metrics, we apply them to complete datasets that share characteristics with incomplete 5g network data. The remainder of this paper is organized as follows. Section II describes related works. Section III presents the proposed metrics. Section IV illustrates the datasets and the validation methodology. Section V discusses the experimental settings and results, and Section VI concludes the paper and provides future research directions. II Related Works The quality and completeness of datasets are essential for effective analysis, especially in time series applications where missing values can obscure key patterns, such as seasonality, and reduce predictive accuracy. Seasonality, characterized by periodic fluctuations over time (e.g., daily or weekly patterns), can critically impact model performance by introducing systematic variations that imputation methods must account for. However, many imputation methods do not incorporate seasonality, relying only on remaining observed data, which simplifies modeling but reduces accuracy. For small gaps, basic interpolation methods are commonly used, fitting smooth curves between known data points to estimate missing values. While simple, these methods fail to capture temporal dependencies and can lead to biased results. Other approaches include single-imputation techniques, such as Hot Deck, Cold Deck, and em ( em ), which replace each missing value with a single estimate but may not reduce bias effectively [ 4 ] . In contrast, mi ( mi ) techniques offer advantages by providing information on how missing data impacts parameter estimates [ 4 ] . Advanced methods, such as regression-based imputation, som ( som ) [ 5 ] , and knn ( knn ), have proven more effective, particularly in datasets where temporal relationships are significant. knn , for instance, fills missing values by identifying the k-closest patterns around the missing data point, utilizing local similarity to improve imputation accuracy [ 6 ] . Incorporating seasonality into imputation methods can markedly improve accuracy. Techniques such as seasonal adjustment with Kalman filters and linear interpolation on seasonally decomposed data, available in tools like the forecast and zoo R-packages, have proven useful [ 7 ] . Additionally, sarima ( sarima ) has been applied to seasonal time series, although it struggles with consecutive missing values [ 8 ] . More advanced approaches include neural network-based methods, such as mlp ( mlp ) [ 9 ] and lstm ( lstm ) networks, as well as hybrid neural models [ 10 ] . Pattern-based methods, like the tkcm ( tkcm ) algorithm, have also been used to handle missing data [ 11 ] . However, many of these methods are limited to single-seasonal patterns and are not well-suited for multiple seasonalities. All imputation validation approaches rely on ground truth data to evaluate accuracy. Typically, studies create artificial gaps in complete datasets, then fill these gaps and compare the imputed values to the known originals. This approach enables traditional metrics like rmse ( rmse ) and mae ( mae ) to measure a model’s ability to accurately reconstruct missing data. However, this validation strategy assumes that ground truth data is available—an assumption that often does not hold in real-world applications, especially in dynamic environments such as 5g networks. This paper addresses this gap by introducing two statistical metrics to evaluate imputation methods without relying on ground truth. These metrics assess how closely the distributions of imputed data align with those of the original data, providing a way to evaluate imputation effectiveness based on internal structure and data consistency. By adapting these metrics, we offer a set of tools that complements existing validation approaches and extends evaluation capabilities to real-world applications where complete datasets are not available. III Proposed Data Filling Validation Metrics To validate the performance of data

Read the complete text