Causal View of Time Series Imputation: Some Identification Results on Missing Mechanism

Ruichu Cai, Kaitao Zheng, Junxian Huang, Zijian Li, Zhengming Chen, Boyan Xu, Zhifeng Hao · 2025

Read Causal View of Time Series Imputation: Some Identification Results on Missing Mechanism by Ruichu Cai, Kaitao Zheng, Junxian Huang, Zijian Li, Zhengming Chen, Boyan Xu, Zhifeng Hao (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-07180.txt.

Introduction

Ruichu Cai and co-authors fill gaps in time series with care for how the gaps came to be. The work dates to 2025. Gaps can come by chance tied to seen facts, or by chance tied to the lost facts. Past fill tools oft use one model for all gap kinds, which can skew reads.

The team first maps the birth path of the data for each gap kind. Hid states and gap-cause terms sit in that map. A flow-based net then learns the hid terms' spread. Proofs show the hid terms can be set apart in their frame. Tests across sets with split gap kinds beat past fill tools.

Catalog record

CREATORRuichu Cai, Kaitao Zheng, Junxian Huang, Zijian Li, Zhengming Chen, Boyan Xu, Zhifeng Hao
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE121 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-07180

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Causal View of Time Series Imputation: Some Identification Results on Missing Mechanism Ruichu Cai, Kaitao Zheng, Junxian Huang, Zijian Li, Zhengming Chen, Boyan Xu, Zhifeng Hao Abstract Time series imputation is one of the most challenge problems and has broad applications in various fields like health care and the Internet of Things. Existing methods mainly aim to model the temporally latent dependencies and the generation process from the observed time series data. In real-world scenarios, different types of missing mechanisms, like MAR (Missing At Random), and MNAR (Missing Not At Random) can occur in time series data. However, existing methods often overlook the difference among the aforementioned missing mechanisms and use a single model for time series imputation, which can easily lead to misleading results due to mechanism mismatching. In this paper, we propose a framework for time series imputation problem by exploring D ifferent M issing M echanisms ( DMM in short) and tailoring solutions accordingly. Specifically, we first analyze the data generation processes with temporal latent states and missing cause variables for different mechanisms. Sequentially, we model these generation processes via variational inference and estimate prior distributions of latent variables via normalizing flow-based neural architecture. Furthermore, we establish identifiability results under the nonlinear independent component analysis framework to show that latent variables are identifiable. Experimental results show that our method surpasses existing time series imputation techniques across various datasets with different missing mechanisms, demonstrating its effectiveness in real-world applications. 1 Introduction While data-driven deep models have achieved significant performance on time series analysis Tang and Matteson (2021) ; Wu et al. (2022) and massive applications, like traffic Jiang et al. (2023) ; Cai et al. (2025a) , weather Wu et al. (2023) , and the Internet of Things Cai et al. (2025b) , their prosperities usually require complete data. However, the missing values of time series led by sensor failures hinder the deployment of existing algorithms to real-world scenarios. To address this challenge, time series imputation Nie et al. (2023) ; Fang et al. (2023) is proposed. The primary goal of time series imputation is to leverage the observed data and the missing indicators to identify the distribution of time series data. To identify the distribution from the time series data Li et al. (2025) , different approaches have been proposed to identify the distribution from the time series data with missing values Li et al. (2024b) . Previously, researchers used statistical tools Acuna and Rodriguez (2004) ; Van Buuren and Groothuis-Oudshoorn (2011) to address the time series imputation. Recent methods based on deep neural networks can be categorized into the predictive and the generative methods. For example, the predictive models harness different neural architectures like recursive neural networks Cao et al. (2018) ; Che et al. (2018) , convolution neural networks Wu et al. (2022) , and Transformer Nie et al. (2023) ; Liu et al. (2023b) to model the inherent dependencies of among variables. Additionally, the generative methods use varied deep generative models like variational autoencoders ( VAE ) Choi and Lee (2023) ; Fortuin et al. (2020) ; Cai et al. (2025c) , generative adversarial networks ( GANs ) Luo et al. (2018) ; Zhang et al. (2021) , and diffusion models Alcaraz and Strodthoff (2022) ; Tashiro et al. (2021) ; Chen et al. (2023) to model the distribution of complete time series data. In summary, these methods model the temporal latent process and generation from latent to observed variables for missing value imputation. Please refer to Appendix A for related work on time series imputation and identification of the temporal latent process. Figure 1: Data generation processes of time series data under different missing mechanisms. {\mathbf{z}}_{t} are temporal latent variables that describe the temporal dependencies. {\mathbf{x}}_{t}^{o} are the observed variables, {\mathbf{x}}_{t}^{m} are the missing data and {\mathbf{c}}_{t} denotes the missing cause variables. (a) The data generation process under the missing at random mechanism, where missingness is related to the observed data but not the unobserved data. (b) The data generation process under the missing not at random mechanism, where the missingness is influenced by the observed data and missing data in the previous time step. (c) The data generation process under the missing completely at random mechanism, where missing data is led by random issues, and the latent missing variables can be considered as random noises. In practical applications, time series data can be affected by various types of missing data mechanisms, such as MCAR (Missing Completely At Random), MAR (Missing At Random), and MNAR (Missing Not At Random). While current methods have achieved success in time series imputation, they often employ a single model that does not account for the differences between these mechanisms. Given an example in healthcare that follows the MNAR mechanisms, patients who experience worsening conditions may not return for scheduled follow-ups, resulting in missing data for the later stages of the treatment. In this case, if a model uses a mismatched missing mechanism like MCAR and ignores the dependency between the missing format and the observed values, it is hard for it to achieve an accurate imputation performance. Therefore, it is essential for time series imputation to model the time series data according to different missing mechanisms. To better exploit the missing mechanisms, we explore D ifferent M issing M echanisms and propose the corresponding methods, forming a general framework named DMM . We first analyze the data generation processes of time series data under different missing mechanisms, including Missing At Random (MAR), Missing Not At Random (MNAR), and Missing Completely At Random (MCAR). Locatello et al. (2019) find that the MCAR mechanism is not identifiable and rare in real-world scenarios. Based on the aforementioned data generation processes, we employ variational inference to model how missing data are generated and the normalizing flow-based neural architectures to enforce the identification of latent variables. Moreover, we analyze the identification results for different missing mechanisms, in which the temporal latent variables and latent missing causes can be identified in the case of MAR and MNAR. Our approach is validated through massive semisynthetic datasets on all the missing mechanisms, the experimental results show that our DMM method outperforms the state-of-the-art baselines. Please refer to Appendix D for more details on missing mechanism. 2 Preliminaries In this paper, we focus on the time series imputation problem in the presence of various types of missing mechanisms. We first formalize the generation process for the time series imputation problem, and then introduce a graphical model (termed imputation m-graphs ) to represent it. Data-generating process. We first let the time series data X=\{{\mathbf{x}}_{1},{\mathbf{x}}_{2},\cdots,{\mathbf{x}}_{T}\},{\mathbf{x}}_{t}\in\mathbb{R}^{n} are generated from latent variables {\mathbf{z}}_{t}\in\mathcal{Z}\subseteq\mathbb{R}^{n} by an invertible and nonlinear mixing function g as shown in Equation ( 1 ): {\mathbf{x}}_{t}=g({\mathbf{z}}_{t}) (1) Moreover, the i -th dimension latent variable z_{t,i} is time-delayed and causally related to the historical latent variables {\mathbf{z}}_{t-\tau} with the time lag \tau via a nonparametric function f_{i} , which is shown as in Equation ( 2 ). z_{t,i}=f_{i}(z_{t-\tau,k}|z_{t-\tau,k}\in\textbf{Pa}(z_{t,i}),\epsilon_{t,i})\quad\text{with}\quad\epsilon_{t,i}\sim p_{\epsilon_{t,i}}, (2) where \textbf{Pa}(z_{t,i}) denotes the set of latent variables that directly cause z_{t,i} and \epsilon_{t,i} denotes the temporally and spatially independent noise extracted from a distribution P_{\epsilon_{t,i}} . Here, we provide a medical example to explain this data generation

Read the complete text