TANDEM : Temporal Attention-guided Neural Differential Equations for Missingness in Time Series Classification Conference: Proceedings of the 34th ACM International Conference on Information and Knowledge Management; November 10–14, 2025; Seoul, Republic of Korea. Proceedings of the 34th ACM Interna

YongKyung Oh, Dong-Young Lim, Sungil Kim, Alex A. T. Bui · 2025

Read TANDEM : Temporal Attention-guided Neural Differential Equations for Missingness in Time Series Classification Conference: Proceedings of the 34th ACM International Conference on Information and Knowledge Management; November 10–14, 2025; Seoul, Republic of Korea. Proceedings of the 34th ACM Interna by YongKyung Oh, Dong-Young Lim, Sungil Kim, Alex A. T. Bui (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-17519.txt.

Introduction

YongKyung Oh and co-authors present a 2025 paper on classifying time series with missing values. Gaps plague sensor and medical records, and filling them by guess can bias results. Their model, TANDEM, treats the gaps as part of the signal. An attention-guided differential equation follows the series as a continuous path, blending raw points with a smooth control path.

Attention lets the model weight the most telling stretches of each record. Thirty benchmark sets plus a real medical set tested the design. TANDEM beat current best methods on accuracy across the board. The authors say it also reveals how a model copes with missingness, which aids trust. The work targets domains where gaps are the rule, not the exception.

Catalog record

CREATORYongKyung Oh, Dong-Young Lim, Sungil Kim, Alex A. T. Bui
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE57 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-17519

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

TANDEM : Temporal Attention-guided Neural Differential Equations for Missingness in Time Series Classification Conference: Proceedings of the 34th ACM International Conference on Information and Knowledge Management; November 10–14, 2025; Seoul, Republic of Korea. Proceedings of the 34th ACM International Conference on Information and Knowledge Management (CIKM ’25), November 10–14, 2025, Seoul, Republic of Korea ISBN: 979-8-4007-2040-6/2025/11 DOI: 10.1145/3746252.3760996 CCS: Computing methodologies Artificial intelligence CCS: Computing methodologies Machine learning YongKyung Oh, Dong-Young Lim, Sungil Kim, Alex A. T. Bui Abstract . Handling missing data in time series classification remains a significant challenge in various domains. Traditional methods often rely on imputation, which may introduce bias or fail to capture the underlying temporal dynamics. In this paper, we propose TANDEM ( Temporal Attention-guided Neural Differential Equations for Missingness ), an attention-guided neural differential equation framework that effectively classifies time series data with missing values. Our approach integrates raw observation, interpolated control path, and continuous latent dynamics through a novel attention mechanism, allowing the model to focus on the most informative aspects of the data. We evaluate TANDEM on 30 benchmark datasets and a real-world medical dataset, demonstrating its superiority over existing state-of-the-art methods. Our framework not only improves classification accuracy but also provides insights into the handling of missing data, making it a valuable tool in practice. 1. Introduction Time series data are fundamental in many domains but are often suffer from missing values due to sensor issues, data corruption, or irregular sampling ( Rubin 1976 ; Little and Rubin 2019 ) . Traditional methods for handling missingness, such as deletion or simple imputation, can distort temporal dynamics and introduce bias, especially with non-random or extensive missing data ( Janssen et al. 2010 ; Emmanuel et al. 2021 ) . While generative imputation models ( Cao et al. 2018 ; Yoon et al. 2018 ) offer improvements, they often treat imputation as a separate preprocessing step, potentially neglecting uncertainties and complex dependencies in irregularly sampled time series. Neural Differential Equations (NDEs), including Neural ODEs ( Chen et al. 2018 ) , CDEs ( Kidger et al. 2020 ) , and SDEs ( Tzen and Raginsky 2019 ; Oh et al. 2024 ) , provide a robust framework for modeling continuous-time dynamics, adept at handling complex and irregularly sampled data. Neural CDEs, for example, effectively model irregular series by using an input-derived control path to drive the hidden state dynamics. However, NDEs alone do not explicitly address how to best utilize available information when observations are sparse or incomplete for classification tasks ( Oh et al. 2025 ) . Attention mechanisms ( Vaswani et al. 2017 ) , renowned for enabling models to focus on salient input segments, offer a promising way to enhance NDEs in such scenarios by adaptively weighing data importance ( Shukla and Marlin 2021 ; Y. Lee et al. 2022 ) . While the integration of NDEs and attention is an active research area ( Jhin et al. 2021 ; J. -T. Chien and Y. -H. Chen 2021 ; Chen et al. 2023 ; Jhin et al. 2024 ; Tong et al. 2025 ) , a comprehensive framework that adaptively fuses diverse NDE-derived representations under varying missingness conditions, across multiple NDE backbones, remains less explored. To address this, we propose TANDEM ( Temporal Attention-guided Neural Differential Equations for Missingness ). TANDEM synergistically combines NDEs with a novel attention and gating mechanism to classify time series with missing values. It integrates three feature streams: raw observations, control path, and continuous NDE-derived latent dynamics. A Gumbel-Sigmoid gating module with multi-head attention fuses these streams and prioritizes informative signals under missingness. Our contributions are: • Novel framework, TANDEM , that integrates raw, interpolated, and latent NDE-based representations to handle missingness in time series. Flexible Gumbel-Sigmoid gating mechanism with multi-head attention for adaptive fusion of these feature streams, enhancing robustness under high missingness. • A modular design supporting various NDE backbones (Neural ODEs, CDEs, SDEs), allowing users to tailor the continuous-time model to their data. • Extensive validation on 30 UCR/UEA benchmarks and a real-world medical dataset, demonstrating superior classification accuracy and robustness over state-of-the-art methods across diverse missingness levels. This paper is organized as follows: Section 2 reviews related work. Section 3 details the TANDEM framework. Experimental results are presented in Section 4 (benchmarks) and Section 5 (real-world application). Section 6 concludes and discusses future work. Figure 1. Conceptual overview of the TANDEM framework. For a given time series with potentially missing values, three distinct feature streams are processed: (i) the raw observation \tilde{{\bm{x}}}(t) , (ii) an interpolated, piecewise-smooth control path \bm{X}(t) , and (iii) continuous latent dynamics {\bm{z}}(t) derived from an NDE backbone. Each stream is individually refined by attention mechanisms, resulting in attended representations \Phi_{\tilde{{\bm{x}}}}(t) , \Phi_{\bm{X}}(t) , and \Phi_{{\bm{z}}}(t) . Colors represent the learned temporal attention scores for each stream. These attended representations are then adaptively weighted by learnable Gumbel-Sigmoid gates ( \sigma_{\tilde{{\bm{x}}}} , \sigma_{\bm{X}} , \sigma_{{\bm{z}}} ) which determine the contribution of each stream. The resulting fused representation, \bar{\mathcal{Z}}(t) , is subsequently passed to a classifier. 2. Related Works NDEs have emerged as a powerful paradigm for modeling continuous-time dynamics ( Oh et al. 2025 ) . The foundational Neural ODEs ( Chen et al. 2018 ) parameterize the derivative of a system’s hidden state with a neural network, offering flexibility for irregularly sampled data. Enhancements include Augmented Neural ODEs ( Dupont et al. 2019 ) for increased expressiveness, and Latent ODEs ( Rubanova et al. 2019 ) which learn dynamics in a latent space, beneficial for series with missingness. Neural CDEs ( Kidger et al. 2020 ) generalize Neural ODEs by incorporating an input-derived control path, making them highly effective for irregular time series. This was further extended by Neural Rough Differential Equations (Neural RDEs) using rough path theory to handle noisy, long sequences ( Morrill et al. 2021 ) . Concurrently, Neural SDEs have been developed to capture stochastic dynamics. Tzen and Raginsky 2019 introduced Neural SDEs for learning stochastic processes, Li et al. 2020 addressed scalable gradient computation for them, and Oh et al. 2024 analyzed their stability for irregular data. While these NDE methods excel at modeling continuous dynamics, they often lack explicit mechanisms to adaptively prioritize information from different feature representations when faced with missing observations, a gap our work addresses. Attention Mechanisms in Sequence Modeling. Attention mechanisms, first prominent in neural machine translation ( Bahdanau et al. 2015 ) , enable models to dynamically focus on relevant parts of an input sequence. The transformer architecture ( Vaswani et al. 2017 ) , centered around self-attention, further established this approach for capturing dependencies in sequences. In time series analysis, attention has been used to capture temporal patterns and feature importance. For instance, Qin et al. 2017 proposed dual-stage attention for prediction, Shih et al. 2019 introduced temporal pattern attention for multivariate forecasting, and Lim et al. 2021 developed temporal fusion transformers for interpretable multi-horizon forecasting. These methods highlight the utility of attention in focusing on critical time steps or features. Integrating NDEs and Attention Mechanisms. The integration of NDEs with attention mechanisms, which combines continuous-time modeling with dynamic input weighting, is an active research area. Initial explorations often occurred in Natural Language Processing

Read the complete text