HELIX: Hybrid Encoding with Learnable Identity and Cross-dimensional Synthesis for Time Series Imputation

Fengming Zhang, Wenjie Du, Huan Zhang, Ke Yu, Shen Qu · 2026

Read HELIX: Hybrid Encoding with Learnable Identity and Cross-dimensional Synthesis for Time Series Imputation by Fengming Zhang, Wenjie Du, Huan Zhang, Ke Yu, Shen Qu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-02278.txt.

Introduction

Fengming Zhang and colleagues present HELIX, a model for filling missing values in time series that gives each feature a lasting identity. Attention methods can use links across features, but they rediscover those links at every layer, with no stable anchor for what each feature means. HELIX assigns a learnable embedding to each feature that persists through the network.

Unlike graph methods, HELIX needs no predefined topology and does not assume uniform spatial links. It learns arbitrary feature dependencies from temporal co-variation, handling data that mix spatial sites with semantic variables. With hybrid temporal-feature attention, it beat sixteen baselines across five public data sets and twenty-one settings. Analysis shows its learned identities align with meaningful feature structure.

Catalog record

CREATORFengming Zhang, Wenjie Du, Huan Zhang, Ke Yu, Shen Qu
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE80 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.02278

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

HELIX: Hybrid Encoding with Learnable Identity and Cross-dimensional Synthesis for Time Series Imputation Fengming Zhang, Wenjie Du, Huan Zhang, Ke Yu, Shen Qu Abstract Time series imputation benefits from leveraging cross-feature correlations, yet existing attention-based methods re-discover feature relationships at each layer, lacking persistent anchors to maintain consistent representations. To address this, we propose HELIX, which assigns each feature a learnable feature identity, a persistent embedding that captures intrinsic semantic properties throughout the network. Unlike graph-based methods that rely on predefined topology and assume homogeneous spatial relationships, HELIX learns arbitrary feature dependencies end-to-end from temporal co-variation, naturally handling datasets where features mix spatial locations with semantic variables. Integrated with hybrid temporal-feature attention, HELIX achieves the state-of-the-art performance, surpassing all 16 baselines on 5 public datasets across 21 experimental settings in our evaluation. Furthermore, our mechanistic analysis reveals that HELIX aligns learned feature identities and dependencies with latent physical and semantic structure progressively across layers, demonstrating that it more effectively translates cross-feature structure into imputation accuracy. 1 Introduction Missing values in multivariate time-series data, arising from sensor failures, communication dropouts, and irregular sampling, propagate through downstream tasks and degrade performance in forecasting ( Wu et al. 2021 ) , classification ( Che et al. 2018 ) , and anomaly detection ( Wu et al. 2023 ) , especially when missingness spans both time and features. Deep learning has advanced time series imputation through recurrent methods ( Cao et al. 2018 ; Che et al. 2018 ) , Transformer-based approaches ( Du et al. 2023 ; Nie et al. 2024 ) , and diffusion models ( Tashiro et al. 2021 ; Goswami et al. 2024 ) . Despite this progress, integrating learnable feature identity embeddings with point-wise (t,i) representations for imputation has received limited attention in the imputation literature ( Wang et al. 2025 ; Du et al. 2024 ; Lester et al. 2021 ; Devlin et al. 2019 ) . Many graph-based imputation methods couple temporal modeling and cross-feature message passing through a coarse interface ( Cini et al. 2022 ; Marisca et al. 2022 ) . A common design strategy is to process one axis first (e.g., summarizing/encoding temporal context before graph propagation, or propagating on feature graphs and then aggregating temporally), which introduces an information bottleneck for point-wise reconstruction: collapsing or serializing one dimension can weaken the fine-grained (t,i) alignment required for accurate value imputation under conditions of severe missingness ( Cini et al. 2022 ; Marisca et al. 2022 ) . In addition, when spatial priors are unavailable or heterogeneous feature types coexist, predefined graphs become ambiguous ( Cini et al. 2022 ; Marisca et al. 2022 ) . Moreover, learned adjacency often remains expensive ( O(F^{2}) ) in practice ( Wu et al. 2020 ; Wu et al. 2019 ) and still provides no persistent, data-independent anchor when values are missing ( Cini et al. 2022 ) . Input \tilde{\mathbf{X}},\mathbf{M} Embedding Layer Projection \mathbf{H}^{(0)} Hybrid Encoding Layer \times L \{\mathbf{H}^{(l)}\}_{l=1}^{L} Multi-level Fusion LayerNorm Projection Output \hat{\mathbf{X}} (a) Overall Architecture Value \tilde{x}_{t,i} Sinusoidal PE Feature ID Mask m_{t,i} \tilde{x} \cdots \cdots m \mathbb{R}^{B\times T\times F\times d_{e}} (b) Embedding Details \mathbf{H}^{(l-1)} Time MHA Feat MHA Feat MHA Time MHA \mathbf{H}_{T} \mathbf{H}_{F} \mathbf{H}_{TF} \mathbf{H}_{FT} Avg \mathbf{H}^{(l)} Stage 1: Parallel Stage 2: Cross (c) Double-Helix Encoding Figure 1 : Architecture Overview with Zoom-in Details. (a) The main backbone. (b) Embedding details (value, Sinusoidal PE, feature identity, mask). (c) Hybrid Encoding Layer detail (referencing the parallel-then-cross attention mechanism). The key insight is that sensor relationships constitute stable structural properties. Therefore, Feature Identity Embedding (FeatID) is introduced: learnable vectors capturing intrinsic semantics, enabling the model to decompose imputation into compatibility (via identity) and dynamic correlation (via values). HELIX ( H ybrid E ncoding with L earnable I dentity and Cross-dimensional Synthesis) 1 1 1 Code: https://github.com/milaogou/HELIX . HELIX is integrated into PyPOTS ( Du 2023 ) for out-of-the-box usage. explicitly decouples static feature identity from dynamic temporal variations. This architecture enriches observations with learned identities and processes them through hybrid encoding that interleaves temporal and cross-feature attention in a double-helix pattern, enabling coordinated information flow across both dimensions. Our main contributions are: • Feature Identity Embedding : learnable per-feature vectors serving as persistent semantic anchors for cross-feature attention. • Double-Helix architecture : hybrid encoding yields consistently strong performance across diverse missing patterns and datasets, improving robustness in our ablations (see Tables 4 and 21 ). • State-of-the-art results : rank first across 21 settings on 5 datasets, outperforming 16 competitive baselines in our evaluation. • Interpretable behavior : feature attention progressively aligns with underlying structure ( r : 0.59{\to}0.71 ), embeddings recover both spatial (BeijingAir) and clinical (PhysioNet2012) structure without supervision. 2 Related Work Deep Multivariate Time Series Imputation. A recent comprehensive survey categorizes deep learning approaches for imputation into three primary paradigms: predictive, generative, and large model-based methods ( Wang et al. 2025 ) . Predictive methods aim to provide deterministic estimates by modeling temporal dependencies. Early works relied on RNNs with decay mechanisms, such as GRU-D ( Che et al. 2018 ) and BRITS ( Cao et al. 2018 ) . Recently, CNN-based models like TimesNet ( Wu et al. 2023 ) and Attention-based models like SAITS ( Du et al. 2023 ) and ImputeFormer ( Nie et al. 2024 ) have gained prominence due to their ability to capture long-range dependencies and complex variations. HELIX belongs to this category, focusing on precise point-wise reconstruction. Generative methods model the data distribution to quantify uncertainty. Variational Autoencoders (VAEs) like GP-VAE ( Fortuin et al. 2020 ) and GAN-based models like GRUI-GAN ( Luo et al. 2018 ) were early adopters. More recently, diffusion probabilistic models such as CSDI ( Tashiro et al. 2021 ) and PriSTI ( Liu et al. 2023 ) have achieved high-fidelity generation. However, as noted in recent surveys, these methods often suffer from high computational costs and slow inference speeds ( Wang et al. 2025 ) . Large Model-based methods leverage pre-trained foundation models (PFMs) to handle diverse missing patterns. Approaches like GPT4TS ( Zhou et al. 2023 ) and Timer ( Liu et al. 2024b ) adapt Large Language Models (LLMs) or large-scale pre-trained Transformers for time series tasks. While promising, they pose significant challenges in terms of parameter efficiency and deployment latency compared to specialized architectures. Feature Dependency and Graph Modeling. Capturing correlations between variates is critical for multivariate imputation. GNN-based methods like GRIN ( Cini et al. 2022 ) and SPIN ( Marisca et al. 2022 ) explicitly model these dependencies using graph neural networks. However, they typically rely on predefined spatial topologies or learned adjacency matrices, which assumes a homogeneous node structure. In contrast, HELIX employs a Feature Identity Embedding to learn intrinsic semantic relationships between heterogeneous features without requiring an explicit graph prior, addressing scenarios where spatial information is unavailable or undefined. Hybrid Temporal-Feature Encoding. Multi-scale aggregation has proven effective: TimeMixer ( Wang et al. 2024 ) proposes multi-scale mixing, while iTransformer ( Liu et al. 2024a ) treats variates as tokens. Crossformer ( Zhang & Yan 2023 ) also utilizes a two-stage attention mechanism. However, it relies on patch embeddings derived solely from data values. In contrast, HELIX introduces explicit Feature Identity

Read the complete text