MoTM: Towards a Foundation Model for Time Series Imputation based on Continuous Modeling
Etienne Le Naour *, Tahar Nabil *, Ghislain Agoua · 2025
Read MoTM: Towards a Foundation Model for Time Series Imputation based on Continuous Modeling by Etienne Le Naour *, Tahar Nabil *, Ghislain Agoua (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-13207.txt.
Introduction
Etienne Le Naour, Tahar Nabil, and Ghislain Agoua build a foundation-style model for filling gaps in time series data. Forecasting gets most attention in this field, while filling missing values in new domains is little explored. Their 2025 model treats each series as a smooth curve, an approach that handles gaps and uneven sampling naturally.
Such curve models falter when a new series looks unlike their training data. The fix, called MoTM, keeps a bank of curve models, each trained on a family of series. A simple regression then mixes them to fit whatever context a new series shows. Tests across gap types and sampling rates show strong results both in and out of the home domain, the authors report.
Catalog record
| CREATOR | Etienne Le Naour *, Tahar Nabil *, Ghislain Agoua |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 34 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-13207
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
MoTM: Towards a Foundation Model for Time Series Imputation based on Continuous Modeling Etienne Le Naour *, Tahar Nabil *, Ghislain Agoua Abstract Recent years have witnessed a growing interest for time series foundation models, with a strong emphasis on the forecasting task. Yet, the crucial task of out-of-domain imputation of missing values remains largely underexplored. We propose a first step to fill this gap by leveraging implicit neural representations (INRs). INRs model time series as continuous functions and naturally handle various missing data scenarios and sampling rates. While they have shown strong performance within specific distributions, they struggle under distribution shifts. To address this, we introduce MoTM (Mixture of Timeflow Models), a step toward a foundation model for time series imputation. Building on the idea that a new time series is a mixture of previously seen patterns, MoTM combines a basis of INRs, each trained independently on a distinct family of time series, with a ridge regressor that adapts to the observed context at inference. We demonstrate robust in-domain and out-of-domain generalization across diverse imputation scenarios (e.g., block and pointwise missingness, variable sampling rates), paving the way for adaptable foundation imputation models. 1 Introduction 0 0 footnotetext: * Equal contribution Oral presentation at the 10th Workshop on Advanced Analytics and Learning on Temporal Data (AALTD), ECML 2025 Real-world time series from domains such as healthcare, industry and climate science are often irregularly sampled or incomplete due to sensor failures and decentralized data collection [ 22 , 6 ] . Reliable imputation is thus a critical first step toward downstream tasks like forecasting, classification, or anomaly detection. Yet, while recent deep learning methods have advanced imputation performance [ 4 , 9 ] , they typically lack robustness to distribution shifts and fail to generalize to out-of-domain data. Recently, zero-shot forecasting models have emerged in the time series community, enabling inference on unseen datasets without retraining. This shift has led to the rise of time series foundation models, offering key benefits: (i) a single, deployable model for diverse use cases, (ii) strong performance on new datasets, often exceeding supervised baselines, and (iii) emerging capabilities beyond simple memorization. While forecasting foundation models are well-studied [ 8 , 26 , 1 ] , imputation-focused counterparts remain scarce. Notable attempts like NuwaTS [ 5 ] and MOMENT [ 12 ] address imputation, but overlook data heterogeneity and varying sampling rates by relying on fixed-length input segments, limiting their ability to exploit shared patterns like periodicities across datasets. A promising direction to overcome this issue lies in time series continuous-time modeling, recently advanced through the use of implicit neural representations (INR) [ 27 , 14 , 15 ] . These models enable time series to be represented as continuous functions, making them particularly suitable for imputation tasks involving irregular sampling or unaligned timestamps. Among these, TimeFlow [ 14 ] has demonstrated competitive imputation performance, often matching or surpassing both traditional statistical methods and deep learning-based approaches. However, while TimeFlow excels within a specific data distribution, it struggles to generalize across distributions, limiting its utility in out-of-domain (OOD) settings. To address these limitations, we introduce MoTM (Mixture of TimeFlow Models), a novel mixture-based architecture. MoTM leverages a ridge regression mechanism at inference to aggregate latent representations from multiple TimeFlow models, each trained on a distinct domain. Our contributions are as follows. • We propose MoTM, a unified model capable of (i) handling various patterns of missing values at inference; (ii) achieving strong performance on out-of-domain datasets without retraining; (iii) effectively managing datasets sampled at different rates (e.g., 10min, 30min, 1h, 2h) by leveraging shared temporal structures across distributions. To the best of our knowledge, MoTM is the first model to meet all of these conditions (see Table 1 ). • Our experiments on synthetic datasets reveal that MoTM exhibits strong zero-shot imputation capabilities that go beyond mere memorization. Notably, it generalizes effectively to time series subject to strong distribution shifts without any additional training. • On real-world datasets, MoTM surpasses baseline models on in-domain (ID) inference and matches the performance of the strongest supervised approaches in the out-of-domain (OOD) setting. Table 1: Comparison of imputation models on key generalization capabilities. Method Can Impute Various Natively Support Different Can Perform Missing Patterns Sampling Rates OOD Inference BRITS [ 4 ] ,SAITS [ 9 ] ✓ ✗ ✗ NuwaTS [ 5 ] ,MOMENT [ 12 ] ✓ ✗ ✓ TimeFlow [ 14 ] , ImputeINR [ 15 ] ✓ ✓ ✗ MoTM (Ours) ✓ ✓ ✓ 2 Related Work The task of imputing missing values in time series has been extensively studied, with approaches ranging from classical statistical methods to recent advances in deep learning. In this section, we review relevant lines of work, focusing on three major directions: supervised deep imputation models, continuous-time representations, and the recent emergence of time series foundation models. Supervised imputation. Recent advances in deep learning have led to an increasing number of models for time series imputation. BRITS [ 4 ] pioneered the use of bidirectional RNNs for imputation, while subsequent methods explored alternative architectures such as GANs [ 18 , 19 , 17 ] , VAEs [ 10 ] , diffusion models [ 25 ] , matrix factorization techniques [ 16 ] , and Transformer-based models like SAITS [ 9 ] . Despite their success, these models assume regularly sampled data limiting their flexibility in real-world applications. Moreover, their generalization capabilities in out-of-domain (OOD) settings remain limited. Continuous-time models. Continuous-time modeling has emerged as a promising approach to handle irregular sampling in time series. Gaussian Processes (GPs) [ 20 ] naturally represent functions over continuous domains but often struggle with scalability and kernel selection [ 7 ] . Neural Processes (NPs) [ 11 , 13 ] provide a more scalable alternative by parameterizing GPs through encoder-decoder architectures, yet they remain challenged by complex, high-frequency signals. More recent extensions use diffusion-based priors [ 2 ] , but these approaches can be sensitive to the number of input timestamps. Other directions involve latent ODEs [ 3 , 21 ] , or attention-based methods like mTAN [ 23 ] , which model irregular time series in a continuous domain. However, these models often fall short in imputation accuracy compared to their discrete-time counterparts. Implicit neural representations (INRs) [ 24 ] have recently gained traction as a more expressive and flexible framework for continuous modeling [ 27 , 14 , 15 ] , but existing models like TimeFlow [ 14 ] still exhibit limited generalization capabilities across distributions. Foundation models. The emergence of foundation models for time series represents a shift towards models capable of zero-shot generalization across diverse datasets. In the forecasting domain, recent models such as Chronos [ 1 ] , Moirai [ 26 ] , and TimesFM [ 8 ] have demonstrated strong performance without fine-tuning, enabling deployment in heterogeneous environments. In contrast, foundation models for imputation remain underexplored. NuwaTS [ 5 ] and MOMENT [ 12 ] are among the few attempts in this direction, but both rely on fixed-length segments and struggle with irregular sampling or variable-resolution datasets. These limitations restrict their ability to model shared temporal structures across datasets with diverse characteristics; highlighting the need for more flexible, distribution-aware