FMTK: A Modular Toolkit for Composable Time Series Foundation Model Pipelines
Hetvi Shastri, Pragya Sharma, Walid A. Hanafy, Mani Srivastava, Prashant Shenoy · 2025
Read FMTK: A Modular Toolkit for Composable Time Series Foundation Model Pipelines by Hetvi Shastri, Pragya Sharma, Walid A. Hanafy, Mani Srivastava, Prashant Shenoy (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-01038.txt.
Introduction
Hetvi Shastri and four coauthors present FMTK in a 2025 paper on time series tools. Foundation models adapt to new tasks with little or no extra training, and time-series foundation models do the same for data that unfolds over time. They have shown strong results on classification, regression, and filling missing values.
FMTK is a modular toolkit for building composable pipelines from such models. Users can mix and match stages instead of rebuilding a whole system for each job. Modularity matters because time series work spans forecasting, monitoring, and health signals, each with its own steps. A shared toolkit lowers the cost of trying foundation models on real problems.
Catalog record
| CREATOR | Hetvi Shastri, Pragya Sharma, Walid A. Hanafy, Mani Srivastava, Prashant Shenoy |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 20 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2512-01038
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
FMTK: A Modular Toolkit for Composable Time Series Foundation Model Pipelines Hetvi Shastri, Pragya Sharma, Walid A. Hanafy, Mani Srivastava, Prashant Shenoy Abstract Foundation models (FMs) have opened new avenues for machine learning applications due to their ability to adapt to new and unseen tasks with minimal or no further training. Time-series foundation models (TSFMs)—FMs trained on time-series data—have shown strong performance on classification, regression, and imputation tasks. Recent pipelines combine TSFMs with task-specific encoders, decoders, and adapters to improve performance; however, assembling such pipelines typically requires ad hoc, model-specific implementations that hinder modularity and reproducibility. We introduce FMTK , an open-source, lightweight and extensible toolkit for constructing and fine-tuning TSFM pipelines via standardized backbone and component abstractions. FMTK enables flexible composition across models and tasks, achieving correctness and performance with an average of seven lines of code. https://github.com/umassos/FMTK † † footnotetext: Author holds concurrent appointments as a Professor at UCLA, and as an Amazon Scholar. This paper describes work performed at UCLA and is not associated with Amazon. 1 Introduction Time Series Foundation Models (TSFMs), such as MOMENT Goswami2024:MOMENT , Chronos Ansari2024:Chronos , and TimesFM Das2024:TimesFM , have emerged as powerful pre-trained architectures for a variety of downstream tasks, including forecasting, classification, and imputation. While these models serve as fixed backbones trained on large-scale temporal data, effective task specialization often requires integrating additional components: input encoders to structure raw data, task-specific decoders to generate predictions, and increasingly, parameter-efficient adapters (e.g., LoRA Hu2022:LoRA ) to enable lightweight fine-tuning. This modular design space, though conceptually flexible, has resulted in a fragmented and ad hoc implementation landscape. For example, models such as PaPaGei pillai2024papagei and Mantis feofanov2025mantis require the development of extensive custom pipelines for simple comparison with state-of-the-art models. Moreover, models like Moment Goswami2024:MOMENT offer distinct modes for different tasks (e.g., forecasting versus classification), which restricts the reuse of the same powerful backbone for a diverse set of downstream tasks during runtime. As a result, three key challenges emerge. 1 First, the absence of a unifying abstraction across encoders, backbones, adapters, and decoders significantly increases the engineering burden and inhibits systematic exploration of architectural variants. 2 Second, the lack of modular encapsulation complicates the attribution. It becomes difficult to isolate and measure the contribution of individual components to the overall performance of the model. 3 Third, evaluation practices vary widely across studies. Minor differences in data pre-processing, training regimes, or decoder heads can lead to substantial discrepancies in reported results, thereby undermining reproducibility. Although existing time series libraries such as sktime sktime , Darts Julien2022:Darts , tsai tsai , and GluonTS gluonts_jmlr support classical and deep learning pipelines, they do not address the emerging need for composable, FM-centric evaluation. To this end, we introduce FMTK : an open-source, lightweight, and extensible Time Series Foundation Model Toolkit for constructing, fine-tuning and benchmarking modular TSFM pipelines. Contributions: Our contributions can be summarized as follows: 1. FMTK proposes a standardized API for TSFM pipelines that defines a common grammar for connecting FM backbones with external encoders, fine-tuning adapters and decoders. 2. FMTK provides reference implementation of commonly used configurations and supports multiple time series tasks under consistent evaluation settings. 3. By decoupling architectural components and enforcing standardized execution semantics, FMTK facilitates reproducible experimentation and controlled comparison across a rapidly growing space of TSFM-based systems. 2 Design Figure 1: Modular abstraction of pipeline construction using FMTK : The framework allows instantiating pipelines by pairing an FM with interchangeable components. Users can dynamically select and load components, specify trainable parts (e.g., decoder), and benchmark pipelines in a unified interface. We illustrate two example configurations using the same FM: (top) encoder-decoder-adapter-tuned pipeline with E1, A1 and D2; (bottom) encoder-decoder tuned with E3 and D3. To address the challenges outlined earlier ( 1 – 3 ), the design of FMTK is guided by three core principles: composability, usability, and reproducibility. Composability is achieved through standardized interfaces for encoders, backbones, adapters, and decoders, enabling seamless interchangeability and systematic exploration of pipeline configurations. Usability is prioritized through a lightweight and declarative API that abstracts away engineering complexity, making it possible for both domain experts and non-specialists to experiment with modular TSFM pipelines without extensive prior familiarity with FM internals. Finally, to promote reproducibility , the toolkit enforces consistent pre-processing, component integration, evaluation routines, and monitoring capabilities, allowing researchers to conduct controlled comparisons and ablation studies under uniform conditions. 2.1 Components These design principles manifest in FMTK through a modular architecture centered around four key components as shown in Figure 1 . Encoders transform raw time series into representations compatible with the foundation model. These may perform format conversion, context windowing, dimentionality reduction or domain-specific preprocessing. FMTK allows interchangeable encoders to support diverse inputs. Foundation Model Backbone (FM) refers to a pre-trained, frozen or partially frozen TSFM that produces task-agnostic latent features. FMTK supports FMs like Chronos, Moment, and TimesFM, by providing a common I/O interfaces. Adapters are lightweight modules for efficient adaptation to new tasks or domains without full backbone fine-tuning. FMTK currently supports methods such as LoRA enabling selective training. Decoders are task-specific heads (e.g., for forecasting, classification) that operate on FM outputs. They may range from simple MLPs to more complex attention-based or partially fine-tuned heads. 2.2 Pipeline Abstraction To support flexible experimentation, FMTK exposes a unified Pipeline abstraction, which allows any valid combination of encoder, backbone, adapter, and decoder modules. As illustrated in Figure 1 , different configurations traverse distinct paths through the component graph depending on the intended usage pattern. We demonstrate via two use-cases how the system handles component integration, fine-tuning and execution behind the scenes, allowing both novice users and expert researchers to build, train, and evaluate pipelines with minimal overhead. (More details provided in Appendix A ) Use-Case 1 (simple usage): Chronos backbone can be combined with SVM decoder to enable Heartbeat Classification task. FMTK allows this by attaching the decoder through add_decoder() and restricting training to the decoder via train(parts_to_train=[...]) . Use-Case 2 (advanced usage): The Moment backbone can support diverse downstream tasks, such as PPG monitoring and Energy Forecasting, through a shared representation. PPG monitoring is supported by attaching a regression MLP decoder, linear encoder, and LoRA adapter to the backbone, while Energy Forecasting is supported by attaching an MLP decoder alone. After fine-tuning as explained in Use-Case 1, toolkit enables adaptive switching between distinct paths at runtime via load_encoder() , load_adapter() and load_decoder() . 2.3 Runtime Metrics and Benchmarking Support In addition to traditional accuracy-based or MAE-based evaluation, FMTK supports the collection of runtime metrics for pipeline benchmarking. For each experiment, the framework logs: 1. Memory Utilization : Peak GPU/CPU memory usage during inference and training. 2. Training and Inference Time : Wall-clock time for each training phase and prediction batch. 3. Component Loading Overhead : Time to load and switch between components at runtime. 4. Energy Consumption : Optional support for energy profiling using compatible hardware monitors. These measurements facilitate holistic comparisons between pipeline variants and promote reproducibility by modularizing system-level bottlenecks and trade-offs. Chronos Moment PaPaGei-S Task Decoder Base FMTK Base FMTK Base FMTK Regression (MAE) Systolic BP (PPG-BP) Ridge 15.84 15.82 15.99 15.99 15.65 15.65 Diastolic BP (PPG-BP) 9.43 9.56 8.88 8.88 8.98 8.98 Heart Rate (PPG-BP)