Can Time-Series Foundation Models Perform Building Energy Management Tasks? Journal: Data/Math Publication type: ARTICLE TYPE

Ozan Baris Mulayim *, Pengrui Quan *, Liying Han, Xiaomin Ouyang, Dezhi Hong, Mario Bergés, Mani Srivastava · 2025

Read Can Time-Series Foundation Models Perform Building Energy Management Tasks? Journal: Data/Math Publication type: ARTICLE TYPE by Ozan Baris Mulayim *, Pengrui Quan *, Liying Han, Xiaomin Ouyang, Dezhi Hong, Mario Bergés, Mani Srivastava (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-11250.txt.

Introduction

Ozan Mulayim and six co-authors test, in 2025 work, whether broad time-series models can run building energy tasks. Buildings need forecasts of heat and power use, yet each site now gets its own bespoke model, which does not scale. Models trained on wide data, like the tongue models that swept other fields, might do the job in one form.

The team graded such models on four fronts: plain forecasts on new data, forecasts with extra inputs, use of their codes for sorting tasks, and steadiness under unlike scores and settings. The models beat simple counts only by a hair on new data, and extra inputs did not help them. Their codes did serve well for sorting. In hard buildings they lagged. The team calls for work on inputs and time sense.

Catalog record

CREATOROzan Baris Mulayim *, Pengrui Quan *, Liying Han, Xiaomin Ouyang, Dezhi Hong, Mario Bergés, Mani Srivastava
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE96 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-11250

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Can Time-Series Foundation Models Perform Building Energy Management Tasks? Journal: Data/Math Publication type: ARTICLE TYPE Ozan Baris Mulayim *, Pengrui Quan *, Liying Han, Xiaomin Ouyang, Dezhi Hong, Mario Bergés, Mani Srivastava Abstract Building energy management (BEM) tasks require processing and learning from a variety of time-series data. Existing solutions rely on bespoke task- and data-specific models to perform these tasks, limiting their broader applicability. Inspired by the transformative success of Large Language Models (LLMs), Time-Series Foundation Models (TSFMs), trained on diverse datasets, have the potential to change this. Were TSFMs to achieve a level of generalizability across tasks and contexts akin to LLMs, they could fundamentally address the scalability challenges pervasive in BEM. To understand where they stand today, we evaluate TSFMs across four dimensions: (1) generalizability in zero-shot univariate forecasting, (2) forecasting with covariates for thermal behavior modeling, (3) zero-shot representation learning for classification tasks, and (4) robustness to performance metrics and varying operational conditions. Our results reveal that TSFMs exhibit limited generalizability, performing only marginally better than statistical models on unseen datasets and modalities for univariate forecasting. Similarly, inclusion of covariates in TSFMs does not yield performance improvements, and their performance remains inferior to conventional models that utilize covariates. While TSFMs generate effective zero-shot representations for downstream classification tasks, they may remain inferior to statistical models in forecasting when statistical models perform test-time fitting. Moreover, TSFMs forecasting performance is sensitive to evaluation metrics, and they struggle in more complex building environments compared to statistical models. These findings underscore the need for targeted advancements in TSFM design, particularly their handling of covariates and incorporating context and temporal dynamics into prediction mechanisms, to develop more adaptable and scalable solutions for BEM. keywords time series foundation models, building energy management, forecasting foundation models, transfer learning keywords [MSC Codes] \codes [Primary]68T07; \codes [Secondary]62M10, 68T05 YEAR {Frontmatter} \authormark Mulayim and Quan et al . \authormark Mulayim and Quan et al . Impact Statement The insights gained from this study extend beyond building energy management, offering a broader evaluation of Time-Series Foundation Models (TSFMs) when applied to domains they were not explicitly trained on. Our findings serve as a critical indicator of TSFMs’ strengths and limitations in out-of-domain generalization. Their ability to extract zero-shot representations proves remarkably effective, highlighting their potential for applications requiring automated feature learning and transferability across diverse time series tasks. However, their reliance on univariate forecasting and the inability to leverage covariates effectively underscore fundamental architectural limitations. The inability of current strategies to integrate external factors signals the need for new model designs that can better capture contextual dependencies. By demonstrating these gaps, this work informs future developments in TSFMs, guiding research toward more adaptable, scalable, and context-aware models for both energy management and broader time-series applications. \localtableofcontents 1 Introduction Building energy management often requires accurate results from a variety of computational tasks performed on time-series data such as forecasting, classification, data imputation, and others. Traditionally, these tasks are addressed using a variety of approaches, including statistical models ( Zhao & Magoulès 2012 ) , machine learning ( Seyedzadeh et al. 2018 ) and physics-based techniques ( Chen et al. 2022 ; Sun et al. 2020 ) . However, heterogeneity—in terms of structure, operation, and environmental conditions—between buildings necessitates the development of task-, modality 1 1 1 In this work, ”modality” refers to distinct types of time-series data, whether representing the same phenomenon measured at different time scales or from different vantage points (e.g., indoor vs. outdoor temperature) or entirely different phenomena (e.g., electricity consumption vs. temperature). -, and building-specific models ( Blum et al. 2019 ) . This fragmented approach introduces challenges in generalizability, limiting the broader applicability of the resulting solutions. Time-Series Foundation Models (TSFMs) have recently emerged as a promising approach for achieving generalizability across datasets and tasks, drawing inspiration from the transformative success of Large Language Models (LLMs). Most TSFMs adopt the well-known transformer architecture, incorporating modifications to better accommodate the characteristics of time-series data. These models are typically pretrained on a diverse corpus of time-series datasets, enabling them to perform tasks such as forecasting and anomaly detection in a zero-shot manner. Pioneering examples, such as MOMENT ( Goswami et al. 2024 ) and TimesFM ( Das et al. 2024 ) , aim to demonstrate generalization across multiple datasets and modalities. Unlike the conventional definitions of foundation models ( Bommasani et al. 2021 ) , the vast majority of the TFSMs proposed so far are not designed to generalize to previously unseen tasks. They are, instead, designed to generalize to new data sources of previously seen modalities, and, in some cases, to new modalities that can be represented as time series—while remaining constrained to a fixed set of tasks ( Baris et al. 2025 ) . Though TSFMs may not yet offer the level of generalizability expected from true foundation models, we have yet to empirically and systematically evaluate their ability to perform beyond the limits of what they were designed for and trained on. In this work, we aim to provide a multifaceted zero-shot evaluation of pretrained TSFMs for various building energy management tasks. Firstly, we analyze the generalizability across datasets and modalities for zero-shot univariate forecasting in two key contexts for predictive building management: electricity usage and indoor air temperature. This initial assessment by the authors served as inpsiration for the present manuscript, after results were presented at a conference ( Mulayim et al. 2024 ) . The choice of univariate forecasting for the initial analysis was due to the fact that most TSFMs are only designed to perform univariate forecasting. As a first extension to that early work, in this paper we examine the covariate utilization of TSFMs, given the dependence of building energy management tasks on external factors. Specifically, we investigate modeling of building thermal behaviors by comparing the forecasting performance of TSFMs with covariates against univariate predictors and conventional thermal modeling approaches. These comparisons are conducted across various prediction horizons to assess their efficacy under different forecasting requirements. Thirdly, we investigate their performance on extracting meaningful representations in a zero-shot setting for classification tasks. Our analysis centers on two distinct classification challenges: appliance classification and metadata mapping. Lastly, we conduct a robustness analysis to understand the details of how TSFMs make decisions. We specifically analyze model’s: (1) stability under different performance metrics, and (2) adaptability to various operational conditions. For this analysis, we again focus on univariate forecasting, as it remains the primary task supported by existing TSFMs. Our evaluation of TSFMs reveals the following five key findings: First, in terms of generalizability , TSFMs exhibit strong performance on datasets they were exposed to during pretraining but struggle with unseen data, particularly when compared to statistical models. While some TSFMs can generalize to new electricity datasets with marginal improvement over statistical methods, their performance on unfamiliar modalities, such as indoor air temperature, is inconsistent—surpassing statistical models for longer forecasting horizons but underperforming for shorter ones. Second, covariate utilization does not enhance TSFM performance, likely due to their training being predominantly univariate; in contrast, traditional methods, optimized for autoregressive forecasting, maintain an advantage regardless of covariate inclusion. Third, regarding representations , Chronos and MOMENT demonstrate the ability to generate meaningful embeddings

Read the complete text