Benchmarking Pre-Trained Time Series Models for Electricity Price Forecasting

Timothée Hornek 1 , Amir Sartipi 1 , Igor Tchappi 1 , and Gilbert Fridgen 1 · 2025

Read Benchmarking Pre-Trained Time Series Models for Electricity Price Forecasting by Timothée Hornek 1 , Amir Sartipi 1 , Igor Tchappi 1 , and Gilbert Fridgen 1 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-08113.txt.

Introduction

Timothee Hornek, Amir Sartipi, Igor Tchappi, and Gilbert Fridgen benchmark pre-trained time series models for electricity price forecasting, in a 2025 paper. Good price forecasts guide trading on power markets. New foundation models promise strong results, but their value for this task was untested.

The team compared six pre-trained models with classic statistical and learning methods. They used day-ahead prices from five European countries for one year and forecast one day ahead. Two pre-trained models matched the classic methods, but none beat the best seasonal model. That model, which captures daily and weekly cycles, was the most consistent overall.

Catalog record

CREATORTimothée Hornek 1 , Amir Sartipi 1 , Igor Tchappi 1 , and Gilbert Fridgen 1
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE28 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-08113

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Benchmarking Pre-Trained Time Series Models for Electricity Price Forecasting Thanks: This research was funded in part by the Luxembourg National Research Fund (FNR) and PayPal, PEARL grant reference 13342933/Gilbert Fridgen. For the purpose of open access, and in fulfillment of the obligations arising from the grant agreement, the author has applied a Creative Commons Attribution 4.0 International (CC BY 4.0) license to any Author Accepted Manuscript version arising from this submission. The research was carried out as part of a partnership with the energy retailer Enovos Luxembourg S.A. © 2025 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. Timothée Hornek 1 , Amir Sartipi 1 , Igor Tchappi 1 , and Gilbert Fridgen 1 Abstract Accurate electricity price forecasting (EPF) is crucial for effective decision-making in power trading on the spot market. While recent advances in generative artificial intelligence (GenAI) and pre-trained large language models (LLMs) have inspired the development of numerous time series foundation models (TSFMs) for time series forecasting, their effectiveness in EPF remains uncertain. To address this gap, we benchmark several state-of-the-art pretrained models—Chronos-Bolt, Chronos-T5, TimesFM, Moirai, Time-MoE, and TimeGPT—against established statistical and machine learning (ML) methods for EPF . Using 2024 day-ahead auction (DAA) electricity prices from Germany, France, the Netherlands, Austria, and Belgium, we generate daily forecasts with a one-day horizon. Chronos-Bolt and Time-MoE emerge as the strongest among the TSFMs , performing on par with traditional models. However, the biseasonal MSTL model, which captures daily and weekly seasonality, stands out for its consistent performance across countries and evaluation metrics, with no TSFM statistically outperforming it. I Introduction Recent advances in generative artificial intelligence (GenAI) , particularly the widespread adoption of pre-trained large language models (LLMs) , have catalyzed the development of analogous models tailored specifically for time series data, commonly known as time series foundation models (TSFMs) . Developers describe these models as “universal forecasters”, capable of providing robust predictions in various domains [ 1 ] . Their training on extensive datasets enables their application in various contexts without the need for additional training, relying solely on their inference capabilities. A specific field of application is electricity price forecasting (EPF) , a well-established time series forecasting task focused on wholesale electricity prices [ 2 ] . In Europe, for example, the primary electricity auction, namely the day-ahead auction (DAA) , takes place daily at noon, determining a single clearing price for each hour of the following day [ 3 ] . Researchers are currently discussing several TSFMs in the literature. For example, Chronos models are built on preexisting LLM architectures, using the T5 model architecture, and trained on a combination of existing and synthetic time series data [ 4 ] . Similarly, TimesFM is trained on a large corpus of time series data, employing a decoder-only architecture [ 5 ] . Time-MoE uses a sparse mixture-of-experts (MoE) architecture, which activates only a subset of its parameters during inference, preserving computational efficiency despite the high total number of parameters. The model is trained on an extensive dataset that contains 300 billion time points [ 6 ] . Morai was trained on the LOTSA dataset, containing more than 27 billion observations, to train its masked encoder architecture [ 1 ] . The weights of the models mentioned so far are publicly available. In contrast, TimeGPT is a closed source pre-trained model designed to emphasize simplicity and ease of use by enabling predictions through application programming interface (API) calls [ 7 ] . All these models provide zero-shot forecasting (i.e., forecasting without fine-tuning or additional training) capabilities, enabling them to use their inference abilities to generate forecasts without requiring any additional prior training. Forecasting with TSFMs remains an active area of research across various fields, including finance and the energy domain. For instance, the authors in [ 8 ] fine-tuned TimesFM [ 5 ] for financial time series forecasting, outperforming several statistical and deep learning (DL) benchmark models. In the energy domain, the authors in [ 9 ] trained transformer-based models from scratch and compared their performance with TSFMs for household load forecasting. They found that TimesFM [ 5 ] outperformed the models trained from scratch, particularly when increasing the input size. In another study focusing on household power consumption data [ 10 ] , the authors benchmarked statistical and machine learning (ML) models against TSFMs for data imputation tasks. Their findings suggest that TSFMs can improve imputation performance. Focusing on EPF , the authors in [ 11 ] investigated the integration of market sentiment and bidding behavior into price forecasting models. By fine-tuning LLMs and using conditional generative adversarial networks (CTSGAN), they achieved improved performance in forecasting price spikes. Similarly, focusing on EPF , the authors in [ 12 ] categorized time series forecasting approaches into four groups (econometric, deep learning, transformer-based, and LLMs ) and conducted a benchmarking study. Their benchmark emphasized DL models using transformer-based architectures, testing the models on electricity price data from several European countries. The results indicated that transformer-based models achieved superior performance in forecasting electricity prices, with the TSFM TimesFM [ 5 ] only slightly less performant. Despite promising initial applications of TSFMs for EPF , their performance in the EPF domain remains understudied. This unclarity also arises from the wide variety of TSFMs discussed in the literature, leading to questions about their comparative performance. Furthermore, it remains unclear how TSFMs perform relative to traditional statistical and ML models in the context of EPF . How effective are these so-called universal forecasters [ 1 ] in the domain of EPF ? This paper seeks to answer this question. We propose a comprehensive benchmark of the state of the art TSFMs , including variations in model sizes, as some models come in versions with different numbers of parameters. Additionally, we include statistical and ML models in the benchmark to allow a comparison not only between TSFMs but also with more traditional forecasting modeling approaches. Our evaluation uses commonly used metrics, such as root mean square error (RMSE) , mean absolute Error (MAE) , and symmetric mean absolute percentage error (SMAPE) , ensuring a robust assessment of forecast performance. Furthermore, we evaluate whether the forecast errors differ statistically using the widely applied Diebold-Mariano (DM) test [ 13 ] . To provide timely and geographically diverse results, our test interval covers the year 2024, and contains DAA prices from the largest European power markets by traded volume: Germany, France, the Netherlands, Austria, and Belgium. We structure the remainder of this paper as follows. Section II outlines our research approach, detailing the models we test and the evaluation metrics we use. Section III describes the time series data, focusing on electricity prices, and specifies the parameterizations of the model. Section IV presents and discusses our results, including our benchmark. Finally, Section V concludes the paper. II Research Approach This section outlines our experiment setup for benchmarking. We test four categories of models: baseline, statistical, and

Read the complete text