Self-Supervised Temporal Super Resolution of Energy Data using Generative Adversarial Transformers
Xuanhao Mu, Gökhan Demirel, Yuzhe Zhang, Jianlei Liu, Thorsten Schlachter, Veit Hagenmeyer · 2025
Read Self-Supervised Temporal Super Resolution of Energy Data using Generative Adversarial Transformers by Xuanhao Mu, Gökhan Demirel, Yuzhe Zhang, Jianlei Liu, Thorsten Schlachter, Veit Hagenmeyer (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-10587.txt.
Introduction
Xuanhao Mu, Gökhan Demirel, Yuzhe Zhang, Jianlei Liu, Thorsten Schlachter, and Veit Hagenmeyer sharpen coarse energy time series without ever seeing fine ones. Their 2025 paper tackles upsampling: grid models need data at fine time steps, but meters often record coarsely. Simple interpolation loses information or adds noise, while trained generators need the very high-resolution data that real deployments lack.
Their fix is a generative adversarial transformer trained in a self-supervised way, sidestepping the missing-data paradox. The adversarial setup pressures the upsampled series to carry the statistical character of real energy data rather than a smoothed guess. The authors position the method for energy system models used in network design and operation, where time granularity decides what flexibility options are even visible.
Catalog record
| CREATOR | Xuanhao Mu, Gökhan Demirel, Yuzhe Zhang, Jianlei Liu, Thorsten Schlachter, Veit Hagenmeyer |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 69 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-10587
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Self-Supervised Temporal Super Resolution of Energy Data using Generative Adversarial Transformers Xuanhao Mu, Gökhan Demirel, Yuzhe Zhang, Jianlei Liu, Thorsten Schlachter, Veit Hagenmeyer Abstract To bridge the temporal granularity gap in energy network design and operation based on Energy System Models, resampling of time series is required. While conventional upsampling methods are computationally efficient, they often result in significant information loss or increased noise. Advanced models such as time series generation models, Super-Resolution models and imputation models show potential, but also face fundamental challenges. The goal of time series generative models is to learn the distribution of the original data to generate high-resolution series with similar statistical characteristics. This is not entirely consistent with the definition of upsampling. Time series Super-Resolution models or imputation models can degrade the accuracy of upsampling because the input low-resolution time series are sparse and may have insufficient context. Moreover, such models usually rely on supervised learning paradigms. This presents a fundamental application paradox: their training requires the high-resolution time series that is intrinsically absent in upsampling application scenarios. To address the mentioned upsampling issue, this paper introduces a new method utilizing Generative Adversarial Transformers (GATs), which can be trained without access to any ground-truth high-resolution data. Compared with conventional interpolation methods, the introduced method can reduce the root mean square error (RMSE) of upsampling tasks by 9%, and the accuracy of a model predictive control (MPC) application scenario is improved by 13%. K eywords Transformer, Generative Adversarial Network, Granularity Gap, Super Resolution, Smart Energy 1 Introduction In recent years, the question of how energy systems can be decarbonized has received increasing attention due to global climate change and rising carbon dioxide emissions [ 1 ] . Energy System Models (ESMs) analyze energy system decarbonization pathways through mathematical modeling and simulation. Due to the complexity of these systems, multiple models often need to be coupled for joint analysis [ 2 ] . However, these independent models must compress the representation of temporal, spatial, or technological information for computational complexity reasons, leading to a loss of precision known as the granularity gap [ 3 ] . One direct consequence of this gap is that different models participating in joint simulations often run at their own inherent time resolutions. For instance, combining an electrical grid model (with a 15-minute resolution) with a gas network model (with an hourly resolution) creates temporal mismatches. Poncelet et al. 2016 [ 4 ] noted that choosing time series with different temporal resolutions can affect the simulation results. Therefore, accurately interpolating time-series data is essential for robust model coupling. Researchers typically use conventional methods such as linear interpolation. These methods are simple and computationally efficient, but often fail to capture the complex nonlinear features inherent in data and tend to introduce noise. Advanced machine learning models such as time series generation models, Super-Resolution (SR) models and imputation models present viable alternatives but encounter inherent difficulties. Time series generation models aim to learn data distributions to create new sequences. SR aims to establish an accurate mapping from low-resolution to high-resolution sequences, while imputation is a more general approach for filling in missing data. These models primarily operate under a supervised training paradigm. This presents a fundamental application paradox: their training requires real, high-resolution time series, which are inherently lacking in the target application scenarios requiring interpolation. Furthermore, when the input time series lacks sufficient data points, these models will suffer significant performance decline because of inadequate contextual information [ 5 ] . To address this critical research gap, the present paper proposes a novel self-supervised time series SR method that combines Transformer (TF) and Generative Adversarial Network (GAN) . First, the TF is introduced to address the insufficient contextual information issue. TF ’s attention mechanism and encoder-decoder architecture enable it to capture the global dynamics of the sequence. Second, the adversarial training framework of GAN ensures high fidelity in the dynamic properties and statistical distribution of the generated sequences. Third, through the computation of a feature space loss, the model generates high-resolution sequences that are consistent with the low-resolution input in terms of feature structure, without requiring actual high-resolution data. This self-supervised learning paradigm resolves the previously mentioned application paradox. The main contributions of the present paper include: • Novel Method : We propose a novel self-supervised time series interpolation training framework that operates without the need for real high-resolution data, thereby overcoming a major barrier for existing deep learning models. • Real Application : We demonstrate the structure preserving properties of our method in model predictive control (MPC) applications, highlighting its potential for real-world energy systems. The subsequent sections of this paper are organized as follows. Section 2 outlines our methods. Section 3 describes the experimental setup and data analysis. Section 4 provides with a discussion. Section 5 presents a review of related work, and Section 6 concludes a conclusion and an outlook. 2 Methodology To address the limitations identified of Section 5 , this paper presents an adaptive TF - GAN hybrid architecture for time series SR . The training process is mainly divided into three phases: 1. Phase 1 is mainly used for pre-training the generator. 2. Phase 2 is mainly used for pre-training the feature space discriminator. 3. Phase 3 is mainly used for joint-training of the generator and discriminator. The main design attributes will be introduced in the following sections individually. 2.1 Generator A critical step in building a generative model for time series SR is selecting a suitable core generator architecture. Real-world data often exhibits significant variability. It may show different sample resolutions, contain missing values, and display periodic or seasonal trends. An effective model requires adaptability to deal with these features. Therefore, in the present paper, TF is used as the base model for the generator with its powerful sequence modeling capabilities and flexible architecture design. For details on the reasons for choosing TF as the base model, see Appendix A . Figure 1: Modified attention mechanism used in the convolutional multi-head attention module. Transformers utilize a self-attention mechanism that enables a model to process sequence elements in parallel and learn global dependencies [ 6 ] . The mechanism generates three vectors based on the input sequence: query ( Q ), key ( K ), and value ( V ) matrices, where queries and keys determine attention weights while values carry the actual information to be aggregated. Q and K must have the same dimension, but v can have a different dimension, allowing it to map the input information into an output of a different dimension (or "length"), which is exactly what is needed for time series SR tasks (generating a high-resolution sequence from a low-resolution one). In the present paper, the task is to change the temporal resolution. Data points must be added, removed, or converted from the original dataset. Therefore, the short-term trend of the data points is of interest. Increasing the trend attention helps the data points recognize short-term patterns and better insert new points or delete old points. To address this need, a convolutional multi-head attention module [ 7 ] is employed, as illustrated at the top of Fig. 1 . This module explicitly models trend changes in the data by capturing