Bridging the climate to energy data gap: simulated annealing for representative climate year selection
Bram van Duinen 1,* , Karin van der Wiel 1,2 , Jean Thorey 3 , Laurens Stoop 4 1 Royal Netherlands Meteorological Institute (KNMI), De Bilt, the Netherlands 2 Faculty of Geosciences, Utrecht University, Utrecht, the Netherlands 3 Réseau de Transport d’Électricité, Paris, France 4 TenneT, Arnhem, the Netherlands * Corresponding Author: [email protected] This manuscript has been submitted to Applied Energy for consideration · 2026
Read Bridging the climate to energy data gap: simulated annealing for representative climate year selection by Bram van Duinen 1,* , Karin van der Wiel 1,2 , Jean Thorey 3 , Laurens Stoop 4 1 Royal Netherlands Meteorological Institute (KNMI), De Bilt, the Netherlands 2 Faculty of Geosciences, Utrecht University, Utrecht, the Netherlands 3 Réseau de Transport d’Électricité, Paris, France 4 TenneT, Arnhem, the Netherlands * Corresponding Author: [email protected] This manuscript has been submitted to Applied Energy for consideration (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-15958.txt.
Introduction
Bram van Duinen and three colleagues propose simulated annealing for selecting representative climate years. Energy models need representative input, but climate science uses hundreds of years while power models process a handful, and current picks lack validation. Representativeness is scored with the seasonal sliced Wasserstein distance, capturing marginals, correlations and seasonal structure. Against random search and K-Medoids clustering on three European cases with 180 climate years, annealing gives the best picks, with effective sample size four to five times larger, roughly 2.5 to 3.5 times more representative than ENTSO-E practice.
Catalog record
| CREATOR | Bram van Duinen 1,* , Karin van der Wiel 1,2 , Jean Thorey 3 , Laurens Stoop 4 1 Royal Netherlands Meteorological Institute (KNMI), De Bilt, the Netherlands 2 Faculty of Geosciences, Utrecht University, Utrecht, the Netherlands 3 Réseau de Transport d’Électricité, Paris, France 4 TenneT, Arnhem, the Netherlands * Corresponding Author: [email protected] This manuscript has been submitted to Applied Energy for consideration |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 67288 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.15958
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Bridging the climate to energy data gap: simulated annealing for representative climate year selection Bram van Duinen 1,* , Karin van der Wiel 1,2 , Jean Thorey 3 , Laurens Stoop 4 1 Royal Netherlands Meteorological Institute (KNMI), De Bilt, the Netherlands 2 Faculty of Geosciences, Utrecht University, Utrecht, the Netherlands 3 Réseau de Transport d’Électricité, Paris, France 4 TenneT, Arnhem, the Netherlands * Corresponding Author: [email protected] This manuscript has been submitted to Applied Energy for consideration Abstract Energy system models are increasingly dependent on representative climate input. Yet, a fundamental mismatch persists between the hundreds of simulated years often used in climate science and the handful of years that computationally demanding power system models can process. Current practice, including ENTSO-E’s European Resource Adequacy Assessment, relies on climate year selections that have not been validated against explicit representativeness criteria. This risks biased investment decisions and blind spots for plausible weather conditions. This study proposes simulated annealing as an optimisation method for selecting representative subsets of complete climate years from large climate ensembles. Representativeness is quantified using the seasonal sliced Wasserstein distance, a metric from optimal transport theory that captures representativeness on marginal distributions, inter-variable correlations, and seasonal structure simultaneously. We evaluate simulated annealing against the alternative methods random search, filtered random search, and K-Medoids clustering across three test cases spanning the Netherlands and Europe, using 180 climate years from the Pan-European Climate Database as a reference. Simulated annealing consistently produces the most representative subsets and outperforms all compared methods. Simulated annealing achieves an effective sample size four to five times the actual subset size. The resulting subsets are roughly 2.5–3.5 times more representative than current ENTSO-E practice. The method is application-agnostic and its output can serve as a validated climate data input to any subsequent (energy) impact study. Highlights • Simulated annealing selects representative climate years for energy system models • Seasonal sliced Wasserstein distance adequately captures representativeness • Simulated annealing outperforms currently used climate year selection methods • Effective sample size reaches four to five times the optimised subset size • Optimised subsets are 2.5-3.5 times more representative than current practice Keywords : Climate year selection, Simulated annealing, Sliced Wasserstein distance, Energy system modelling, Representative periods, Representative years, Large ensemble modelling 1 Introduction Climate variability is one of the central challenges in energy system planning, but in current practice is often at risk of being averaged away. As electricity systems become increasingly dominated by weather-dependent renewable sources [ 24 ] , it becomes crucially important to have accurate climate data input [ 41 ] . For transmission system operators conducting large-scale power system optimisation studies, the choice of climate years used as model input therefore carries substantial weight. Yet this methodological decision has received limited systematic attention. A climate year, or set of climate years, is a representative year/set that shares relevant aspects with the full climate of the study period. This can for example be a single year constructed from long-term observations to reflect average conditions, or a small ensemble of years selected to also capture extremes such as unusually cold winters, low-wind periods, or high solar irradiance. Generally, climate years serve as forcing input into energy system models, and hence their selection determines how well the modelled energy system captures the effects of climate variability. The usage of properly chosen, representative climate years is essential for accurate investment planning and resource adequacy assessments. Unrepresentative and thus biased climate years used as input to energy system studies can easily cost billions of societal funds due to misinformed investments [ 17 , 18 , 36 ] . Moreover, biased climate year selections may systematically exclude weather conditions that climate science deems plausible, leaving the energy system unprepared for events that are not genuine surprises but artefacts of poor methodology [ 37 , 41 , 26 , 36 , 34 , 6 ] . Yet current practice across energy planning studies, including ENTSO-E’s European Resource Adequacy Assessment and Ten-Year Network Development Plan [ 13 , 12 ] , relies on selection methods that were adopted without rigorous validation against representativeness criteria. To adequately capture climate variability [ 44 ] , climate scientists have developed large-ensemble modelling approaches. Here, hundreds to thousands of years are simulated to represent the full distribution of possible outcomes in a given climate [ 51 , 50 , 2 , 30 ] . The chaotic nature of the climate system means that subsequent years can turn out completely different, despite having near-identical climatic background state. This makes large sample sizes essential for robust statistical characterisation of both typical conditions and extremes. However, a fundamental mismatch exists between climate science and energy system modelling [ 3 , 9 , 18 , 41 , 53 ] . While state-of-the-art climate datasets may span hundreds to thousands of simulated years, detailed industry-standard power system optimisation models are computationally demanding and cannot handle such large input datasets. These models must optimise processes such as unit commitment, network constraints, and market dynamics at hourly or sub-hourly resolution. This typically limits studies to between one and thirty climate years. This constraint creates an unavoidable need for subsampling [ 37 ] : selecting a small number of climate years to represent the full distribution of meteorological conditions from the full reference dataset as well as possible [ 33 ] . Several approaches to this climate year selection problem have emerged. One common strategy constructs synthetic "typical meteorological years" by making a composite of months or other intra-annual periods from different historical years [ 11 , 25 ] . Each representative period is selected to represent typical conditions for that period. While computationally convenient, such composite years introduce artificial discontinuities that disrupt the temporal coherence essential for modelling storage and hydropower reservoir dynamics [ 21 ] . Moreover, there is considerable inter-annual variability in the meteorological parameters affecting the energy system [ 37 , 50 , 17 , 18 , 34 ] . Typical meteorological years, or even shorter (aggregated) ’representative periods’ [ 31 , 46 , 21 , 23 ] are therefore of limited use to accurately capture climate variability in resource adequacy or grid expansion studies for systems containing high shares of renewables. An alternative approach, which has received comparatively little attention in the literature [ 37 ] , is to select a (small) number of complete climate years from a larger climate modelling experiment [ 33 , 41 , 36 ] . The magnitude of climatic inter-annual variability is generally underestimated. It is so large that one cannot assume that using multiple complete years guarantees representativeness. Hence the usage of large ensembles with hundreds to thousands of years of data in climate science. A poorly chosen subset may over- or under-represent certain climatic conditions. For instance, selecting years that are consistently wind-rich while missing prolonged low-wind episodes could bias the energy system outcomes in the same way a single arbitrarily chosen year would. The selection of climate years must therefore be guided by an explicit objective: the chosen subset should approximate as well as possible the full ensemble’s multivariate, multi-seasonal distribution across all energy-relevant meteorological variables. Compared to composite approaches that connect months or shorter periods from different sources, using complete