Building Power Grid Models from Open Data: A Complete Pipeline from OpenStreetMap to Optimal Power Flow
Andrea Britto, Thiago Spina, Weiwei Yang, Spencer Fowers, Baosen Zhang, Chris White, [4pt] Microsoft Research · 2026
Read Building Power Grid Models from Open Data: A Complete Pipeline from OpenStreetMap to Optimal Power Flow by Andrea Britto, Thiago Spina, Weiwei Yang, Spencer Fowers, Baosen Zhang, Chris White, [4pt] Microsoft Research (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-04289.txt.
Introduction
Andrea Britto and five co-authors build realistic models of United States power transmission grids entirely from public data. Detailed grid data are restricted for security reasons, which limits research, so an open route to full models has clear value.
Their five-stage pipeline pulls infrastructure from OpenStreetMap, rebuilds the network layout, estimates electrical values from official plant data, and spreads hourly demand across buses using census population. It then solves power flow for models of all forty-eight mainland states plus six multi-state regions. Most state models converge under the strictest settings, and costs and losses look close to real market outcomes.
Catalog record
| CREATOR | Andrea Britto, Thiago Spina, Weiwei Yang, Spencer Fowers, Baosen Zhang, Chris White, [4pt] Microsoft Research |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 91 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.04289
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Building Power Grid Models from Open Data: A Complete Pipeline from OpenStreetMap to Optimal Power Flow Andrea Britto, Thiago Spina, Weiwei Yang, Spencer Fowers, Baosen Zhang, Chris White, [4pt] Microsoft Research Abstract Access to realistic transmission grid models is essential for power systems research, yet detailed network data in the United States remains restricted under critical-infrastructure regulations. We present a pipeline that constructs complete, OPF-solvable transmission network models entirely from publicly available data. The five-stage pipeline (1) extracts power infrastructure from OpenStreetMap via a local Overpass API instance, (2) reconstructs bus-branch topology through voltage inference, line merging, and transformer detection, (3) estimates electrical parameters using voltage-class lookup tables calibrated with U.S. Energy Information Administration (EIA) plant-level data, (4) allocates hourly demand from EIA-930 to individual buses using US Census population as a spatial proxy, and (5) solves both DC and AC optimal power flow using PowerModels.jl with a progressive relaxation strategy that automatically loosens constraints on imprecise models. We validate the pipeline on all 48 contiguous US states and six multi-state regions, including the full Western (5,076 buses) and Eastern (21,697 buses) Interconnections. Of the 48 single-state models, 42 (88%) converge at the strictest relaxation level for AC-OPF at peak hour and 44 (92%) off-peak. Dispatch costs (median $22/MWh) and system losses (median 1.0%) are consistent with real wholesale-market outcomes. The pipeline relies exclusively on open data sources, enabling reproducible grid analysis without proprietary data. All 54 models (48 single-state and 6 multi-state) are publicly released at https://github.com/microsoft/GridSFM . 1 Introduction The electrical grid is under greater stress today than at any point in its history. Three converging forces are simultaneously reshaping demand patterns, generation portfolios, and system failure modes: • AI-driven demand growth. Large-scale data centers are now among the fastest-growing sources of electricity demand in advanced economies. The International Energy Agency projects that global data-center electricity consumption will more than double between 2024 and 2030, driven primarily by the computational requirements of training and serving large language models and other AI workloads [ 11 ] . A single hyperscale campus can consume as much electricity as a mid-sized city, and clusters of such facilities are increasingly concentrated in regions whose transmission infrastructure was not designed for dense, around-the-clock industrial loads. • Renewable integration. Solar and wind now account for a large and growing share of new US electricity generation, fundamentally altering how power systems operate [ 29 ] . Unlike conventional plants, renewable resources are geographically constrained and inherently variable, requiring detailed understanding of how they interact with dispatchable (operator-controlled) generation during periods of stress. • Extreme weather events. Winter Storm Uri (February 2021) triggered cascading failures across the Texas grid, leaving 4.5 million customers without power and causing an estimated $195 billion in damages [ 12 ] . Hurricane Maria (September 2017) caused prolonged, island-wide power outages in Puerto Rico. Weather-related grid disruptions in the United States have approximately doubled over the past two decades [ 5 ] – creating an urgent need for tools that can model cascading failures and support resilient system planning. Addressing these challenges requires quantitative models of the transmission grid – network representations of substations and transmission lines with realistic electrical parameters, generator characteristics, and demand distributions. Such models are essential to: 1. Predict congestion and plan transmission expansion. Identifying network bottlenecks where power flows approach thermal limits, and evaluating where new lines or upgrades would most effectively relieve constraints. 2. Optimize generator dispatch. Solving the Optimal Power Flow (OPF) problem – determining the least-cost combination of generators that meets demand while respecting all network constraints (thermal limits, voltage bounds, power balance). OPF and the other power-systems concepts used in this paper are formally defined in section 2 . 3. Simulate cascading failures. Modeling how the loss of a single line or generator propagates through the network, tripping protections and shedding load – the mechanism behind large-scale blackouts. 4. Assess resilience under stress scenarios. Evaluating grid performance under extreme conditions: simultaneous high demand, low renewable output, and equipment outages. 5. Enable data-driven methods. Training and validating machine-learning models for congestion forecasting, anomaly detection, and operational decision support, all of which require large volumes of realistic grid states. In short, grid data is foundational infrastructure for the energy transition. Without it, researchers cannot study the systems they aim to improve. Yet as the next section describes, this data is largely inaccessible. 1.1 The Grid Data Problem The electrical transmission grid is among the most complex engineered systems in the world, but detailed models of its topology and operating parameters are largely inaccessible to the research community. In the United States, the Federal Energy Regulatory Commission (FERC) classifies detailed grid topology, line impedance data (the electrical characteristics of transmission lines, defined in section 2.1 ), and operating parameters as Critical Energy Infrastructure Information (CEII) [ 7 ] . The North American Electric Reliability Corporation (NERC) further restricts access through its Critical Infrastructure Protection standards, which mandate physical and cyber security protections for bulk electric system data [ 19 ] . In practice, this means that the network models used for transmission planning, reliability assessment, and market simulation are treated as sensitive critical-infrastructure information. For researchers, the consequences are significant. Obtaining access to real grid models requires a formal application to FERC, a process that can take months and imposes strict redistribution restrictions – a researcher who receives CEII data cannot share it with collaborators at other institutions, let alone publish it. Commercial alternatives exist, but annual license fees range from $50,000 to $500,000, and the terms typically prohibit sharing derived models or results in a form that could reconstruct the original data. The academic community has long relied on standardized test cases to fill this gap. The IEEE 14-bus, 30-bus, 118-bus, and 300-bus systems [ 8 ] – where “bus” denotes a network node, typically a substation (see section 2.1 ) – have been workhorses for power systems research for decades. More recently, the IEEE PES Power Grid Library (PGLib-OPF) [ 2 ] has curated a collection of validated OPF benchmark cases ranging from 3-bus pedagogical examples to 10,000+ bus networks. However, even PGLib’s largest cases are designed to test solver algorithms, not to represent specific real-world grids. They predate large-scale renewable integration, lack High-Voltage Direct Current (HVDC) links (long-distance DC corridors that connect separate AC grids, defined in section 2.1 ), and do not capture the geographic and operational diversity of a continental-scale power system. Birchfield et al. [ 4 ] showed that standard test cases fail to reproduce key structural characteristics of real networks, including degree distributions, electrical diameter, and generation-load spatial patterns. More recently, the Texas A&M (TAMU) synthetic grid project [ 33 ] produced geographically realistic 2,000-bus and 10,000-bus test cases by statistically generating topologies that match real network properties. While valuable, these synthetic grids are constructed to resemble the real grid without being derived from it – their geographic correspondence to actual infrastructure is approximate, and they cannot be updated as the real grid evolves. This situation – where grid data is simultaneously indispensable for research and inaccessible to most researchers – motivates the present work. 1.2 Contribution and Paper Organization This paper presents a complete pipeline that transforms