Newton’s Lantern: A Reinforcement Learning Framework for Finetuning AC Power Flow Warm Start Models
Shourya Bose, Helgi Hilmarsson, Dhruv Suri · 2026
Read Newton’s Lantern: A Reinforcement Learning Framework for Finetuning AC Power Flow Warm Start Models by Shourya Bose, Helgi Hilmarsson, Dhruv Suri (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-11102.txt.
Introduction
Shourya Bose, Helgi Hilmarsson, and Dhruv Suri present Newton's Lantern, a reinforcement-learning pipeline for fine-tuning AC power-flow warm-start models. Neural warm starts slash Newton-Raphson iterations for grid power-flow solutions, but supervised versions generalize poorly on heavily loaded cases near voltage collapse.
The team proves a lower bound on iteration count that depends on warm-start error direction rather than magnitude. The bound goes vacuous as the power-flow Jacobian's smallest singular value shrinks, pinpointing the supervised failure mode near saddle-node bifurcation. Newton's Lantern pairs group relative policy optimization with a reward model learned from perturbations of base predictions, using iteration count itself as supervision. Across IEEE 118-bus and larger grid benchmarks, it alone converges on every test snapshot with the smallest mean iteration count. Grid operators get warm starts that hold up under stress.
Catalog record
| CREATOR | Shourya Bose, Helgi Hilmarsson, Dhruv Suri |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 79256 |
| LICENSE | http://creativecommons.org/licenses/by-sa/4.0/ |
| RIGHTS | CC BY SA |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.11102
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Newton’s Lantern: A Reinforcement Learning Framework for Finetuning AC Power Flow Warm Start Models Shourya Bose, Helgi Hilmarsson, Dhruv Suri Abstract Neural warm starts can sharply reduce the number of Newton-Raphson iterations required to solve the AC power flow problem, but existing supervised approaches generalize poorly on heavily loaded instances near voltage collapse. We prove a lower bound on the Newton-Raphson iteration count that depends on the direction of the warm start error rather than on its magnitude, and show as a corollary that the bound becomes vacuous as the smallest singular value of the power-flow Jacobian shrinks, identifying the failure mode of supervised regression near the saddle-node bifurcation. Motivated by this analysis, we introduce Newton’s Lantern , a finetuning pipeline that combines group relative policy optimization with a learned reward model trained on perturbations of the base model’s predictions, using the iteration count itself as the supervisory signal. Across IEEE 118-bus, GOC 500-bus, and GOC 2000-bus benchmarks, Newton’s Lantern is the only method that converges on every test snapshot while attaining the smallest mean iteration count. 1 Introduction The electric grid is instrumental in providing a reliable supply of electricity to billions of people worldwide. A critical component of grid operations is the AC power flow (ACPF) problem ( Stott 1974 ) , which determines the steady-state operating point of the system. At its core, ACPF is a root-finding problem for a set of nonlinear equations g_{D}(x) describing the grid, wherein x represents the system state and D a single snapshot of the grid characteristics. Here, x comprises the bus voltage magnitudes and angles to be determined, while D encapsulates the grid’s physical and operational parameters. It is conventionally solved using the Newton-Raphson (NR) algorithm ( Tinney and Hart 1967 ) . An important objective for utility companies and independent system operators is to determine a good starting point x_{0} for the NR algorithm such that it converges in the fewest iterations. The conventionally accepted solution is the flat start ( Tinney and Hart 1967 ) , which sets all voltage magnitudes to unity and angles to zero, or the DC start , which uses linear DC power flow to generate angles while retaining the unity voltage magnitudes. However, as the size of the grid (and therefore the resulting ACPF problem) grows, both methods can fail to achieve convergence. One category of solutions modifies the NR algorithm itself to improve its convergence characteristics ( Iwamoto and Tamura 1981 ) , but these methods fail when the region of convergence is far from the flat start point. The second category of solutions, which encompasses the present work, exploits the structure of g_{D}(\,\cdot\,) or a dataset of solutions corresponding to different instances of D to generate a good x_{0} . In the latter category, the analytical method of choice has conventionally been continuation power flow, which obtains the solution of a ‘difficult’ instance D^{\prime} by tracing a path homotopy from the solution of a related ‘easy’ instance D ( Ajjarapu and Christy 1992 ; Mehta et al. 2016 ) . Recently however, there has been increased interest in using learning-based methods to approximate the mapping D\mapsto x_{0} from datasets of pre-solved ACPF instances. While there exists a plethora of work in the supervised setting (see ( Khaloie et al. 2025 ) for a detailed review), applications of reinforcement learning (RL) for this purpose ( Yan et al. 2025 ) have been scarce. This is disappointing, since ACPF solvers produce rich traces during the iterative solution process, which can be used to improve model performance without explicit labels. Another aspect which has been understudied, and directly relates to the necessity of RL for this problem is the contracted region of convergence when the grid is near its voltage collapse point ( Sauer and Pai 1990 ) . This implies that warm start models trained on grids operating under nominal conditions fail to generalize to the aforementioned cases. We specifically focus on three shortcomings with the present literature. 1. Supervised warm start models use ACPF solutions as targets: A significant amount of prior literature on supervised warm start models for ACPF ( Okhuegbe et al. 2024b ; Okhuegbe et al. 2024a ; Diehl 2019 ) uses the exact solution x^{*} from existing datasets as the target for the model. As will be shown in the sequel, this results in poor warm start performance when the unit vector \frac{\hat{x}^{*}-x^{*}}{\left\lVert\hat{x}^{*}-x^{*}\right\rVert} points in certain directions, where \hat{x}^{*} is the model prediction. 2. Heavily loaded systems near voltage collapse are not considered: Most ML-for-ACPF datasets are generated by uniformly perturbing a lightly loaded operating point, so the entire dataset stays in the voltage stability regime. The recent PF \Delta benchmark ( Rivera et al. 2025 ) is a notable exception, using continuation methods to include near collapse cases, but the models trained therein are not used for warm starts. This results in a gap in literature concerning generalization of warm start models. 3. Reinforcement learning has been underutilized: To our knowledge, only two prior works apply RL to improve ACPF convergence: Yan et al. 2025 modifies each NR step, while Kaseb et al. 2025 requires a quantum-enhanced RL environment. Neither yields a plug-and-play warm start model which simply generates a x_{0} that minimizes the number of NR iterations. To overcome these shortcomings, we introduce Newton’s Lantern , an RL framework for finetuning warm start models that are pretrained on datasets restricted to voltage stable operating points away from the voltage collapse point, and are subsequently finetuned on a difficult holdout dataset containing near collapse cases. This setup is representative of practical grid operating conditions, where overloading and voltage collapse occur only under rare adverse events such as extreme weather and demand spikes ( Khazeiynasab and Qi 2021 ) . Our contributions are concretely as follows. 1. Characterizing the shortcoming of ACPF targets: We provide a theoretical result showing that the NR iteration count depends on the direction of the prediction error of warm start models trained with the ACPF solution x^{*} as the supervised target. A representative 2-bus example is analyzed in Appendix [FUTURE]. 2. Considering heavily loaded systems: The above result implies that near the voltage collapse point, anisotropy of the region of convergence causes the NR iteration count to inflate severely in certain directions. We demonstrate experimentally that warm start models trained on voltage stable cases fail to produce a starting point for which NR converges, while supervised finetuning (SFT) on a holdout set of voltage collapse cases restores convergence. 3. Reinforcement learning for improving convergence: Our framework Newton’s Lantern uses group-relative policy optimization (GRPO) with a negative iteration-count reward to finetune pretrained warm start models on the voltage collapse holdout. Experiments show it outperforms SFT on multiple grid examples, as well as a proximal policy optimization (PPO) baseline with an oracle value function. Notation. \mathbb{R}^{n} denotes n -dimensional Euclidean space and S^{n-1}\stackrel{{\scriptstyle\Delta}}{{=}}\left\{v\in\mathbb{R}^{n}:\left\lVert v\right\rVert=1\right\} the unit sphere. All norms \left\lVert\cdot\right\rVert are Euclidean unless an explicit subscript appears. The class C^{3} collects functions with continuous third derivatives. For a vector-valued map g\colon\mathbb{R}^{n}\to\mathbb{R}^{m} , the Hessian \nabla^{2}g is a tensor of shape m\times n\times n , and \nabla^{2}g\,[v,v]\in\mathbb{R}^{m} is the vector with \ell -th entry \sum_{i,j}v_{i}v_{j}\,\partial_{i}\partial_{j}\,g_{\ell} .