Porting the Nonlinear Optimization Library HiOp to Accelerator-Based Hardware Architectures Journal: Parallel Computing

Slaven Peleš, Kalyan S. Perumalla, Maksudul Alam, Asher J. Mancinelli, R. Cameron Rutherford, Jake Ryan, Cosmin G. Petra · 2026

Read Porting the Nonlinear Optimization Library HiOp to Accelerator-Based Hardware Architectures Journal: Parallel Computing by Slaven Peleš, Kalyan S. Perumalla, Maksudul Alam, Asher J. Mancinelli, R. Cameron Rutherford, Jake Ryan, Cosmin G. Petra (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-13736.txt.

Introduction

Slaven Peles and six colleagues port the curved tuning library HiOp to GPU-based chips. The team presents a novel inner point form running fully on GPUs, skipping sparse solvers by shrinking the sparse problem into a dense problem of usable size. That shows inner point methods for sparse problems can run well where over 90 percent of compute power sits in GPUs. The work is driven by optimal power flow problems and uses shared libraries Umpire and RAJA.

Catalog record

CREATORSlaven Peleš, Kalyan S. Perumalla, Maksudul Alam, Asher J. Mancinelli, R. Cameron Rutherford, Jake Ryan, Cosmin G. Petra
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE53437
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.13736

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Porting the Nonlinear Optimization Library HiOp to Accelerator-Based Hardware Architectures Journal: Parallel Computing Slaven Peleš, Kalyan S. Perumalla, Maksudul Alam, Asher J. Mancinelli, R. Cameron Rutherford, Jake Ryan, Cosmin G. Petra Abstract While interior point methods have been the centerpiece of nonlinear programming tools used in science and engineering, their reliance on linear solvers that can tackle sparse symmetric indefinite and highly ill-conditioned problems made it difficult to implement them effectively on hardware accelerators. At this time, there are few sparse linear solvers that can be used in this context [ 21 ] . Here, we present a novel formulation of an interior point method implemented in our HiOp library, which is designed to be able to run entirely on hardware accelerators. This formulation avoids dependence on sparse solvers altogether, which is achieved by compressing the underlying sparse linear problem into a dense one of manageable size. We demonstrate feasibility of this approach and provide a baseline for future interior point method implementations on hardware accelerators. Our investigation is motivated by problems arising in optimal power flow analysis in power systems engineering and our approach is tailored to the broad class of problems arising in that important domain. We also demonstrate utility of modern programming models based on performance portability libraries, namely, Umpire and RAJA. We discuss trade-offs between performance, portability and development cost in the solution space for this non-linear optimization problem. As a result of this research, we demonstrate for the first time that interior point methods for sparse problems can be efficiently realized on modern computing systems where more than 90% of processing power is in GPUs. 1 Introduction Interior point methods have been widely used in solving nonlinear programming problems arising in a number of science and engineering areas including model predictive control [ 5 ] , structural mechanics [ 20 ] , genomics [ 10 ] , and optimal power flow analysis [ 17 ] . The computational performance of an actual interior point method implementation strongly depends on the linear solver used to solve the underlying Karush-Kuhn-Tucker (KKT) linear problem [ 25 ] . Those problems are symmetric and typically indefinite, sparse, and very ill-conditioned. Many interior point method implementations also require a linear solver to provide matrix inertia (i.e. the number of positive, zero, and negative eigenvalues). The interior point method workflow we consider in this paper is schematically shown in Figure 1 . The method iteratively searches for an optimal solution by minimizing the objective scalar function that depends on multiple parameters. To ensure that the solution is within a feasible region, that is, all constraints are satisfied, the method extends the problem with barrier functions. Such an extended problem is solved by a Newton solver (inner loop in Figure 1 ), and then barrier parameters are gradually reduced to small values by a homotopy (outer loop in Figure 1 ) to arrive at the solution of the original problem. Because the underlying linear problem becomes singular when barrier parameters are zero, the homotopy algorithm has to exit when the optimal solution is close enough to the solution of the original problem, but before the underlying linear problem becomes too ill-conditioned to solve. This is why a robust linear solver is essential for an effective implementation of the interior point method. For more details, the reader is referred to seminal paper [ 25 ] and references therein. Figure 1: Interior point method workflow. Line arrows describe optimization algorithm control instructions, while block arrows describe data movement between solver components and the optimization model. The method requests evaluation of model objects, assembles KKT system and drives execution of the Newton solver. 1.1 Motivating Application In the energy industry, optimal power flow analysis is used to minimize the cost of operation of power grid, while satisfying all operational constraints such as generation-load balance, transmission limits, frequency limits, etc. The state-of-the-art in the industry is to linearize the power grid models around the operating point and then use linear programming to get an optimal solution. This approximation excludes important details such as modeling of voltage and reactive power constraints. Interior point method captures these constraints and could potentially allow for less conservative and thus cheaper dispatch within the same safety margin. The motivating problem for this work is security constrained optimal power flow. In this analysis, one performs simultaneous optimal power flow analysis for multiple scenarios, where each scenario represents a failure of a selected grid component. Such an analysis provides a contingency plan for grid planners and operators [ 8 , 19 ] . In this context, the interior point solver forms a coarse computational unit of a large-scale analysis. Such analysis is computationally extremely expensive; grid operators, for example, typically first simplify the problem by reducing the number of contingencies using some heuristic screening technique, and then perform security constrained power flow analysis. That means they look for a secure solution instead of a secure optimal solution. The recent emergence of heterogeneous computing platforms offers new potential to provide the necessary computational power to enable the energy industry to perform high-fidelity security constrained optimal power flow analysis effectively on commodity hardware, thereby progressing from merely feasible solutions towards optimal solutions. Deploying the interior point method on an accelerator device such as a graphical processing unit (GPU) would make a critical step in that direction. Historically, interior point methods came to prominence after efficient sparse linear solver methods were invented. Challenges in developing efficient fine-grained parallelization techniques for direct sparse linear solvers are currently preventing efficient implementations of interior point method on hardware accelerators. This limitation is even more pronounced in the case of highly irregular and very sparse problems, such as power grids, where linear solvers employing supernodal matrix factorization are not quite effective [ 6 ] . Currently, there are few linear solvers that meet the requirements of the interior point method and perform well on GPUs [ 21 ] . 1.2 Our Approach HiOp is our lightweight optimization solver specifically designed to overcome this issue by compressing the optimization problem in way that the underlying linear problem is dense and, thus, one can use dense GPU-enabled linear solvers which are more mature and better performing on accelerator devices. This compression technique reduces the size of the problem by approximately a third and is elaborated in Section 2 . We also use the Kron reduction technique [ 9 ] to perform an initial, pre-optimization compression of the sparse power flow to dense power flow and to obtain a so-called mixed dense-sparse format used by HiOp to further compress the internal linear systems, as previously mentioned. Kron reduction is a traditional technique in circuit analysis that reduces the number of nodes in a network while maintaining an accurate representation of the physics of the power flow [ 9 ] . Kron reduction is essentially equivalent to taking the Schur complement of a subset of the nodes in the susceptance matrix, which, as expected, results in a much denser (and smaller) susceptance matrix. We use the dense Kron-compressed power flow as the power flow engine in the ACOPF formulation and gradually enforce thermal limits on transmission elements and voltage limits by adding additional constraints

Read the complete text