Lightweight Real-Time ALADIN for Distributed Optimization † Corresponding author The work of X.D. and A.I.R. was supported by the Guangzhou-HKUST(GZ) Joint Funding Scheme (Grant No. 2025A03J3960). The work of A.I.R. was also supported by the Guangdong Provincial Project (Grant No. 2024QN11G109).

Yifei Wang, Xuhui Feng, Shimin Pan, Liangfan Zhu, Xu Du †, Apostolos I. Rikos · 2026

Read Lightweight Real-Time ALADIN for Distributed Optimization † Corresponding author The work of X.D. and A.I.R. was supported by the Guangzhou-HKUST(GZ) Joint Funding Scheme (Grant No. 2025A03J3960). The work of A.I.R. was also supported by the Guangdong Provincial Project (Grant No. 2024QN11G109). by Yifei Wang, Xuhui Feng, Shimin Pan, Liangfan Zhu, Xu Du †, Apostolos I. Rikos (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-15176.txt.

Introduction

Wang and others slim down ALADIN for real-time spread-out tuning across many nodes. Adjoint SQP methods work out Jacobian data inside the embedded quadratic program, cutting message costs. An event-based update rule skips some Hessian and Jacobian refreshes, cutting compute cost. The method keeps local convergence and strong results while running much faster in urgent tests.

Catalog record

CREATORYifei Wang, Xuhui Feng, Shimin Pan, Liangfan Zhu, Xu Du †, Apostolos I. Rikos
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE31962
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.15176

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Lightweight Real-Time ALADIN for Distributed Optimization † Corresponding author The work of X.D. and A.I.R. was supported by the Guangzhou-HKUST(GZ) Joint Funding Scheme (Grant No. 2025A03J3960). The work of A.I.R. was also supported by the Guangdong Provincial Project (Grant No. 2024QN11G109). Yifei Wang, Xuhui Feng, Shimin Pan, Liangfan Zhu, Xu Du †, Apostolos I. Rikos Abstract This paper presents a real-time computational framework for multi-node distributed optimization by extending the Augmented Lagrangian Alternating Direction Inexact Newton (ALADIN) algorithm. Our approach integrates adjoint sequential quadratic programming (SQP) techniques to enable efficient approximation of Jacobian information within the ALADIN embedded quadratic program, thereby reducing communication overhead. Furthermore, to decrease computational complexity, we design an event-triggered update strategy that avoids updating Hessian and Jacobian matrices at every iteration. The proposed method achieves local convergence and enhanced communication efficiency, making it well suited for time-critical applications. Numerical experiments demonstrate that our approach achieves competitive performance while exhibiting superior computational efficiency in real-time scenarios, validating its practical applicability for time-sensitive distributed optimization challenges. keywords Distributed optimization, ALADIN, Adjoint SQP 1 Introduction Distributed optimization has attracted substantial attention in recent years. This trend is driven by progress in federated learning ( 18 ; 6 ), power systems ( 4 ; 16 ), and model predictive control (MPC) ( 19 ; 15 ). Studies in these fields consistently show that the curse of dimensionality becomes severe as the dimension of the optimization variables grows. As a result, centralized methods for large-scale problems become computationally infeasible. Distributed optimization algorithms are therefore viewed as an effective means to alleviate the curse of dimensionality. Distributed optimization comprises a family of computational methods in which nodes iteratively solve local subproblems. During the iteration process, nodes exchange information with neighbors or with a central coordinator. The exchanged information may include first and second-order information, or local primal variables. These approaches are commonly classified into primal and dual decomposition frameworks ( 3 ). In dual decomposition methods, communication includes not only the information exchanged in primal decomposition but also dual variables associated with coupling constraints, which can enhance convergence behavior. A well-known algorithm in this category is the Alternating Direction Method of Multipliers (ADMM) ( 1 ), which distributes the Augmented Lagrangian Method and provides rigorous convergence guarantees for convex problems. However, ADMM often suffers from slow convergence and requires restrictive assumptions in nonconvex settings, see 12 . Recent research has introduced the Augmented Lagrangian Alternating Direction Inexact Newton algorithm (ALADIN) ( 14 ; 7 ). ALADIN incorporates sequential quadratic programming (SQP) into an ADMM-type framework, which yields accelerated convergence for convex problems and ensures local convergence for nonconvex cases. Building on these properties, this paper aims to explore the application of ALADIN to distributed nonconvex optimization in real-time environments. Existing Literature. ALADIN was originally developed for distributed sensor network localization ( 13 ) and MPC ( 15 ), both of which involve distributed nonconvex optimization problems. Subsequent studies ( 8 ; 4 ) demonstrated its effectiveness in distributed alternating current power flow optimization. All of these applications fall within the category of resource allocation problems. More recently, 7 introduced a consensus-oriented variant, termed Consensus ALADIN, which achieves improved computational efficiency for consensus optimization. To the best of our knowledge, the paper ( 20 ) was the first to extend the application of ALADIN to non-smooth, non-convex constraint optimization problems. Regarding convergence properties, ALADIN ensures local convergence for nonconvex problems under standard assumptions. These assumptions include the second order sufficient condition (SOSC) and the linear independent constraint qualification (LICQ). For convex problems, global convergence can be achieved when the local Hessian is approximated by constant matrices. Recent theoretical advances ( 6 ; 7 ; 5 ) established sufficient conditions for global linear convergence of ALADIN in convex settings. Moreover, ( 9 , Chapter 5) derived explicit linear convergence rates under stronger assumptions. For comprehensive surveys of ALADIN, we refer interested readers to 16 . However, a key limitation of the ALADIN framework lies in its reliance on solving a large-scale constrained coupled quadratic program (QP) for inter-node coordination. This step introduces high communication overhead and significant computational cost, mainly due to the construction and direct solution of the coupled QP ( ( 4 , IV.C) ). Recent work ( 21 ) derived a closed-form expression for the constrained coupled QP. This result decouples the updates of three variable sets: (i) the dual variables associated with coupling constraints, (ii) the dual variables related to local constraints, (iii) the primal variables. Despite this simplification, constructing the coordination QP still requires each node to transmit substantial local information to the coordinator when local constraints are present. This information includes first and second-order information of the local objectives, the constraint Jacobians, which results in significant communication overhead. Moreover, the variable updates in the closed-form representation still rely on matrix inversions. These inversions become computationally expensive in high-dimensional settings. Although existing Hessian approximation techniques, such as the Broyden–Fletcher–Goldfarb–Shanno (BFGS)-based method in 7 , can avoid the direct transmission of Hessian information, they are only applicable to unconstrained subproblems and do not provide a general mechanism for handling constrained cases. These limitations reveal two major challenges for ALADIN: (i) excessive information transmission and the absence of effective Hessian and Jacobian recovery for constrained local subproblems, and (ii) considerable matrix inversion operations required to solve the large-scale coupled QP. Main Contributions. Motivated by the aforementioned challenges, we propose a novel real-time optimization framework based on ALADIN, termed Efficient Adjoint BFGS ALADIN . Our approach combines the BFGS-ALADIN technique ( 7 ) with adjoint SQP methods ( 2 ; 17 ; 10 ; 11 ), enabling the coordinator to reconstruct both local Hessian and Jacobian information without explicit transmission from the nodes. Furthermore, inspired by 14 , we incorporate an event-triggered mechanism that adaptively determines when to update these local approximations during the iterative process. To the best of our knowledge, this is the first work that employs ALADIN within a framework that simultaneously (i) recovers both local Hessian and Jacobian information at the coordinator and (ii) integrates an event-triggered mechanism to update these approximations, thereby reducing the computational burden of solving ALADIN’s coupled QP. Numerical results demonstrate the superior performance of the proposed algorithm compared to existing benchmarks. Notation. In this paper, the superscript [k] denotes the iteration index, while the notation (\psi\mid\phi) indicates the dual multiplier \psi associated with the corresponding constraint \phi . 2 Problem Formulation This paper considers a resource allocation problem involving N nodes. Each node i has a decision variable x_{i}\in\mathbb{R}^{n_{i}} , a local objective function f_{i}(x_{i}):\mathbb{R}^{n_{i}}\rightarrow\mathbb{R} and local constraints g_{i}:\mathbb{R}^{n_{i}}\rightarrow\mathbb{R}^{c_{i}} . The problem is formulated as follows: \small\begin{split}\min_{\begin{subarray}{c}x_{i}\in\mathbb{R}^{n_{i}}\\ \forall i\in\{1,\dots,N\}\end{subarray}}\;\sum_{i=1}^{N}f_{i}(x_{i})\hskip 9.24994pt\text{s.t.}\;\;\;\left\{\begin{split}&\sum_{i=1}^{N}A_{i}x_{i}=b,\\ &g_{i}(x_{i})=0\hskip 9.24994pt\forall i\in\{1,\dots,N\}.\end{split}\right.\end{split} (1) Here, the nodes’ variables are coupled through an affine constraint \sum_{i=1}^{N}A_{i}x_{i}=b , where A_{i}\in\mathbb{R}^{m\times n_{i}} and b\in\mathbb{R}^{m} . In this paper, we adopt the following assumptions that are essential for our subsequent development. Assumption 1 SOSC Satisfaction . For each node, the local cost function f_{i} is closed, proper, twice continuously differentiable, and satisfies SOSC at a local minimizer x^{*} of problem ( 1 ), i.e. \nabla^{2}f(x^{*})\succ 0. Additionally, for every node i , the local constraint function g_{i} is assumed to be closed, proper, and second-order continuously differentiable.

Read the complete text