Distributed and Decentralized Optimization Algorithms via Consensus ALADIN
Xu Du, Jingzhe Wang, Karl H. Johansson, Apostolos I. Rikos · 2026
Read Distributed and Decentralized Optimization Algorithms via Consensus ALADIN by Xu Du, Jingzhe Wang, Karl H. Johansson, Apostolos I. Rikos (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-20638.txt.
Introduction
Xu Du and three colleagues extend the ALADIN optimization framework to distributed consensus problems. Such problems arise in smart grids, control, and machine learning, where many parts must agree on shared values. Their Consensus ALADIN version uses a central coordinator and comes in first-order and second-order forms, the latter using a Hessian approximation. A decentralized version runs over directed graphs with quantized messages, and both gain global convergence for convex problems.
Catalog record
| CREATOR | Xu Du, Jingzhe Wang, Karl H. Johansson, Apostolos I. Rikos |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 84418 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.20638
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Distributed and Decentralized Optimization Algorithms via Consensus ALADIN Xu Du, Jingzhe Wang, Karl H. Johansson, Apostolos I. Rikos Abstract Distributed optimization has found widespread applications in smart grids, optimal control, and machine learning. This paper studies distributed consensus optimization. We extend the Augmented Lagrangian-based Alternating Direction Inexact Newton (ALADIN) framework to propose Consensus ALADIN (C-ALADIN) with a central coordinator, which directly handles consensus constraints. Our C-ALADIN algorithm admits both a first-order variant and a second-order variant that employs a Hessian approximation, avoiding direct transmission of second-order information while preserving fast local convergence. We then develop a decentralized version of C-ALADIN that operates over directed graphs with quantized communication, using a finite-time coordination protocol. For both versions, we establish global convergence guarantees for convex problems and local convergence guarantees for non-convex problems. For the decentralized case, the iterates converge to a neighborhood of the optimum determined by the quantization level. Numerical results demonstrate that our methods retain fast convergence while substantially reducing communication and computational costs compared to existing decentralized approaches. I Introduction Distributed and decentralized optimization have attracted significant attention, driven by advances in distributed control systems [ 47 , 28 , 55 ] , federated learning [ 60 , 59 ] , and distributed power systems [ 46 , 11 ] . The growing need to solve large-scale problems with massive datasets and heterogeneous objectives motivates the use of distributed and decentralized optimization algorithms. In distributed optimization, data are partitioned across multiple agents. Each agent solves a local subproblem and exchanges information either with a central coordinator or directly with its neighboring agents. When no coordinator is present and communication relies solely on peer-to-peer interactions, the setting is specifically referred to as decentralized optimization. Distributed optimization problems are typically categorized into two main classes: (i) distributed resource allocation optimization, and (ii) distributed consensus optimization [ 16 ] . In the first class, the objective function has a finite-sum structure, and local variables are coupled through affine equality or inequality constraints, potentially with heterogeneous dimensions [ 10 ] . In the second class, problems also exhibit a sum-structured objective, but the local variables are required to reach full consensus [ 4 ] . From an algorithmic perspective, as surveyed in [ 5 , 10 ] , distributed and decentralized optimization methods can be divided into two types: (i) primal decomposition based algorithms and (ii) dual decomposition based algorithms. Primal decomposition based optimization includes zeroth-order [ 56 ] , first-order [ 36 , 45 , 25 , 33 , 54 , 31 , 39 , 26 ] , and second-order methods [ 49 , 58 , 9 ] . In contrast, dual decomposition based approaches build upon fundamental frameworks such as Dantzig-Wolfe decomposition [ 7 ] , the Alternating Direction Method of Multipliers (ADMM) [ 4 ] , and the Augmented Lagrangian Alternating Direction Inexact Newton (ALADIN) method [ 22 , 23 ] . Dual decomposition generally achieves faster convergence and higher solution accuracy than primal methods [ 32 , Sec. I] . This work therefore focuses on dual decomposition based approaches for distributed and decentralized consensus optimization, specifically on the ALADIN method [ 22 , 23 ] . This algorithm has demonstrated favorable convergence performance in distributed resource allocation optimization. However, its application to consensus optimization faces structural challenges, as we discuss next. Extending ALADIN to this setting therefore remains largely unexplored in the literature. I-A Literature Review. The ALADIN algorithm [ 22 ] was originally introduced to improve the numerical convergence speed of ADMM [ 4 , 38 , 12 ] for distributed resource allocation optimization, specifically its parallelizable primal splitting variant [ 50 ] , [ 22 , Algorithm 1] , and to strengthen its convergence guarantees for non-convex problems. It achieves this by integrating the coupled Sequential Quadratic Programming (SQP) [ 37 ] into the augmented Lagrangian framework [ 22 , 23 , 19 , 18 , 11 , 52 , 15 , 16 , 17 , 14 , 21 , 24 ] . In convergence theory, ALADIN-type algorithms achieve local convergence guarantees for smooth non-convex problems and global convergence guarantees for convex problems [ 23 , 16 ] . ALADIN has subsequently been applied to model predictive control (MPC) [ 24 ] , moving horizon estimation (MHE) [ 55 , 51 ] , and distributed optimal power flow (OPF) [ 19 , 11 ] . In each case, the problem suffers from the curse of dimensionality: for MPC and MHE, due to a long horizon, and for OPF, due to a large number of buses. By recasting these problems into distributed formulations via time-splitting for MPC/MHE or spatial decomposition for OPF, and solving them with ALADIN, the dimensionality burden is effectively alleviated. Inspired by ALADIN, the PaDOA algorithm [ 35 ] was developed for distributed mixed-integer programming, integrating outer approximation into the distributed optimization framework, achieving global convergence for convex problems and finding applications in temperature control systems. Despite the success of ALADIN in distributed resource allocation optimization problems, its application to distributed consensus optimization faces several challenges: (i) ALADIN requires each variable to possess local second-order information, yet the global consensus variable has no associated objective function and consequently admits no Hessian, leading to a structural mismatch; (ii) existing ALADIN implementations typically rely on a central coordinator or assume undirected communication, which is not always feasible in many real-world applications where directed graphs are prevalent; and (iii) ALADIN relies on real-valued exchange of Hessians and gradients, which limits applicability in environments with limited communication bandwidth. To address the first challenge, a coupling matrix scheme was proposed in [ 1 , Sec. 12] that reformulates consensus optimization into a resource allocation form, but this requires manual intervention, leaving direct consensus solving within ALADIN underexplored. To address the second challenge, prior work [ 18 ] employs decentralized ADMM to solve the coupled QP in ALADIN. In an attempt to tackle decentralized consensus optimization directly, the GIANT algorithm [ 49 ] and its variants employ global gradient aggregation with exact local Hessian information. Nevertheless, they have been primarily studied only for convex problems on undirected graphs. The ADMM-type algorithm in [ 41 ] simultaneously addresses all aforementioned challenges through the integration of Consensus ADMM with a decentralized quantized communication scheme; however, it remains limited to convex problems and is not based on the ALADIN framework. Based on the above literature review, three critical gaps remain for ALADIN‑type algorithms in the context of distributed consensus optimization: (i) tailoring ALADIN specifically for consensus constraints (rather than resource allocation); (ii) decentralization over directed graphs without a central coordinator; and (iii) quantized communication to reduce bandwidth. Although some prior works address subsets of these issues (e.g., quantization for ADMM, decentralized QP solvers for resource allocation), no existing ALADIN‑based method addresses all three in a unified manner, particularly for non‑convex problems. To the best of our knowledge, apart from our recent works [ 16 , 13 ] , this gap has not been systematically addressed. I-B Main Contributions. Motivated by the aforementioned open questions, we propose Consensus ALADIN (C-ALADIN) and its extensions built upon the ALADIN framework. Our main contributions are as follows. • C-ALADIN framework. To tailor ALADIN specifically for distributed consensus