Distributed Model Predictive Control Design for Multi-agent Systems via Bayesian Optimization

Hossein Nejatbakhsh Esfahani, Kai Liu, Javad Mohammadpour Velni · 2025

Read Distributed Model Predictive Control Design for Multi-agent Systems via Bayesian Optimization by Hossein Nejatbakhsh Esfahani, Kai Liu, Javad Mohammadpour Velni (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-12989.txt.

Introduction

Hossein Nejatbakhsh Esfahani, Kai Liu, and Javad Mohammadpour Velni tune cooperating controllers for groups of machines, in a 2025 paper. Fleets of robots or vehicles often split control among local controllers that plan ahead with their own models. Those local models are imperfect copies of the real system, which drags down the whole fleet's performance.

Their design learns better controller settings through Bayesian optimization run in a distributed way. A splitting algorithm lets each agent improve its settings while staying in step with the group. The team prove the learning settles at the best settings under their conditions. Fleets that tune themselves around model errors could hold formation and save energy without a central brain.

Catalog record

CREATORHossein Nejatbakhsh Esfahani, Kai Liu, Javad Mohammadpour Velni
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE83 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-12989

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Distributed Model Predictive Control Design for Multi-agent Systems via Bayesian Optimization Hossein Nejatbakhsh Esfahani, Kai Liu, Javad Mohammadpour Velni Abstract This paper introduces a new approach that leverages Multi-agent Bayesian Optimization (MABO) to design Distributed Model Predictive Control (DMPC) schemes for multi-agent systems. The primary objective is to learn optimal DMPC schemes even when local model predictive controllers rely on imperfect local models. The proposed method invokes a dual decomposition-based distributed optimization framework, incorporating an Alternating Direction Method of Multipliers (ADMM)-based MABO algorithm to enable coordinated learning of parameterized DMPC schemes. This enhances the closed-loop performance of local controllers, despite discrepancies between their models and the actual multi-agent system dynamics. In addition to the newly proposed algorithms, this work also provides rigorous proofs establishing the optimality and convergence of the underlying learning method. Finally, numerical examples are given to demonstrate the efficacy of the proposed MABO-based learning approach. I Introduction Networked systems have grown significantly in scale and complexity, leading to increasingly demanding requirements for model-based control accuracy and real-time performance. For such large-scale network systems, complex optimization algorithms are commonly employed to perform desired tasks while minimizing a priori defined objective functions and satisfying operational constraints [ 1 ] . Optimization-based control of networked systems then remains a challenging problem when a complex model of multi-agent system is exploited within the optimization framework. Although simplified models can reduce the complexity of the model-based optimization algorithms, the inaccuracies can significantly degrade the performance of multi-agent control system. A common approach to managing large-scale networked systems is to design local controllers that neglect interactions between the subsystems involved. However, this often results in an overall degradation in the system performance. Although centralized control could achieve better global performance, it is generally impractical due to limitations in communication, the complexity of nonlinear systems, and the large number of decision variables [ 2 ] . To address these challenges, extensive research has focused on structured control systems, including decentralized and distributed architectures. However, the primary challenge in a decentralized architecture lies in the lack of communication between controllers, which can lead to degraded closed-loop performance and, in some instances, even result in instability. In contrast, a distributed control system allows communication between controllers, enabling better coordination and potentially improved performance [ 3 ] . In the context of distributed control systems, distributed MPC (DMPC) is a well-researched optimal control approach that can handle interconnected systems and multi-variable interactions. Dual decomposition and Alternating Direction Method of Multipliers (ADMM) are two efficient methods for solving DMPC problems, where a coupled constraint between agents can be formulated as a dual problem [ 4 , 5 ] . However, inaccurate local MPC models adversely affect the performance of DMPC. It can also be challenging to choose parameters for the cost and constraint functions for each agent. Machine learning-based approaches have recently emerged to address the aforementioned issue by enabling data-driven model learning for MPC [ 6 , 7 ] . However, closed-loop control performance is not directly related to the model fitting, so that the control objectives may not be satisfied even if the learned model can accurately capture the real plant. To address this issue, the methods proposed in [ 8 , 9 , 10 , 11 , 12 ] established tools to fuse Markov Decision Process (MDP) and MPC so that an MPC scheme can deliver the same optimal policy as MDP by modifying the terminal and stage cost functions of the MPC. Then, several Reinforcement Learning (RL)-based methods were developed to learn the corresponding MPC cost functions aimed at improving closed-loop performance. It was shown that parameterizing the cost function can offer an alternative approach to model learning, motivated by the inherent connection between model-based predictions and the MPC cost function. The integration of Bayesian Optimization (BO) with MPC has recently introduced a powerful paradigm for addressing complex control problems in various domains. By enabling adaptive, data-driven, and efficient control strategies, this combination holds the potential for many applications ranging from robotics to energy systems and beyond [ 13 , 14 , 15 ] . BO is a probabilistic optimization approach designed for black-box functions that are expensive to evaluate. The methodology revolves around the construction of a surrogate model, often a Gaussian Process (GP), to approximate the target function [ 16 ] . Appropriate fusion of BO with MPC leverages the strengths of both; while BO has the ability to optimize black-box functions, MPC offers predictive control capabilities. MPC performance hinges on the proper selection of parameters such as prediction horizon, weighting matrices, and constraints. BO then enables systematic tuning by considering the closed-loop system performance as a black-box objective function [ 17 , 18 ] . The BO’s surrogate modeling can also be used to capture and update system uncertainties in real time, enabling adaptive MPC strategies for nonlinear or time-varying systems [ 19 ] . Authors in [ 20 ] proposed a safe and stability-informed BO for MPC cost function learning, in which a parameterized MPC scheme is safely adjusted to deliver the best closed-loop performance in the presence of a model mismatch between the MPC model and the real plant. A high-dimensional BO framework for sample-efficient MPC tuning was also proposed recently in [ 21 ] . Despite recent efforts in utilizing BO for control design purposes, in the context of multi-agent systems, the combined BO-MPC control approaches above do not account for the coupling and the interactions between different agents, i.e., through a DMPC scheme. To address that, in this paper, we propose to learn a DMPC scheme using a Multi-Agent BO (MABO) framework aiming at improving the optimal closed-loop performance for each local MPC scheme in the presence of model mismatch. We formulate the fusion of DMPC and multi-agent Markov Decision Processes (MDPs) so that the local MPC schemes obtained from a dual-decomposition method can capture the local value functions associated with the multi-agent MDP. In the proposed learning-based DMPC, we first show how the local cost functions associated with the local MPC schemes can be modified to deliver local optimal policies. We then propose to practically learn a parameterized DMPC by a coordinated learning mechanism in the ADMM-based MABO framework. Major contributions of this work are as follows: • We propose a modified DMPC scheme and demonstrate its ability to capture the true multi-agent MDP, even when the local MPC schemes, formulated via the dual decomposition method, are based on imperfect models of the real multi-agent system. We provide formal proofs to establish that the modified DMPC scheme serves as a valid approximator for the local optimal policies. • We introduce a parametric variant of the modified DMPC scheme and develop an ADMM-based MABO algorithm to enable coordinated learning of the parameterized local MPC schemes. • We conduct a rigorous convergence analysis of the proposed coordination-based distributed learning algorithm, supported by formal proofs of key properties of the acquisition function employed in the ADMM-based MABO method. This paper is organized as follows. In Section II , a distributed MPC scheme based on a dynamic dual-decomposition method is described. The fusion of DMPC and multi-agent MDPs is detailed in Section III . In Section IV , we provide

Read the complete text