A Lyapunov-based MPC for Distributed Multi Agent Systems with Time Delays and Packet Dropouts using Hidden Markov Models
Loaie Solyman, Aamir Ahmad, Ayman El-Badawy · 2025
Read A Lyapunov-based MPC for Distributed Multi Agent Systems with Time Delays and Packet Dropouts using Hidden Markov Models by Loaie Solyman, Aamir Ahmad, Ayman El-Badawy (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-03708.txt.
Introduction
Groups of cooperating agents, from drones to mobile robots, must agree on a shared course of action while their communication network misbehaves. Loaie Solyman, Aamir Ahmad, and Ayman El-Badawy address delays and dropped packets in a 2025 control preprint. Messages arriving late or not at all create errors that offline planning cannot remove.
Their framework joins semi-continuous hidden Markov models, which track the network's random behaviour in real time, with Lyapunov-based model predictive control. The controller balances three aims at once: gentle control effort, small network-induced error, and small error caused by the communication graph itself. An incremental learning routine updates the network model online as conditions change. Simulations across several network layouts show the agents still reach consensus and stay near optimal performance, even as the topology varies.
Catalog record
| CREATOR | Loaie Solyman, Aamir Ahmad, Ayman El-Badawy |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 63 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2512-03708
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
A Lyapunov-based MPC for Distributed Multi Agent Systems with Time Delays and Packet Dropouts using Hidden Markov Models Loaie Solyman, Aamir Ahmad, Ayman El-Badawy Abstract We propose a SCHMM-LMPC framework, integrating Semi-Continuous Hidden Markov Models with Lyapunov-based Model Predictive Control, for distributed optimal control of multi agent systems under network imperfections. The SCHMM captures the stochastic network behavior in real time, while LMPC ensures consensus and optimality via Linear Matrix Inequalities (LMIs). The developed optimal control problem simultaneously minimizes three elements. First, the control effort is reduced to avoid aggressive inputs and second, the network-induced error caused by time delays and packet dropouts. Third, the topology-induced error, as the distributed graph restricts agents’ access to global information. This error is inherent to the communication graph and cannot be addressed through offline learning. To overcome this, the study also introduces the incremental Expectation Maximization (EM) algorithm, enabling online learning of the SCHMM. This adaptation allows the framework to mitigate both network and topology errors while maintaining optimality through MPC. Simulations validate the effectiveness of the proposed SCHMM-LMPC, demonstrating adaptability in multi agent systems with diverse topologies. I Introduction Multi Agent Systems (MASs) have gained considerable attention in fields such as robotics, autonomous vehicles, smart grids, and distributed sensor networks [ 1 ] . These systems rely on consensus-oriented control, where agents coordinate their actions through local connection [ 2 ] . Achieving consensus, however, is difficult under constraints like time delays, packet dropouts [ 3 ] , and distributed topologies [ 4 ] . Such issues are critical in team formations, where delays or data loss hinder coordination, or in smart grids, where distributed agents must operate synchronously under diverse constraints. Despite extensive research, no unified solution fully addresses these challenges [ 5 ] . The study of distributed optimal control in MASs remains challenging due to three interrelated issues, namely, distributed topologies [ 6 ] , the need for optimality [ 7 ] , and network imperfections [ 6 ] . In distributed settings, agents lack centralized control, exchanging only local data with neighbors [ 6 ] . This improves scalability and resilience but complicates control law design, as agents must act on incomplete global information. The optimality issue requires control laws to meet performance criteria such as constrained control effort [ 8 ] . Achieving this collectively, with agents solving coupled optimization problems under partial information, necessitates distributed optimization algorithms [ 9 ] . Network imperfections, such as delays and packet losses, further impair information exchange, degrading performance or causing instability [ 10 ] . These stochastic effects are hard to model, requiring probabilistic strategies. The three issues are tightly coupled, as unreliable communication complicates distributed decision-making, while ensuring optimality demands precision often disrupted by network imperfections [ 11 ] . Thus, comprehensive solutions must address all three jointly. This paper develops such a framework, systematically incorporating distributed structure, guaranteeing optimality, and explicitly accounting for delays and packet dropouts. Regarding topology, three paradigms exist, the centralized, decentralized, and distributed. Centralized schemes rely on a single controller, which may achieve global optimality but suffer from scalability and single-point failure [ 12 ] . Decentralized schemes let agents act independently with only local data, enhancing resilience but yielding suboptimal outcomes [ 13 ] . Distributed topologies strike a balance where agents interact with neighbors according to a network graph and compute local actions using both local and shared data [ 14 ] . This approach offers scalability and resilience to single-point failure, making it the most practical choice for MASs in uncertain environments [ 15 ] . The optimality issue extends beyond mere consensus, requiring control strategies that minimize a defined cost while respecting constraints. In dynamic or resource-limited environments, suboptimal solutions reduce efficiency. Model Predictive Control (MPC) addresses this by optimizing a cost function over a prediction horizon under constraints [ 16 ] . Coupled with Lyapunov-based analysis, MPC guarantees optimal performance and consensus, making it effective for MAS applications [ 17 ] . Network imperfections such as time delays and packet dropouts present further challenges. Delays hinder timely decisions, while dropouts cause data loss [ 18 ] . Mitigation strategies include delay-compensation methods, predictive control, and event-triggered schemes [ 4 ] . More recent works embed stochastic models like Hidden Markov Models (HMMs) into consensus algorithms, providing probabilistic guarantees [ 3 ] . Study [ 3 ] introduced a Semi-Continuous HMM (SCHMM) called the Single Model Scheme (SMS) to jointly capture delays and dropouts. However, this work only addressed single control systems and not MASs. Some studies attempt to combine subsets of the three problems. For example, [ 19 ] addressed distributed topology and optimality via a randomized Jacobi proximal Alternating Direction Method of Multipliers (ADMM), but the method is complex and ignores communication constraints. Another study tackled topology and communication jointly [ 20 ] , requiring agents to track all possible packet loss scenarios. While effective, the assumptions are local to limited geographical areas as mentioned by the study itself. Other contributions like [ 21 ] and [ 22 ] similarly address only two of the three problems. Where [ 21 ] used a Markov chain to predict the behavior of packet dropouts only, solving the distributed topology issue along with partial solution to the networks issue. Also, [ 22 ] utilized iterative learning to predict the behavior of continuous data losses while adhering to a cost function, solving only the optimality issue and partially attacking the networks issue. No existing study comprehensively solves distributed optimal control in MASs under both time delays and packet dropouts. These mentioned studies also have a drawback, which is their formulation of the problem. The distributed nature of the topology constraints the number of neighbors each agent can communicate with, in addition, this communication is impaired by the network. Earlier studies formulate the problem in a way that heavily couples the topological and network issues, which then poses a difficult problem to solve. This compels them to make conservative assumptions on the topology or the network. This drawback was noticed in the literature and hence this study would overcome that through an independent formulation of the problem. This paper introduces the Semi-Continuous Hidden Markov Model – Lyapunov-based Model Predictive Control (SCHMM-LMPC), the first framework to simultaneously address distributed topology, optimality, and network uncertainties. This method groups neighboring agents into subsystems which reduces the computational burden. This extracts a compact system, where an error term linked to distributed topology, is introduced. Unlike prior work where SCHMMs only modeled network errors [ 3 ] , this study considers errors also arising from topology. To handle this, an incremental Expectation Maximization (EM) algorithm that is novel in SCHMM contexts, is introduced for online learning. Moreover, LMPC ensures optimality and consensus through Lyapunov-based guarantees. The problem at hand is non-trivial because it deals with two apparently dependent error terms. The first is the error due to the network delays and losses. And, the second is the error due to the distributed topology, as each agent can only communicate with a subset of the graph. The main contribution of this study is a compact system formulation that removes this interdependence. By leveraging the SCHMM prediction mechanism to