Distributed Event-Triggered Nash Equilibrium Seeking for Noncooperative Games

Victor Hugo Pereira Rodrigues footnoteinfo, Tiago Roux Oliveira, Miroslav Krstić, Tamer Başar · 2025

Read Distributed Event-Triggered Nash Equilibrium Seeking for Noncooperative Games by Victor Hugo Pereira Rodrigues footnoteinfo, Tiago Roux Oliveira, Miroslav Krstić, Tamer Başar (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-06691.txt.

Introduction

Victor Hugo Pereira Rodrigues, Tiago Roux Oliveira, Miroslav Krstic, and Tamer Basar design algorithms that steer competing players to equilibrium without models, in this two thousand twenty-five paper. In noncooperative games each player pursues its own payoff, and a Nash equilibrium is where nobody gains by deviating alone. The players here do not know their quadratic payoff functions. Sinusoidal perturbations let each estimate its pseudo-gradient from observed payoffs, an extremum seeking trick.

Communication is event-triggered to save bandwidth: each player broadcasts only when its current gradient estimate has drifted enough from the last sent value, and tunes its own trigger threshold. The authors prove local convergence, quantify the small residual set around the equilibrium, and establish a minimum dwell time ruling out infinitely fast switching, the Zeno behavior. Stability analysis uses Lyapunov methods and averaging for discontinuous systems. An oligopoly example illustrates the theory numerically.

Catalog record

CREATORVictor Hugo Pereira Rodrigues footnoteinfo, Tiago Roux Oliveira, Miroslav Krstić, Tamer Başar
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE65 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-06691

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Distributed Event-Triggered Nash Equilibrium Seeking for Noncooperative Games Victor Hugo Pereira Rodrigues footnoteinfo, Tiago Roux Oliveira, Miroslav Krstić, Tamer Başar Abstract We propose locally convergent Nash equilibrium seeking algorithms for N N -player noncooperative games, which use distributed event-triggered pseudo-gradient estimates. The proposed approach employs sinusoidal perturbations to estimate the pseudo-gradients of unknown quadratic payoff functions. This is the first instance of noncooperative games being tackled in a model-free fashion with event-triggered extremum seeking. Each player evaluates independently the deviation between the corresponding current pseudo-gradient estimate and its last broadcasted value from the event-triggering mechanism to tune individually the player action, while they preserve collectively the closed-loop stability/convergence. We guarantee Zeno behavior avoidance by establishing a minimum dwell-time to avoid infinitely fast switching. In particular, the stability analysis is carried out using Lyapunov’s method and averaging for systems with discontinuous right-hand sides. We quantify the size of the ultimate small residual sets around the Nash equilibrium and illustrate the theoretical results numerically on an oligopoly setting. keywords Game Theory; Nash Equilibrium Seeking; Extremum Seeking; Event-Triggered Tuning. † † thanks: [ † † address: State University of Rio de Janeiro (UERJ), Rio de Janeiro – RJ, Brazil † † address: University of California San Diego (UCSD), San Diego – CA, USA † † address: University of Illinois Urbana-Champaign, Urbana – IL, USA footnoteinfo]Corresponding author: V. H. P. Rodrigues. , , , and . 1 Introduction Game theory provides a theoretical framework for studying social situations among competing players and using mathematical models of strategic interaction among rational decision-makers [ 25 , 13 ] . Game-theoretic approaches to designing, modeling, and optimizing emerging engineering systems, biological behaviors and mathematical finance make this topic of research an extremely important one in many fields with a wide range of applications [ 28 , 7 , 14 ] . Indeed, there exist numerous studies of both theoretical and practical nature in the literature on differential games [ 75 , 62 , 74 , 81 , 20 , 10 , 5 ] . In this context, we can view games roughly in two categories: cooperative and noncooperative games [ 12 ] . A game is cooperative if the players are able to form binding commitments externally enforced ( e.g. , through contract law), resulting in collective payoffs. A game is noncooperative if players cannot form alliances or if all agreements need to be self-enforcing ( e.g. , through credible threats), focusing on predicting individual players’ actions and payoffs and analyzing the Nash equilibrium [ 52 ] . Nash equilibrium is an outcome which, once achieved or reached, means no player can improve upon its payoff by modifying its decision unilaterally [ 12 ] . The development of algorithms to achieve convergence to a Nash equilibrium has been a focus of researchers for several decades [ 44 , 11 ] . Some papers have also looked at learning aspects of various update schemes for reaching Nash equilibrium [ 90 ] . Related to extremum seeking (ES), the authors in [ 24 ] study the problem of computing, in real time, the Nash equilibrium of static noncooperative games with N players by employing a non-model based approach. By utilizing ES [ 43 ] with sinusoidal perturbations, the players achieve stable, local attainment of their Nash strategies without the need for any model information. Thereafter, the expansion of the algorithm proposed in [ 24 ] to different domains was given for delayed and PDE systems [ 61 , 58 ] as well as fixed-time convergence [ 65 , 70 ] . On the other hand, in the current technological age of network science, researchers are focusing on decreasing costs by designing fast and reliable communication schemes where the plant and controller might not be physically connected, or might even be in different geographical locations. These networked control systems offer advantages in the financial cost of installation and maintenance [ 87 ] . However, one of their major disadvantages is the resulting high-traffic congestion, which can lead to transmission delays and packet dropouts, i.e. , data may be lost while in transit through the network [ 32 ] . These issues are highly related to limited resource or available communication channels’ bandwidth. To alleviate or mitigate this problem, Event-Triggered Controllers (ETC) can be used. ETC executes the control task, non-periodically, in response to a triggering condition designed as a function of the plant’s state. Besides the asymptotic stability properties [ 77 ] , this strategy reduces control effort since the control update and data communication only occur when the error between the current state and the equilibrium set exceeds a certain value that might induce instability [ 15 ] . Pioneering works towards the development of resource-aware control design include the construction of digital computer design [ 50 ] , the event-based PID design [ 2 ] and the event-based controller for stochastic systems [ 9 ] . Works dedicated to extension of event-based control for networked control systems with a high level of complexity exist for both linear [ 84 , 31 , 30 ] and nonlinear systems [ 77 , 4 ] . Among others, results on event-based control deal with the robustness against the effect of possible perturbations [ 33 , 16 ] or parametric uncertainties [ 83 ] . In [ 88 ] , ETC is designed to satisfy a cyclic-small-gain condition such that the stabilization of a class of nonlinear time-delay systems is guaranteed. Further, the authors in [ 18 ] propose distributed event-triggered leaderless and leader-follower consensus control laws for general linear multi-agent networks. An event-triggered output-feedback design [ 4 ] has been employed aiming to stabilize a class of nonlinear systems by combining techniques from event-triggered and time-triggered control. Research in this area spans various control-estimation designs and system complexities, addressing robustness and stability concerns [ 36 , 37 , 38 , 4 , 88 , 18 ] . Many practical engineering problems that arise in industry, involving networking in areas such as network virtualization, software defined networks, cloud computing, the Internet of Things, context-aware networks, green communications, and security can be modeled by a game-theoretic approach with distributively connectivity through networks by using their resources [ 28 , 7 , 6 ] . Hence, the motivation for employing real-time optimization to improve such engineering processes commonly modeled by this combination of game theory and event-triggered architectures in networked-based framework should be clear and highly demanding. There even exist publications on these topics [ 49 , 80 , 35 , 86 ] , but the literature has not yet addressed in this context extremum seeking feedback [ 43 ] . In fact, it appears to be quite challenging to address this problem. Despite the large number of publications on ETC mentioned in the previous paragraphs and also the consolidation of ES results for static and general nonlinear dynamic systems in continuous time [ 43 ] , the theoretical advances of ES have gone much beyond such systems, encompassing discrete-time systems [ 19 ] , stochastic systems [ 46 , 45 ] , multivariable systems [ 26 ] , noncooperative games [ 24 ] , time delays [ 59 , 89 ] and even

Read the complete text