Evolutionary Algorithms for Computing Nash Equilibria in Dynamic Games
Alireza Rezaee · 2026
Read Evolutionary Algorithms for Computing Nash Equilibria in Dynamic Games by Alireza Rezaee (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-02397.txt.
Introduction
Alireza Rezaee computes Nash equilibria in dynamic games, the settings where several players choose strategies over time and each outcome depends on all choices together. Games like these model multi agent decisions in control and economics. Classical solvers lean on strong structural assumptions and break down for nonlinear dynamics, many players, or long time horizons, where several local equilibria can exist.
Rezaee shows by example that classical methods can miss the true global equilibrium even in small games. He then proposes two population based evolutionary methods that search the joint strategy space directly, a co evolutionary genetic algorithm and a hybrid that mixes a genetic algorithm with particle swarm optimization. Neither needs the restrictive assumptions, and both are less likely to get trapped at a merely local equilibrium.
Catalog record
| CREATOR | Alireza Rezaee |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 24 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-02397
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Evolutionary Algorithms for Computing Nash Equilibria in Dynamic Games Alireza Rezaee Abstract Dynamic nonzero sum games are widely used to model multi agent decision making in control, economics, and related fields. Classical methods for computing Nash equilibria, especially in linear quadratic settings, rely on strong structural assumptions and become impractical for nonlinear dynamics, many players, or long horizons, where multiple local equilibria may exist. We show through examples that such methods can fail to reach the true global Nash equilibrium even in relatively small games. To address this, we propose two population based evolutionary algorithms for general dynamic games with linear or nonlinear dynamics and arbitrary objective functions: a co evolutionary genetic algorithm and a hybrid genetic algorithm particle swarm optimization scheme. Both approaches search directly over joint strategy spaces without restrictive assumptions and are less prone to getting trapped in local Nash equilibria, providing more reliable approximations to global Nash solutions. 1 Introduction to Game Theory In non-cooperative games where players act simultaneously (i.e., without a hierarchical order or prior knowledge of other players’ moves at each stage), the goal is to find an equilibrium point at which all players simultaneously optimize their value functions (costs or payoffs). In many such games, at each decision stage, the actions of all players influence not only their own objective functions, but also those of other players. This is in contrast with standard single-objective optimization problems, where only a single control input (decision variable) is optimized. At each stage of a dynamic game, all players select their strategies. Each player’s action affects its own payoff and also the payoffs of the other players. In order to make good decisions and optimize its payoff, each player must choose a strategy that is optimal given the strategies of all the other players. Thus, unlike standard optimization problems—where each objective is treated separately and optimized with respect to its own variables—in dynamic games the control is exerted over a class of functions that jointly affect all players’ objectives and must be optimized simultaneously. This leads naturally to the concept of a Nash equilibrium [ 18 ] . Computing Nash equilibria in dynamic games is challenging. Classical approaches rely on dynamic programming, Riccati equations in linear–quadratic (LQ) settings, or first-order necessary conditions, and they become increasingly intractable as the dimension of the state space, the number of players, and the time horizon grow [ 1 ] . Moreover, these methods are tightly coupled to specific model structures (e.g., linear dynamics and quadratic costs), whereas many modern applications in networked systems, intelligent transportation, and cyber-physical systems exhibit nonlinear, hybrid, or data-driven dynamics [ 21 , 22 , 23 ] . In parallel, evolutionary computation and swarm intelligence have been successfully applied to a wide range of optimization problems in signal processing [ 43 ] , communications and antennas [ 40 , 50 ] , control systems [ 47 , 44 , 46 , 45 ] , cloud and distributed computing [ 53 , 52 ] , and smart grids or energy systems [ 24 ] . These successes motivate the use of evolutionary algorithms for dynamic games, where the goal is to search over joint strategy spaces rather than single-objective design variables. 1.1 Definition of an N -Player Dynamic Game Definition 1. Consider an N -player discrete-time dynamic game with a finite and known time horizon K\in\mathbb{N} . Such a game is characterized by: • A set of players: \mathcal{N}=\{1,2,\dots,N\} . • A finite set of stages: \mathcal{K}=\{0,1,\dots,K\} , where K is the maximum number of moves (stages). • The system dynamics: x_{k+1}=f_{k}\big(x_{k},u_{1,k},\dots,u_{N,k}\big),\quad k=0,\dots,K-1, (1) where x_{k} is the state at stage k , and u_{i,k} is the control (action) of player i at stage k . • For each player i\in\mathcal{N} , a control sequence (strategy) over the horizon: u_{i}=\{u_{i,0},u_{i,1},\dots,u_{i,K-1}\}. (2) • An information structure for each player, specifying what information is available at each stage. Depending on the information pattern, different solution concepts and equilibrium points may arise. A global Nash equilibrium typically assumes complete information about the system and the objective functions of all players. • For each player i , a cost (or payoff) function over the horizon: J_{i}(u_{1},\dots,u_{N})=\sum_{k=0}^{K-1}g_{i,k}\big(x_{k},u_{1,k},\dots,u_{N,k}\big)+h_{i}(x_{K}), (3) where g_{i,k} and h_{i} encode the running and terminal costs (or rewards). We denote by u_{-i} the collection of strategies of all players except player i . 1.2 Nash Equilibrium Definition 2. A strategy profile u^{\star}=(u^{\star}_{1},\dots,u^{\star}_{N}) is a (feedback) Nash equilibrium of the game if and only if, for every player i\in\mathcal{N} , J_{i}\big(u^{\star}_{i},u^{\star}_{-i}\big)\leq J_{i}\big(u_{i},u^{\star}_{-i}\big),\quad\forall\,u_{i}. (4) In words, given that all other players use u^{\star}_{-i} , player i cannot improve its cost (or payoff) by unilaterally deviating from u^{\star}_{i} . Search techniques for Nash equilibria are often derived from this definition. A Nash equilibrium satisfies the necessary optimality conditions for each player conditional on the strategies of other players. In general, however, for dynamic games with nonlinear dynamics, nonlinear objective functions, and many players and stages, classical methods (e.g., solving first-order necessary optimality conditions) become difficult to implement and may converge only to local equilibria [ 4 , 12 , 13 ] . Moreover, many classical methods rely on restrictive assumptions and approximations (e.g., linearization), and one cannot always claim that they find the true global Nash equilibrium. These limitations have motivated the development of evolutionary and learning-based methods for computing Nash equilibria in more complex games, including coevolutionary strategies [ 12 , 14 ] and hybrid metaheuristics [ 2 , 3 ] . 2 Evolutionary Approaches to Dynamic Games Evolutionary game theory and computational intelligence-based methods provide flexible tools for computing equilibria in dynamic games without strong structural assumptions. Genetic algorithms (GAs) and particle swarm optimization (PSO) are two well-established evolutionary methods that can be adapted to search for Nash equilibria [ 17 , 10 , 11 , 9 ] . A key advantage of these approaches is that they can be applied to a broad class of problems, regardless of: • Linear or nonlinear dynamics, • Number of players or stages, • Shape of the objective functions. In contrast, many mathematical solution methods are effective only for particular game structures. For example, dynamic programming and Riccati-equation-based methods are typically limited to linear–quadratic dynamic games [ 1 , 18 ] . Similar ideas have already proven effective in a wide range of pattern recognition and computer vision tasks, such as face detection and recognition [ 28 , 32 , 29 , 30 ] , surface geodesic pattern analysis [ 27 ] , offline signature verification and palmprint recognition [ 19 , 34 ] , and dynamic texture modeling [ 25 ] . In biomedical and healthcare applications, evolutionary and deep models have been used for disease prediction [ 31 ] , diabetes therapy initiation [ 26 ] , cardiac arrhythmia detection [ 49 ] , fungal image analysis [ 35 ] , COVID-19 screening and related software tools [ 33 , 36 , 51 ] , and robust machine learning toolkits [ 38 ] . These diverse applications highlight the robustness of evolutionary and learning-based optimization when dealing with high-dimensional, noisy, or non-convex search spaces. In this paper, we present two population-based evolutionary methods: 1. A co-evolutionary genetic algorithm (GA) for Nash