Predictive Compensation in Finite–Horizon LQ Games under Gauss–Markov Deviations footnoteinfo

Navid Mojahed, Mahdis Rabbani, Shima Nazari · 2025

Read Predictive Compensation in Finite–Horizon LQ Games under Gauss–Markov Deviations footnoteinfo by Navid Mojahed, Mahdis Rabbani, Shima Nazari (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-03744.txt.

Introduction

Navid Mojahed, Mahdis Rabbani, and Shima Nazari build predictive compensation for two-player control games where one side's actions get corrupted by lingering noise. The setting is a finite-horizon linear quadratic game, where each player pursues a cost goal against the other. Deviations from equilibrium play follow a Gauss-Markov pattern with memory from step to step.

The clean player, seeing past deviations as they happen, feeds forward a prediction of their future effect. Closed-form recursions track mean and spread under that compensated loop, with boundedness and sensitivity results to match. Cost savings from optimal prediction are characterized and confirmed in simulations. Robotic and vehicle contests with sloppy actuators fit the frame well.

Catalog record

CREATORNavid Mojahed, Mahdis Rabbani, Shima Nazari
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE41 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-03744

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Predictive Compensation in Finite–Horizon LQ Games under Gauss–Markov Deviations footnoteinfo Navid Mojahed, Mahdis Rabbani, Shima Nazari Abstract This paper develops a predictive compensation framework for finite–horizon, discrete–time linear quadratic dynamic games subject to Gauss–-Markov execution deviations from feedback Nash strategies. One player’s control is corrupted by temporally correlated stochastic perturbations modeled as a first–order autoregressive (AR(1)) process, while the opposing player has causal access to past deviations and employs a predictive feedforward strategy that anticipates their future effect. We derive closed–form recursions for mean and covariance propagation under the resulting perturbed closed loop, establish boundedness and sensitivity properties of the equilibrium trajectory, and characterize the reduction in expected cost achieved by optimal predictive compensation. Numerical experiments corroborate the theoretical results and demonstrate performance gains relative to nominal Nash feedback across a range of disturbance persistence levels. keywords Linear Quadratic; Dynamic Games; Nash Equilibrium; Game Theory; Predictive Compensation; Gauss–Markov Processes; Robust Control. † † thanks: [ † † address: Department of Mechanical and Aerospace Engineering, University of California, Davis, CA 95616, USA. footnoteinfo]This paper was not presented at any IFAC meeting. Corresponding author Navid Mojahed. E-mail [email protected]. , , 1 Introduction Linear quadratic dynamic games provide a canonical framework for analyzing multi-agent decision-making with coupled dynamics and cost functions. A central concept is the Nash equilibrium, where no player benefits from unilateral deviation [ 2 , 15 ] . Classical treatments establish the existence and characterization of feedback Nash strategies and coupled Riccati recursions for finite-horizon settings [ 8 , 11 ] , while recent work has revisited scalable or data-driven computation of (approximate) feedback Nash equilibria in discrete time [ 16 , 17 ] . Beyond model-based schemes, learning-based methods, such as Q-learning tailored to LQ games, have been shown to recover feedback Nash strategies without explicit models; see, for example, the finite-horizon, nonzero-sum difference-game formulation in [ 28 ] , which we also use as our numerical benchmark. Dynamic games serve as foundational models for strategic interactions in multi-agent systems, spanning autonomous driving and motion planning [ 6 ] to coordination and learning in networked decision systems [ 14 ] . In such applications, equilibrium feedback policies provide a principled mechanism for anticipating other agents’ actions and maintaining mutual consistency among strategies. However, when these theoretical policies are deployed on physical systems, implementation imperfections, such as actuator lag, saturation, quantization, and communication delay, can distort the intended control inputs. As a result, the realized behavior may deviate systematically from the nominal Nash trajectory. Existing treatments of uncertainty in dynamic games, including \varepsilon -equilibria, robust or risk-sensitive formulations, and soft-constrained formulations [ 23 , 10 , 1 , 9 , 12 , 25 , 26 ] , have primarily focused on model or observation uncertainty and often idealize execution errors as white and memoryless. Yet, in practice, these disturbances are typically temporally correlated, reflecting actuator dynamics or communication holdover, and neglecting this correlation can significantly degrade closed-loop performance and robustness margins, even when the nominal equilibrium ensures internal stability. Our prior work examined optimal compensation for LQ games under deterministic execution errors [ 18 ] , establishing a baseline for quantifying and mitigating equilibrium deviations arising from imperfect actuation. Building on that framework, the present study extends the analysis to stochastic and temporally correlated disturbances modeled as first-order Gauss–Markov (AR(1)) processes. The AR(1) model, a standard representation of colored noise in stochastic control and estimation [ 13 , 4 , 5 , 20 ] , captures the persistence and memory effects inherent in real actuation channels. Specifically, we analyze a discrete-time, finite-horizon, two–player, nonzero–sum LQ game in which Player 2’s applied input departs from its Nash feedback law by an AR(1) deviation. We derive closed-form recursions characterizing the evolution of second-order moments as the deviation propagates through the time-varying closed loop, revealing analytically that both state covariance and cost inflation scale quadratically with the steady-state per-channel standard deviation, \mathcal{O}(\sigma_{0}^{2}) , and increase monotonically with the persistence factor \rho . Finally, leveraging the one-step-ahead predictor inherent to the AR(1) structure, we propose a causal predictive compensation strategy for Player 1 that proactively mitigates the expected cost. This compensation strategy is conceptually related to preview and feedforward control [ 24 ] , but developed here for game-theoretic LQ settings. Contributions. (i) A moment-based sensitivity framework for discrete-time finite-horizon LQ Nash games subject to AR(1) execution deviations, including explicit coupled recursions for the state covariance and state–deviation cross-covariance. (ii) Norm- and trace-based bounds that certify \mathcal{O}(\sigma_{0}^{2}) scaling of the state covariance and establish monotone growth of cost sensitivity with the persistence factor \rho . (iii) A causal predictive compensation law for Player 1 that exploits past deviation measurements through the AR(1) structure and, under mild assumptions, strictly reduces the expected cost relative to a no-compensation baseline under the same AR(1) deviations, validated through Monte Carlo simulations. Paper Outline. Section 2 formalizes the finite-horizon LQ game and the feedback Nash equilibrium. Section 3 introduces the AR(1) execution-deviation model and develops the deviation-propagation recursions and cost-sensitivity bounds. Section 4 presents the predictive compensator design and its analysis. Section 5 reports numerical results, and Section 6 concludes with future directions. 2 Problem Formulation & Background Consider a discrete-time, finite-horizon, two-player nonzero-sum linear quadratic (LQ) dynamic game. This section presents the nominal system dynamics, the cost functions of the players, and the resulting feedback Nash equilibrium under perfect execution. Notation. For a matrix A\in\mathbb{R}^{n\times m} , the spectral norm is denoted as \|A\|_{2}:=\sigma_{\max}(A) , where \sigma_{\max}(A) is the largest singular value of A , and the Frobenius norm is represented by \|A\|_{F}:=\sqrt{\mathrm{tr}(A^{\top}A)} , where \mathrm{tr}(\cdot) denotes the trace. For symmetric A,B , we write A\succ 0 ( \succeq 0 ) if A is positive (semi)definite, and A\succ B ( \succeq B ) if A-B is positive (semi)definite. The spectral radius of a matrix is denoted by \varrho(\cdot) . An asterisk ∗ denotes that the variable belongs to the nominal Nash equilibrium; for instance, x_{k}^{*} , u_{i,k}^{*} , and J_{i}^{*} , represent the nominal Nash equilibrium state, control, and cost for Player i , respectively. The subscript -i refers to all players except Player i . For a random variable or stochastic process, \mathbb{E}[\cdot] and \Var[\cdot] denote its expectation and variance, respectively. Game Model. We study the discrete-time LQ dynamic game x_{k+1}=Ax_{k}+B_{1}u_{1,k}+B_{2}u_{2,k},\quad k=0,\ldots,N-1, (1) where x_{k}\in\mathbb{R}^{n} is the joint states of the game, u_{i,k}\in\mathbb{R}^{m_{i}} is the control of Player i\in\{1,2\} , and the initial joint states x_{0} is given. The system matrices satisfy A\in\mathbb{R}^{n\times n} , and B_{i}\in\mathbb{R}^{n\times m_{i}} , with n number of joint states and m_{i} number of the control inputs of Player i . Each player i minimizes the quadratic cost J_{i}=\sum_{k=0}^{N-1}\big(x_{k}^{\top}Q_{i}x_{k}+u_{i,k}^{\top}R_{i}u_{i,k}\big)+x_{N}^{\top}Q_{i,N}x_{N}, (2) where Q_{i},\,Q_{i,N}\succeq 0 , and R_{i}\succ 0 are stage and terminal weights. Assumption 1 For each i\in\{1,2\} , the weighting matrices satisfy Q_{i},\,Q_{i,N}\succeq 0 , and R_{i}\succ 0 . The positive definiteness of R_{i} ensures well-posedness of the Nash feedback law. Definition 1 A pair of contol inputs \{(u^{*}_{1,k},\,u^{*}_{2,k})\}_{k=0}^{N-1} with u^{*}_{i,k}=-K^{*}_{i,k}\,x_{k},\quad i\in\{1,2\}, (3) is a feedback Nash equilibrium if, for each Player i , \displaystyle J_{i}\bigl(x_{0},\{u^{*}_{i,k}\}_{k=0}^{N-1}, \displaystyle\{u^{*}_{-i,k}\}_{k=0}^{N-1}\bigr)\; \displaystyle\leq\;J_{i}\bigl(x_{0},\{u_{i,k}\}_{k=0}^{N-1},\{u^{*}_{-i,k}\}_{k=0}^{N-1}\bigr), for all admissible control sequences \{u_{i,k}\}_{k=0}^{N-1} . Under Nash equilibrium gains \{K^{*}_{1,k},\,K^{*}_{2,k}\}_{k=0}^{N-1} , the closed-loop system evolves as x_{k+1}^{*}=A_{\mathrm{cl},k}\,x_{k}^{*},\quad A_{\mathrm{cl},k}:=A-B_{1}K^{*}_{1,k}-B_{2}K^{*}_{2,k}. (4) Assumption 2 For

Read the complete text