Stochastic maximum principle for optimal control problem of non exchangeable mean field systems
Idris Kharroubi, Samy Mekkaoui, Huyên Pham · 2025
Read Stochastic maximum principle for optimal control problem of non exchangeable mean field systems by Idris Kharroubi, Samy Mekkaoui, Huyên Pham (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-05595.txt.
Introduction
Idris Kharroubi, Samy Mekkaoui, and Huyên Pham derive rules for best control in large interacting systems, in this 2025 math paper. Mean field systems model crowds of agents who sway each other through average effects. Here the agents are not interchangeable: each pair links in its own way, with strengths that need not match in both directions. That messier setup fits real networks better than the tidy standard case.
The authors prove a stochastic maximum principle, giving tests that a best control must pass and tests that prove one is best. The tests take the form of linked forward and backward equations for the whole crowd. They show these equations can be solved under stated conditions. A simpler linear case then yields the best control through a large system of Riccati equations.
Catalog record
| CREATOR | Idris Kharroubi, Samy Mekkaoui, Huyên Pham |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 119 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-05595
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Stochastic maximum principle for optimal control problem of non exchangeable mean field systems Idris Kharroubi, Samy Mekkaoui, Huyên Pham Abstract We study the Pontryagin maximum principle by deriving necessary and sufficient conditions for a class of optimal control problems arising in non exchangeable mean field systems, where agents interact through heterogeneous and asymmetric couplings. Our analysis leads to a collection of forward-backward stochastic differential equations (FBSDE) of non exchangeable mean field type. Under suitable assumptions, we establish the solvability of this system. As an illustration, we consider the linear-quadratic case, where the optimal control is characterized by an infinite dimensional system of Riccati equations. MSC Classification : 49N80; 60K35; 93E20. Key words : Pontryagin maximum principle; mean-field FBSDE; heterogeneous interactions; non-exchangeable systems; linear-quadratic graphon optimal control. 1 Introduction The study of large population and complex systems is a central question in mathematical modeling with wide-ranging applications in modern society, including social networks, power grid infrastructures, financial markets, and lightning networks. The analysis of such systems has given rise to models in which the representative state of an agent depends on its own distribution, leading to the class of McKean-Vlasov (MKV) equations. These equations have been extensively studied in the context of mean-field game (MFG) or mean-field control (MFC). We refer the reader to the seminal lectures of P.L. Lions [ 2 ] and the comprehensive monographs by Carmona and Delarue [ 11 , 12 ] , which introduce the foundational mathematical tools for these problems, such as Itô’s calculus along flow of probability measures, stochastic maximum principle, MKV-type FBSDEs, and the Master Bellman equation in the Wasserstein space. In this paper, motivated by the modeling of more complex networks, we focus on large-scale systems of agents with asymmetric and heterogeneous interactions, leading to non exchangeable systems. Recent years have witnessed a growing interest in such models, notably via the graphon framework introduced by Lovász in [ 7 ] , and later explored in the context of heterogeneous mean-field systems in [ 3 , 6 , 8 , 13 ] . More recently, in the setting of optimal control, new general frameworks have emerged where the interactions are modelled via the full collection of marginal laws of all agents without necessarily assuming a specific graphon-type structure. This generalization leads to the study of a new class coupled systems with non-exchangeable interactions \displaystyle\mathrm{d}X_{t}^{u} \displaystyle=\;b(u,X_{t}^{u},(\mathbb{P}_{X_{t}^{v}})_{v\in I},\alpha_{t}^{u})\mathrm{d}t+\sigma(u,X_{t}^{u},(\mathbb{P}_{X_{t}^{v}})_{v\in I},\alpha_{t}^{u})\mathrm{d}W_{t}^{u},\quad u\in I=[0,1],\;t\in[0,T]. (1.1) In the context of MFC, we are then looking for a collection of control processes \alpha=(\alpha^{u})_{u\in I} to minimize the following cost functional over a finite horizon T J(\alpha)=\int_{I}\mathbb{E}\Big[\int_{0}^{T}f(u,X_{t}^{u},(\mathbb{P}_{X_{t}^{v}})_{v},\alpha_{t}^{u})\mathrm{d}t+g\big(u,X_{T}^{u},(\mathbb{P}_{X_{T}^{v}})_{v}\big)\Big]\mathrm{d}u. (1.2) Such control problem has recently been studied by a dynamic programming approach in [ 4 ] . This leads to a master equation on the space L^{2}({\cal P}_{2}(\mathbb{R}^{d})) , consisting of collections (\mu^{u})_{u\in I} of square integrable probability measures on \mathbb{R}^{d} s.t \int_{I}\int_{\mathbb{R}^{d}}|x|^{2}\mu^{u}(dx)du<+\infty . Since the Pontryagin maximum principle provides a natural and complementary method for analyzing stochastic control problems [ 9 , 10 ] , this motivated our investigation of its formulation in the context of non-exchangeable mean field systems. Due to the heterogeneity among agents, encoded in the collection of SDEs ( 1.1 ), we are naturally led, to study a family of FBSDEs indexed by u \in I , in contrast to classical mean-field models that can be summed up into a single FBSDE (see [ 19 ] ). Such a family of FBSDEs has been considered by [ 16 ] in the context of linear graphon-based interactions. Very recently, and independently of our current work, the paper [ 17 ] has extended this study from a control perspective by Pontryagin maximum principle in the case of nonlinear graphon-based interactions, i.e., the coefficients b,\sigma depend on the collection of laws only through a graphon-weighted sum. In this work, we address the general case of non exchangeable systems as in ( 1.1 ). A particularly notable subclass of optimal control problems within the Pontryagin maximum principle framework arises when the controlled dynamics is linear and the cost functional is quadratic. In the classical mean-field setting, existence and uniqueness results for the corresponding FBSDE systems are well established (see [ 19 ] ). This leads to the so-called linear-quadratic mean-field (LQ-MF) control framework, which has been widely studied due to its analytical tractability and broad applicability [ 18 , 5 , 15 ] . More recently, the work [ 1 ] extended this theory to the linear-quadratic non-exchangeable mean-field (LQ-NEMF) setting, where heterogeneity in interactions is explicitly modeled. This generalization introduces a new class of infinite-dimensional Riccati equations that capture the structure of non-exchangeable interactions and opens the door to novel applications. Our work and contributions. In the spirit of classical mean-field control, we formulate the Pontryagin maximum principle for non-exchangeable systems of interacting agents, where the state process X=(X^{u})_{u\in I} evolves according to the dynamics ( 1.1 ), and the optimality criterion is given by the cost functional ( 1.2 ). This leads us to introduce the associated Hamiltonian function \displaystyle H(u,x,(\mu^{v})_{v},y,z,a) \displaystyle:=\;b(u,x,(\mu^{v})_{v},a)\cdot y+\sigma(u,x,(\mu^{v})_{v},a):z+f(u,x,(\mu^{v})_{v},a), (1.3) where (Y,Z)=(Y^{u},Z^{u})_{u\in I} are solution to the following collection of adjoint equations \left\{\begin{aligned} \mathrm{d}Y_{t}^{u}&=\;-\partial_{x}H(u,X_{t}^{u},(\mathbb{P}_{X_{t}^{v}})_{v},Y_{t}^{u},Z_{t}^{u},\alpha_{t}^{u})dt+Z_{t}^{u}\mathrm{d}W_{t}^{u}\\ &\qquad-\;\int_{I}\mathbb{\tilde{E}}\Big[\partial\frac{\delta}{\delta m}H(\tilde{u},\tilde{X}_{t}^{\tilde{u}},(\mathbb{P}_{X_{t}^{v}}),\tilde{Y}_{t}^{\tilde{u}},\tilde{Z}_{t}^{\tilde{u}},\tilde{\alpha}_{t}^{\tilde{u}})(u,X_{t}^{u})\Big]\mathrm{d}\tilde{u}\mathrm{d}t,\\ Y_{T}^{u}&=\;\partial_{x}g\big(u,X_{T}^{u},(\mathbb{P}_{X_{T}^{v}})_{v}\big)+\int_{I}\mathbb{\tilde{E}}\Big[\partial\frac{\delta}{\delta m}g\big(\tilde{u},\tilde{X}_{T}^{\tilde{u}},(\mathbb{P}_{X_{T}^{v}})_{v}\big)(u,X_{T}^{u})\Big]\mathrm{d}\tilde{u},\\ \end{aligned}\right. (1.4) where (\tilde{X},\tilde{Y},\tilde{Z},\tilde{\alpha}) is an independent copy of (X,Y,Z,\alpha) defined on another probability space (\tilde{\Omega},\tilde{{\cal F}},\tilde{\mathbb{P}}) . Here \frac{\delta}{\delta m} and \partial\frac{\delta}{\delta m} stand for the linear functional derivative and his gradient and will be precised in the sequel. Our objective is to characterize the optimal control via a pointwise minimization of the Hamiltonian H . To this end, we introduce a suitable notion of convexity for functions defined on the space L^{2}({\cal P}_{2}(\mathbb{R}^{d})) and assume this property for both H and the terminal cost g . Under these assumptions, we establish a necessary and sufficient condition for a control \alpha=(\alpha^{u})_{u\in I} to be optimal. The characterization, in turn, leads to the study of a collection of FBSDEs of the following form \left\{\begin{aligned} \mathrm{d}X_{t}^{u}&=\;b(u,X_{t}^{u},(\mathbb{P}_{X_{t}^{v}})_{v},\hat{\alpha}_{t}^{u})\mathrm{d}t+\sigma(u,X_{t}^{u},(\mathbb{P}_{X_{t}^{v}})_{v},\hat{\alpha}_{t}^{u})\mathrm{d}W_{t}^{u},\\ dY_{t}^{u}&=\;-\bigg[\partial_{x}H(u,X_{t}^{u},(\mathbb{P}_{X_{t}^{v}})_{v},Y_{t}^{u},Z_{t}^{u},\hat{\alpha}_{t}^{u})+\int_{I}\mathbb{\tilde{E}}\Big[\partial\frac{\delta}{\delta m}H(\tilde{u},\tilde{X}_{t}^{\tilde{u}},(\mathbb{P}_{X_{t}^{v}})_{v},\tilde{Y}_{t}^{\tilde{u}},\tilde{Z}_{t}^{\tilde{u}},\tilde{\hat{\alpha}}_{t}^{\tilde{u}})(u,X_{t}^{u})\Big]\mathrm{d}\tilde{u}\bigg]\mathrm{d}t\\ &\qquad+\;Z_{t}^{u}\mathrm{d}W_{t}^{u},\\ X_{0}^{u}&=\;\xi^{u},\\ Y_{T}^{u}&=\;\partial_{x}g(u,X_{T}^{u},(\mathbb{P}_{X_{T}^{v}})_{v})+\int_{I}\mathbb{\tilde{E}}\Big[\partial\frac{\delta}{\delta m}g(\tilde{u},\tilde{X}_{T}^{\tilde{u}},(\mathbb{P}_{X_{T}^{v}})_{v})(u,X_{T}^{u})\Big]\mathrm{d}\tilde{u},\end{aligned}\right. (1.5) where \hat{\alpha}_{t}^{u}=\hat{\mathrm{a}}(u,X_{t}^{u},(\mathbb{P}_{X_{t}^{v}})_{v},Y_{t}^{u},Z_{t}^{u}) for a Borel measurable function \hat{\mathrm{a}} defined on I\times\mathbb{R}^{d}\times L^{2}({\cal P}_{2}(\mathbb{R}^{d}))\times\mathbb{R}^{d}\times\mathbb{R}^{d\times n} . Under standard assumptions on the model coefficients, and by introducing a suitable solution space for the collection of FBSDE ( 1.5 ), we establish the existence and uniqueness of solutions. We would like to emphasize that the well posedness of the control problem and the related family of FBSDEs require a suitable definition of admissible controls, specifically in terms of measurability with respect to the label. In particular, we pay a careful attention to check that the derived optimal controls satisfy the admissibility condition. Finally, we illustrate our methodology in the linear-quadratic setting and prove the consistency of our stochastic maximum principle with the dynamic programming approach (see [ 1 ] ). Outline of the paper. The structure of the paper is as follows. In Section 2, we formulate the mean-field control problem for non-exchangeable systems. Section 3 introduces key preliminaries on functions defined over the space L^{2}({\cal P}_{2}(\mathbb{R}^{d})) , which are essential for the subsequent analysis. In Section 4, we derive necessary and sufficient optimality conditions using the stochastic maximum principle, under suitable regularity and convexity assumptions. This leads to the study of a collection of FBSDE of non-exchangeable mean-field type. Section 5 is devoted to establishing existence and uniqueness