A Mean Field Games Perspective on Evolutionary Clustering
Alessio Basti, Fabio CamilliAdriano Festa · 2026
Read A Mean Field Games Perspective on Evolutionary Clustering by Alessio Basti, Fabio CamilliAdriano Festa (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-27137.txt.
Introduction
Basti and co-authors frame evolutionary clustering as a quasi-stationary mean field game. Each cluster is a probability density moved by a Fokker-Planck equation. A stationary Hamilton-Jacobi equation supplies the velocity field for each density. The setup fixes the number of clusters but not their shapes. For Gaussian clusters, affine rules reproduce classic expectation-maximization paths exactly. Time-averaged likelihood goals improve smoothness when clusters overlap or noise intrudes. A density-based version handles non-Gaussian parts as well. Tests compare against snapshot and smoothed EM rivals.
Catalog record
| CREATOR | Alessio Basti, Fabio CamilliAdriano Festa |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 58844 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.27137
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
A Mean Field Games Perspective on Evolutionary Clustering Alessio Basti, Fabio CamilliAdriano Festa Abstract We propose a control-theoretic framework for evolutionary clustering based on Mean Field Games (MFG). Moving beyond static or heuristic approaches, we formulate the problem as a population dynamics game governed by a coupled Hamilton-Jacobi-Bellman and Fokker-Planck system. Driven by a variational cost functional rather than predefined statistical shapes, this continuous-time formulation provides a flexible basis for non-parametric cluster evolution. To validate the framework, we analyze the setting of time-dependent Gaussian mixtures, showing that the MFG dynamics recover the trajectories of the classical Expectation-Maximization (EM) algorithm while ensuring mass conservation. Furthermore, we introduce time-averaged log-likelihood functionals to regularize temporal fluctuations. Numerical experiments illustrate the stability of our approach and suggest a path toward more general non-parametric clustering applications where traditional EM methods may face limitations. AMS-Subject Classification: 62H30, 35K55, 49N80 . Keywords: Cluster Analysis; Expectation Maximization algorithm; Mean Field Games . 1 Introduction Clustering lies at the heart of unsupervised learning, where the goal is to group data points into coherent subpopulations: points within the same group share high similarity, while those in different groups remain dissimilar. Classical approaches employ finite mixture models, flexible statistical representations that express data as weighted sums of distributions, most commonly Gaussian, and rely, for example, on the Expectation–Maximization (EM) algorithm for parameter estimation. These methods enable soft clustering and probabilistic interpretations (see [ 3 , 4 ] ). While these techniques are usually applied in static contexts, many modern applications, spanning from social network dynamics to real-time signal processing, require detecting clusters that evolve over time. Although diverse discrete evolutionary clustering methods have been proposed, such as repeated EM and temporal regularization, they often lack a unifying theoretical framework in the continuous setting [ 2 , 8 , 11 , 22 ] . Drawing inspiration from recent efforts to reinterpret machine learning via differential geometry, dynamical systems, and optimal control [ 9 , 10 , 13 , 15 , 14 , 18 ] , we establish a common control-theoretic framework that recasts evolutionary clustering through the lens of Mean Field Games (MFG). MFG theory has emerged as a powerful framework to describe the collective behavior of large populations of interacting agents. Originally introduced independently by Jean-Michel Lasry and Pierre-Louis Lions [ 17 ] , and by Minyi Huang, Roland Malhamé and Peter E. Caines [ 16 ] , the theory provides a continuum description of strategic interactions when the number of agents tends to infinity. In this limit, individual decisions are encoded through a Hamilton–Jacobi equation, while the collective evolution of the population is described by a Fokker–Planck equation. Beyond its original applications in economics and control, MFG theory has recently found connections with machine learning, optimal transport, and large-scale optimization problems, where learning dynamics can be interpreted as gradient flows or mean-field limits of interacting particles [ 1 , 7 , 5 , 20 , 23 ] . In this sense, evolutionary clustering fits naturally within this perspective: it can be viewed as a controlled mean-field evolution in which clusters emerge as stable population patterns driven by an optimality principle. Indeed, clustering can be interpreted as a collective organization process: data points adapt their state according to a cost that balances data fidelity and interaction with the overall distribution. The MFG formalism captures this interplay between microscopic optimization and macroscopic density evolution. Moreover, unlike classical EM-type methods that rely on fixed parametric families, the MFG framework is intrinsically non-parametric, since the unknowns are probability densities evolving in time under variational principles. Hence, a key contribution of this paper is to bridge the gap between heuristic discrete methods and rigorous population dynamics, thereby enabling new extensions in both parametric and non-parametric clustering frameworks. The remainder of the paper is structured to detail these findings. In Section 2 , we introduce the general non-parametric MFG framework for multi-population dynamics. In Section 3 , we validate this framework by restricting our analysis to time-dependent Gaussian mixtures, providing a rigorous mathematical demonstration of its equivalence with the classic EM algorithm. Finally, we introduce time-averaged log-likelihood functionals to handle short-term fluctuations and, in Section 4 , present numerical experiments that confirm the validity of our approach in the Gaussian case. 2 Non-Parametric Mean Field Games Framework We represent the dataset at time t\in[0,T] as a probability density f(\cdot,t) mapping \mathbb{R}^{d} into (0,\infty) . The mixture m is composed of K components expressed as m(x,t)=\sum_{k=1}^{K}\alpha_{k}(t)m_{k}(x,t),\qquad\alpha(t)=(\alpha_{1}(t),\dots,\alpha_{K}(t))\in\mathcal{T}_{K}, (2.1) where m_{k} are the cluster densities and \mathcal{T}_{K} is the unit simplex. The weights \alpha_{k}(t) describe the proportion of the total population associated with the k -th component at time t . We highlight that the reference density f(x,t) is assumed to be given and represents the observed data distribution at time t , while the mixture m(x,t) approximates f by evolving according to controlled dynamics. By on Bayes’ theorem, we introduce the probabilities \gamma_{k} (also known as responsibilities ) that each data point belongs to a given latent component k of the mixture, indicating how much each component contributes to generating that observation, i.e. \gamma_{k}(x,t)=\dfrac{\alpha_{k}(t)m_{k}(x,t)}{m(x,t)},\qquad x\in\mathbb{R}^{d},\,t\in[0,T],\,k=1,\dots,K. (2.2) These responsibilities can be used to divide the dataset into clusters by setting: C_{k}(t)=\left\{x\in\mathbb{R}^{d}\;\middle|\;\gamma_{k}(x,t)=\max_{j=1,\dots,K}\gamma_{j}(x,t)\right\}. To compute the densities m_{k} and the weights \alpha_{k} , we consider a quasi-stationary MFG. In contrast to standard MFGs, where agents anticipate the future evolution of the population, the quasi-stationary setting assumes agents react only to the current population state. This makes the model particularly suitable for online or slowly varying data (see [ 19 ] ). In this setting, each data point is viewed as a controlled stochastic agent. The state X_{t} of an agent in the k -th cluster evolves according to: dX_{t}=a(X_{t})\,dt+\sqrt{2\varepsilon}\,dW_{t},\quad X_{0}=x, (2.3) where a is the control, \varepsilon>0 is the diffusion coefficient, and W_{t} denotes a standard Wiener process. We assume that, at each time instant t , the agent belonging to the k -th population optimizes a cost functional J_{k}(x,a;t) using the information available at the present time, where J_{k}(x,a;t)=\lim_{S\to+\infty}\frac{1}{S}\mathbb{E}_{x}\left[\int_{t}^{S}\left(L(\tilde{X}_{s},a(\tilde{X}_{s}))+F_{k}(\tilde{X}_{s},m(\cdot,t))\right)ds\right], (2.4) where L is a Lagrangian cost, and F_{k} is the interaction term coupling the agent’s state with the distribution of the population, \tilde{X} refers to a (fictitious) dynamics of type ( 2.3 ) starting at time t . The optimal control a obtained by optimizing this functional is then incorporated into dynamics ( 2.3 ) [ 19 ] . Note that, in ( 2.4 ), the distribution m is frozen at the current time t . Therefore, agents do not anticipate its future evolution, but instead optimize their configuration based solely on the information available at that time. To bridge the microscopic dynamics with the macroscopic description, we introduce the Hamiltonian H via the Legendre transform of the Lagrangian: H(x,p)=\sup_{a\in\mathbb{R}^{d}}\left\{-p\cdot a-L(x,a)\right\}. Under the quasi-stationary assumption, agents solve a stationary optimization problem at each time t , while the densities m_{k} evolve according to the optimal drift -\partial_{p}H(x,Du_{k}) , where the notation \partial_{p}H denotes the derivative of H with respect to the momentum p . The resulting coupled system is given by: \left\{\begin{array}[]{ll}-\varepsilon\Delta u_{k}(x,t)+H\big(x,Du_{k}(x,t)\big)+\lambda_{k}(t)=F_{k}\big(x,m(\cdot,t)\big),\\[6.0pt] \partial_{t}m_{k}(x,t)-\varepsilon\Delta m_{k}(x,t)-\operatorname{div}\!\big(m_{k}(x,t)\,\partial_{p}H(x,Du_{k}(x,t))\big)=0,\\[6.0pt] \alpha_{k}(t)=\int_{\mathbb{R}^{d}}\gamma_{k}(x,t)\,f(x,t)\,dx,\\[6.0pt] m_{k}(x,0)=m_{k,0}(x),\qquad\min_{x\in\mathbb{R}^{d}}u_{k}(x,t)=0,\end{array}\right\}_{\forall\,k=1,\dots,K} (2.5) where u_{k} is the ergodic value function, and \lambda_{k}(t)\in\mathbb{R} is the ergodic constant. It is worth noticing that the responsibilities \gamma_{k} couple