Oscillating solutions to the mean-field Langevin descent-ascent flow

Jean-Christophe Mourrat, Loucas Pillaud-Vivien · 2026

Read Oscillating solutions to the mean-field Langevin descent-ascent flow by Jean-Christophe Mourrat, Loucas Pillaud-Vivien (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-11134.txt.

Introduction

Mourrat and Pillaud-Vivien present a counterexample to mean-field Langevin descent-ascent flow convergence. They consider payoff functions forming a double well in each coordinate, for which deterministic dynamics admits a limit cycle. When coupling between the two coordinates is strong and entropic regularization small, the mean-field dynamics stays close to this cyclic behaviour, and does not converge. The result shows that mean-field Langevin descent-ascent flow can fail to converge even under strong coupling and weak regularization, contradicting the convergence statement.

Catalog record

CREATORJean-Christophe Mourrat, Loucas Pillaud-Vivien
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE36618
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.11134

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Oscillating solutions to the mean-field Langevin descent-ascent flow Jean-Christophe Mourrat, Loucas Pillaud-Vivien Abstract . We present a counterexample to the statement of convergence of the mean-field Langevin descent-ascent flow on ℝ 2 \mathbb{R}^{2} . We consider payoff functions that are shaped as a double well in each coordinate, and for which the deterministic dynamics admits a limit cycle. When the coupling between the two coordinates is sufficiently strong and the entropic regularization sufficiently small, we show that the mean-field dynamics remains close to this cyclic behavior, and in particular, does not converge. 1. Introduction A natural procedure for finding a saddle point of a function f:\mathbb{R}^{d}\times\mathbb{R}^{d}\to\mathbb{R} is to iteratively take small steps in the direction of (-\nabla_{x}f,\nabla_{y}f) . In the limit of infinitesimally small steps, we obtain a continuous dynamics called the gradient descent-ascent flow. It is well known that this gradient descent-ascent flow can fail to converge, even for simple functions such as f(x,y)=xy , for which the flow circles around the origin. A natural idea to remedy this is to add entropic regularization, which amounts to optimizing over probability measures rather than points, and to study the resulting mean-field Langevin descent-ascent (MFL-DA) flow. Given \varepsilon>0 and a smooth function f:\mathbb{R}\times\mathbb{R}\to\mathbb{R} , the MFL-DA flow is given by (1.1) \begin{cases}\displaystyle{\partial_{t}\mu_{t}=\varepsilon\,\partial_{x}^{2}\mu_{t}+\partial_{x}\left(\mu_{t}\,\partial_{x}\int f(x,y)\,\mathrm{d}\nu_{t}(y)\right),}\\ \displaystyle{\partial_{t}\nu_{t}=\varepsilon\,\partial_{y}^{2}\nu_{t}-\partial_{y}\left(\nu_{t}\,\partial_{y}\int f(x,y)\,\mathrm{d}\mu_{t}(x)\right).}\end{cases} This is the Wasserstein gradient descent-ascent flow for the functional \mathcal{F}(\mu,\nu)=\iint f\,\mathrm{d}\mu\,\mathrm{d}\nu+\varepsilon\,H(\mu)-\varepsilon\,H(\nu), where H(\mu)=\int\log\left(\frac{\mathrm{d}\mu}{\mathrm{d}x}\right)\,\mathrm{d}\mu is the (negative) differential entropy. The laws (\mu_{t},\nu_{t}) are the marginal laws of the processes (X_{t},Y_{t}) solving (1.2) \begin{cases}\displaystyle{\mathrm{d}X_{t}=\left(-\int\partial_{x}f(X_{t},y)\,\mathrm{d}\nu_{t}(y)\right)\mathrm{d}t+\sqrt{2\varepsilon}\,\mathrm{d}B_{t},}\\ \displaystyle{\mathrm{d}Y_{t}=\left(\int\partial_{y}f(x,Y_{t})\,\mathrm{d}\mu_{t}(x)\right)\mathrm{d}t+\sqrt{2\varepsilon}\,\mathrm{d}B^{\prime}_{t},}\end{cases} where B_{t},B^{\prime}_{t} are independent standard Brownian motions. This framework was introduced and studied in [ 1 ] , where it is shown that if the flow converges, then the limit must be the unique entropy-regularized mixed Nash equilibrium. Whether convergence actually holds was posed as an open problem in [ 13 ] . Part of the motivation for this question is that the entropic regularization endows the problem with strong structural properties: for instance, under mild assumptions, the partial equilibrium measures satisfy uniform log-Sobolev inequalities, which suggests that the regularization might tame the cycling behavior inherent to the deterministic dynamics. Several partial results support this intuition. Local convergence has been established independently in [ 11 ] and [ 12 ] . Global convergence is known to hold under two-timescale modifications of the flow [ 6 , 7 ] ; see also [ 5 ] for other modified dynamics. However, in a companion paper [ 8 ] , one of us showed that in the finite-dimensional setting, gradient descent-ascent can fail to converge even under a two-sided Polyak–Łojasiewicz condition — the natural finite-dimensional analog of the uniform log-Sobolev assumption [ 9 ] . The question of global convergence in the mean-field setting, however, remained open. The point of this paper is to show that the answer is negative: there exist functions for which the MFL-DA flow stays in a compact region and yet does not converge. More precisely, we consider functions indexed by \alpha\geqslant 1 of the form: for every x,y\in\mathbb{R} , (1.3) f_{\alpha}(x,y):=\alpha xy-\frac{x^{2}}{2}+\frac{x^{4}}{12}+\frac{y^{2}}{2}-\frac{y^{4}}{12}\,. For this choice of the function f , the well-posedness of the system ( 1.1 ) follows from [ 3 , 4 ] . As will be confirmed below (see Propositions 3.1 and 3.2 ), the quartic large-scale behavior of f ensures the confinement of the flow. Computing the partial derivatives: \partial_{x}f_{\alpha}(x,y)=\alpha y-x+x^{3}/3,\,\partial_{y}f_{\alpha}(x,y)=\alpha x+y-y^{3}/3 and writing m_{t}:=\int x\,\mathrm{d}\mu_{t}(x)=\mathbb{E}[X_{t}] and n_{t}:=\int y\,\mathrm{d}\nu_{t}(y)=\mathbb{E}[Y_{t}] for the means, the SDE system ( 1.2 ) becomes (1.4) \begin{cases}\displaystyle{\mathrm{d}X_{t}=\left(-\alpha n_{t}+X_{t}-X_{t}^{3}/3\right)\mathrm{d}t+\sqrt{2\varepsilon}\,\mathrm{d}B_{t},}\\ \displaystyle{\mathrm{d}Y_{t}=\left(\alpha m_{t}+Y_{t}-Y_{t}^{3}/3\right)\mathrm{d}t+\sqrt{2\varepsilon}\,\mathrm{d}B^{\prime}_{t}\,.}\end{cases} For this choice, the deterministic dynamics ( \varepsilon=0 , Dirac initial condition) admits a limit cycle \mathscr{C}_{\alpha} that circles around the origin and is contained in the annulus (1.5) \mathcal{A}:=\{(m,n)\in\mathbb{R}^{2}\ :\ 3\leqslant m^{2}+n^{2}\leqslant 6\}, see Proposition 2.1 . When the coupling parameter \alpha is sufficiently large and the entropic regularization \varepsilon is sufficiently small, we show that the stochastic mean-field dynamics remains close to this limit cycle for all times, and in particular does not converge. Theorem 1.1 . For every \delta\in(0,1] , \alpha<+\infty sufficiently large, and \varepsilon>0 sufficiently small, the following holds. If (X_{0},Y_{0}) is deterministic and belongs to \mathscr{C}_{\alpha} , then for every t_{0}\geqslant 0 , there exists a parametrization (\overline{m}_{t},\overline{n}_{t})_{t\in[t_{0},t_{0}+T_{\alpha}]} of the curve \mathscr{C}_{\alpha} such that for every t\in[t_{0},t_{0}+T_{\alpha}] , we have \mathbb{E}[|X_{t}-\overline{m}_{t}|^{2}]+\mathbb{E}[|Y_{t}-\overline{n}_{t}|^{2}]\leqslant\delta. In this circumstance, the means (\mathbb{E}[X_{t}],\mathbb{E}[Y_{t}]) therefore circle around the origin for all times while remaining away from it; in particular, the measures (\mu_{t},\nu_{t}) do not converge as t tends to infinity. We have stated Theorem 1.1 with the assumption that (X_{0},Y_{0}) is deterministic and belongs to \mathscr{C}_{\alpha} . This is only for the sake of clarity of exposition. The more general Theorem 3.3 below allows for random initial conditions, provided that they are sufficiently concentrated and with a mean sufficiently close to \mathscr{C}_{\alpha} . Theorem 3.3 assumes a deterministic upper bound on X_{0}^{2}+Y_{0}^{2} , but this itself can be weakened, as the proof will hopefully make clear. The proof proceeds in two main steps. The first is a careful analysis of the deterministic dynamics, carried out in Section 2 , for which we establish the existence of a unique limit cycle via the Poincaré–Bendixson theorem and construct a Lyapunov function certifying its exponential stability (Propositions 2.1 and 2.4 ). The second step, in Section 3 , is an inductive argument (Theorem 3.3 ) showing that the stochastic fluctuations introduced by the noise remain small over each period of the cycle, so that they cannot accumulate and drive the system away from the periodic orbit. Finally, experiments illustrating the result are presented in Section 4 . 2. Analysis of the deterministic dynamics In this section, we focus on the analysis of the deterministic dynamics, where we set \varepsilon=0 and we impose the initial measures \mu_{0} and \nu_{0} to be Dirac masses. In this case, the evolution ( 1.4 ) becomes deterministic and reduces to the differential system (2.1) \partial_{t}m=-\alpha n+m-\frac{m^{3}}{3},\hskip 20.00003pt\partial_{t}n=\alpha m+n-\frac{n^{3}}{3}. We let F_{\alpha}:\mathbb{R}^{2}\to\mathbb{R}^{2} denote the vector field driving this system of equations, (2.2) F_{\alpha}(m,n):=\left(-\alpha n+m-\frac{m^{3}}{3},\alpha m+n-\frac{n^{3}}{3}\right). We recall that the annulus \mathcal{A} is defined in ( 1.5 ). Proposition 2.1 (limit cycle) . The system ( 2.1 ) admits a unique non-constant periodic orbit, which we denote by \mathscr{C}_{\alpha} . This orbit circles around the origin and is contained in \mathcal{A} . It is a limit cycle of every trajectory of the system ( 2.1 ) except the one that stays put at the origin. The smallest period T_{\alpha} of the motion along this cycle satisfies (2.3) \frac{4\pi}{2\alpha+1}\leqslant T_{\alpha}\leqslant\frac{4\pi}{2\alpha-1}. Proof. We set r:=\sqrt{m^{2}+n^{2}} . For (m,n) solving ( 2.1 ), we can write (2.4) \partial_{t}(r^{2})=2(m\,\partial_{t}{m}+n\,\partial_{t}{n})=2r^{2}-\frac{2}{3}(m^{4}+n^{4}). Since \frac{r^{4}}{2}\leqslant m^{4}+n^{4}\leqslant r^{4} , we have 2r^{2}\left(1-\frac{r^{2}}{3}\right)\leqslant\partial_{t}(r^{2})\leqslant r^{2}\left(2-\frac{r^{2}}{3}\right). Hence, either m(0)=n(0)=0 and the trajectory stays put at the origin, or \liminf_{t\to+\infty}r^{2}\geqslant 3 and \limsup_{t\to+\infty}r^{2}\leqslant 6 . Since the trajectory either stays put at the origin or never visits it, we can define an angular variable \theta such that m=r\cos\theta and n=r\sin\theta , and we have (2.5) \partial_{t}\theta=\frac{m\partial_{t}n-n\partial_{t}m}{r^{2}}=\alpha+\frac{1}{3r^{2}}mn(m^{2}-n^{2})=\alpha+\frac{r^{2}}{12}\sin(4\theta), where we used mn=\tfrac{1}{2}r^{2}\sin(2\theta) and m^{2}-n^{2}=r^{2}\cos(2\theta) to derive the last identity. Since \alpha\geqslant 1 and r^{2}\leqslant 6 in the annulus \mathcal{A} , we see that \partial_{t}\theta never vanishes in \mathcal{A} , and in particular the vector field F_{\alpha} never vanishes in \mathcal{A} . (We can also note that the system (

Read the complete text