Optimal drift optimizer for non-convex optimization

Qin Li, Sixu Li, Eitan Tadmor, Emmanuel Trélat · 2026

Read Optimal drift optimizer for non-convex optimization by Qin Li, Sixu Li, Eitan Tadmor, Emmanuel Trélat (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-24485.txt.

Introduction

Qin Li and three colleagues pin down the exact drift picked by a stochastic control rule for nonconvex optimization. The argument centers on the end distribution of the best process, which is a Gibbs-type law for a proximally penalized energy. That yields three exact drift forms: potential, averaged-gradient, and barycentric. Close to the end time, the drift turns back into a scaled gradient-descent field, and at low temperature it pulls toward the unique global minimizer. The rule balances Brownian exploration against a quadratic control cost.

Catalog record

CREATORQin Li, Sixu Li, Eitan Tadmor, Emmanuel Trélat
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE76004
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.24485

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Optimal drift optimizer for non-convex optimization Thanks: Acknowledgment. Research of Q. Li and S. Li was supported by NSF-DMS 2308440 and Vilas Associate Award. Research of E. Tadmor was supported by ONR grant N00014-2412659, by NSF grant DMS-2508407 and by the Fondation Sciences Mathématiques de Paris (FSMP) while being hosted by LJLL at Sorbonne University. E. Trélat acknowledges the support by FA8655-25-1-7469 of the EOARD-AFOSR Qin Li, Sixu Li, Eitan Tadmor, Emmanuel Trélat Abstract . We study a finite-horizon stochastic control criterion for non-convex optimization in which Brownian exploration is balanced against a quadratic control cost. Rather than emphasizing the classical Hopf–Cole representation, we isolate the exact drift selected by the criterion and reorganize it in a form adapted to optimization. The key object is the conditional terminal law of the optimal process. We show that this law is a Gibbs measure for a proximally penalized energy, yielding three exact representations of the drift: potential, averaged-gradient, and barycentric. We then analyze two asymptotic regimes relevant for optimization. As terminal time is approached, the drift recovers a scaled gradient-descent field. In the low-temperature regime, assuming a unique global minimizer, the conditional terminal law concentrates on it even in the presence of nonglobal local minima, and the drift converges to an affine attraction field toward it. In the nondegenerate case we also derive Laplace asymptotics for the drift, the value function, and the covariance of the conditional terminal law. Finally, we record a simple gradient-free discretization suggested by the barycentric formula. 1991 Mathematics Subject Classification 90C26, 35Q84, 49L20 1. Introduction We are interested in the global minimization problem x^{*}\in\operatorname*{argmin}_{x\in\mathrm{I\kern-1.67421ptR}^{d}}f(x),\qquad f_{*}=\min_{x\in\mathrm{I\kern-1.67421ptR}^{d}}f(x), for a possibly non-convex objective function f:\mathrm{I\kern-2.10007ptR}^{d}\to\mathrm{I\kern-2.10007ptR} . The starting point of the paper is the finite-horizon stochastic control criterion (1.1) J^{\lambda}(u)=\mathbb{E}\bigg[f(X_{T})+\frac{\lambda}{2T}\int_{0}^{T}|u_{t}|^{2}\,\mathrm{d}t\bigg],\quad X_{t}=x_{0}+\int_{0}^{t}u_{s}\,\mathrm{d}s+\sqrt{2\beta}B_{t},\quad u_{s}=\mathbf{u}(s,X_{s}). We use control , drift , and — when speaking from the optimization viewpoint — optimizer , for the process u . In the deterministic warm-up below, u is an open-loop control depending only on time. In the stochastic problem, the relevant objects will be time-dependent Markov feedbacks of the form u_{t}=\mathbf{u}(t,X_{t}) , which is standard terminology in finite-horizon control theory (see, e.g., [ 12 , 33 , 36 ] ). Throughout the paper, u_{s} denotes the realized admissible control process, \mathbf{u}(t,x) denotes a Markov feedback vector field, while \mathbf{u}_{\lambda}^{*} will denote the optimal feedback selected by the finite-horizon criterion associated with J^{\lambda} (see Theorem 2.3 below). We keep the expression “optimal drift optimizer” as a convenient shorthand for the feedback selected by ( 1.1 ), but always relative to this precise criterion. The paper does not claim a universal optimal algorithm for non-convex optimization. From the viewpoint of stochastic control, the analytic core of ( 1.1 ) is classical. The logarithmic transform reducing the Hamilton-Jacobi-Bellman equation to a linear parabolic equation belongs to the linearly solvable control literature [ 20 , 31 , 32 ] . Closely related exponential reweightings of Brownian motion appear in reciprocal diffusion and Schrödinger-Föllmer constructions [ 8 , 9 , 13 , 16 , 34 , 37 ] . The same forward-backward structure also appears in mean-field games [ 5 , 23 ] . On the PDE and optimization side, related kernels have recently been interpreted through Wasserstein proximal operators and Hamilton-Jacobi regularizations [ 17 , 15 , 24 , 27 ] . The present viewpoint should also be compared with Gaussian homotopies, consensus-based optimization, and gradient-free integration methods [ 1 , 7 , 14 , 19 ] . The closed form itself is therefore not the main contribution of the paper. The point of the present note is to isolate the optimization content of that classical formula in a short and coherent framework on \mathrm{I\kern-2.10007ptR}^{d} . More precisely, the paper emphasizes the following facts. (i) The criterion ( 1.1 ) fixes its own scales. It selects both the Gaussian variance 2\beta(T-t) and the effective temperature \frac{2\lambda\beta}{T} , instead of taking them as external schedules. This distinguishes the present construction from Gaussian homotopy and consensus-type methods, where the smoothing scale or the consensus temperature is prescribed by hand. (ii) The stochastic problem is best read as a feedback optimal control problem, and the law-level Fokker-Planck formulation explains naturally why a feedback field appears. The deterministic open-loop toy problem already contains the proximal mechanism behind the whole construction. (iii) The central object is the conditional terminal law of the optimal process. It is a Gibbs law for a penalized energy, and it simultaneously yields the three useful forms of the drift: potential, averaged-gradient, and barycentric. (iv) The low-temperature regime \lambda\to 0 is the global-optimization regime. Under the sole assumption that the global minimizer is unique, with no exclusion of nonglobal local minima, the terminal law concentrates on that minimizer and the drift becomes an affine attraction toward it. The regime t\to T is the local consistency regime: it shows that the same drift reconnects with gradient descent near the end of the horizon. The two limits are generically non-commutative, reflecting the tension between global exploration and local exploitation. The main text is written on \mathrm{I\kern-2.10007ptR}^{d} with an integrable Gibbs density. We do not mix a free diffusion on \mathrm{I\kern-2.10007ptR}^{d} with a hard state constraint encoded by setting f=+\infty outside a bounded set. The bounded-domain framework, namely reflected diffusions and no-flux boundary conditions, is mentioned as a perspective in Section 5 . Before turning to the stochastic feedback problem, it is useful to begin with the deterministic open-loop toy model behind the whole construction. Proposition 1.1 (Deterministic warm-up) . Fix x_{0}\in\mathrm{I\kern-2.10007ptR}^{d} , T>0 , and \lambda>0 . Consider \inf\bigg\{f(x(T))+\frac{\lambda}{2T}\int_{0}^{T}|u(t)|^{2}\,\mathrm{d}t\ \ \big|\ \ \dot{x}(t)=u(t),\ x(0)=x_{0}\bigg\}. Then (1.2) \inf_{u\in L^{2}(0,T;\mathrm{I\kern-1.67421ptR}^{d})}\bigg\{f(x(T))+\frac{\lambda}{2T}\int_{0}^{T}|u(t)|^{2}\,\mathrm{d}t\bigg\}=\inf_{y\in\mathrm{I\kern-1.67421ptR}^{d}}\bigg\{f(y)+\frac{\lambda}{2T^{2}}|y-x_{0}|^{2}\bigg\}. If the right-hand side admits a minimizer y_{\lambda}(x_{0}) , then an optimal control is the constant control u_{\lambda}(t)=\frac{y_{\lambda}(x_{0})-x_{0}}{T},\qquad x_{\lambda}(t)=x_{0}+\frac{t}{T}\big(y_{\lambda}(x_{0})-x_{0}\big). Proof. Let y=x(T) . Since y-x_{0}=\int_{0}^{T}u(t)\,\mathrm{d}t , the Cauchy-Schwarz inequality gives \int_{0}^{T}|u(t)|^{2}\,\mathrm{d}t\geqslant\frac{1}{T}\bigg|\int_{0}^{T}u(t)\,\mathrm{d}t\bigg|^{2}=\frac{1}{T}|y-x_{0}|^{2}, with equality if and only if u is constant. Therefore, among all trajectories ending at y , the minimal kinetic cost equals \frac{\lambda}{2T^{2}}|y-x_{0}|^{2} . Minimizing over y gives the result. ∎ Proposition 1.1 already shows what the quadratic running cost does: it turns the endpoint optimization into a proximal penalization. Equivalently, the right-hand side of ( 1.2 ) is the Moreau envelope of f with parameter \mu=T^{2}/\lambda , evaluated at x_{0} . The stochastic problem below is its noisy feedback analogue, with a terminal law instead of a single terminal point. The same warm-up already contains the basic low- \lambda intuition. Corollary 1.2 (Low- \lambda limit in the warm-up) . Assume that f is continuous, bounded from below, coercive, and has a unique minimizer x^{*} . Let y_{\lambda}(x_{0}) be any minimizer of the problem ( 1.2 ). Then y_{\lambda}(x_{0})\to x^{*} as \lambda\downarrow 0 . Consequently, u_{\lambda}(t)\to\frac{x^{*}-x_{0}}{T} for every t\in[0,T] . Proof. For every \lambda>0 , f\big(y_{\lambda}(x_{0})\big)+\frac{\lambda}{2T^{2}}|y_{\lambda}(x_{0})-x_{0}|^{2}\leqslant f(x^{*})+\frac{\lambda}{2T^{2}}|x^{*}-x_{0}|^{2}. Hence f\big(y_{\lambda}(x_{0})\big)\leqslant f_{*}+\frac{\lambda}{2T^{2}}|x^{*}-x_{0}|^{2}. By coercivity, the family \{y_{\lambda}(x_{0})\}_{\lambda>0} is bounded. Let \lambda_{n}\downarrow 0 and assume y_{\lambda_{n}}(x_{0})\to\bar{y} along a subsequence. Passing to the limit in the previous inequality gives f(\bar{y})\leqslant f_{*} . Hence \bar{y}=x^{*} by uniqueness of the minimizer. Every convergent subsequence has the same limit, so the whole family converges to x^{*} . ∎ The deterministic warm-up is open-loop. The finite-horizon optimizer selected by ( 1.1 ) will instead be a time-dependent Markov feedback. The rest of the

Read the complete text