Well-posedness and approximation of reflected McKean-Vlasov SDEs with applications
P. D. Hinds, A. Sharma, M. V. Tretyakov · 2024
Read Well-posedness and approximation of reflected McKean-Vlasov SDEs with applications by P. D. Hinds, A. Sharma, M. V. Tretyakov (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-20247.txt.
Description
A 2024 arXiv research paper by P. D. Hinds, A. Sharma, M. V. Tretyakov. In this paper, we establish well-posedness of reflected McKean-Vlasov SDEs and their particle approximations in smooth non-convex domains. We prove convergence of the interacting particle system to the corresponding mean-field limit with the optimal rate of convergence. We motivate this study with applications to sampling and optimization in constrained domains by considering reflected mean-field Langevin SDEs and two reflected consensus-based optimization (CBO) models, respectively.
Catalog record
| CREATOR | P. D. Hinds, A. Sharma, M. V. Tretyakov |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 95 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2412-20247
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Well-posedness and approximation of reflected McKean-Vlasov SDEs with applications P. D. Hinds, A. Sharma, M. V. Tretyakov Abstract In this paper, we establish well-posedness of reflected McKean-Vlasov SDEs and their particle approximations in smooth non-convex domains. We prove convergence of the interacting particle system to the corresponding mean-field limit with the optimal rate of convergence. We motivate this study with applications to sampling and optimization in constrained domains by considering reflected mean-field Langevin SDEs and two reflected consensus-based optimization (CBO) models, respectively. We utilize reflection coupling to study long-time behaviour of reflected mean-field SDEs and also investigate convergence of the reflected CBO models to the global minimum of a constrained optimization problem. We numerically test reflected CBO models on benchmark constrained optimization problems and an inverse problem. Keywords: constrained optimization, constrained sampling, mean-field Langevin dynamics, consensus-based optimization, interacting particle systems, reflected mean-field diffusion, reflected stochastic differential equations, propagation of chaos. AMS Classification: 60H10 90C26 65C30 65C35 60J76. 1 Introduction Reflected stochastic differential equations (SDEs) are used to model processes confined to a domain with boundary, where the solution is reflected along a certain direction when it hits the boundary. At the same time, McKean-Vlasov SDEs have coefficients with non-linear dependencies on the law of the solution. This paper is devoted to the study of reflected McKean-Vlasov SDEs which can model systems with constraints and mean-field interactions. We illustrate practical relevance of reflected mean-field SDEs via problems in sampling and optimization with constraints. Sampling and optimization problems are ubiquitous in the applied sciences and have found resurgence due to advancements in machine learning. The relation between optimization and sampling is quite established. While convex optimization (as well as log-concave sampling) is well-studied [ 48 ] , the task of non-convex global optimization (as well as non-log-concave sampling) poses additional challenges [ 29 ] . In the Bayesian setting, many of the optimization problems can be posed as sampling problems. On the other hand, many sampling techniques can be viewed as optimization in infinite dimensional setting through the variational perspective. With regard to global optimization, metaheuristic methods are a popular class of methods which have been used to numerically solve global optimization problems. Such methods consist of a high-level algorithmic framework to coordinate low-level heuristics in order to efficiently explore and exploit the solution space. Examples include particle swarm optimization [ 34 ] and differential evolution [ 57 ] among others. While there is typically limited theoretical foundation for such models, these methods have been found to be effective in practice [ 63 ] . We are mainly interested in optimization and sampling techniques based on interacting particle systems driven by reflected SDEs. Interacting particle system based methods for optimization and sampling have gained traction (see [ 35 , 11 , 42 , 24 , 25 , 52 , 33 ] ) due to their enhanced capability to explore a non-convex energy landscape. These systems are driven by SDEs and hence the tools from stochastic calculus, especially mean-field theory [ 59 ] and stochastic numerics [ 47 ] are available to establish their convergence. Let us discuss the contributions of this paper along with the comparison with existing literature. We will further discuss the literature at appropriate places later in the paper. Here, we give a high-level overview. In the paper, we first establish existence and uniqueness of reflected McKean-Vlasov SDEs and their particle approximations in a non-convex domain setting (Section 3 ). The well-posedness was shown in a convex domain setting in [ 1 ] and in a non-convex setting, but allowing only first order interaction, in [ 58 ] . In [ 64 ] well-posedness was also considered in a non-convex domain setting but for McKean-Vlasov SDEs with singular drift and extra conditions on the diffusion coefficient. Our next result is convergence of interacting particle system towards its mean-field limit with the optimal rate of convergence (Section 4 ). The assumptions that we impose for well-posedness and particle convergence are general enough that many models which have been studied in \mathbb{R}^{d} (see e.g. [ 11 , 24 , 12 , 19 ] ) can be reformulated in the framework of reflected McKean-Vlasov SDEs to handle constraints. We provide three illustrations for application of reflected McKean-Vlasov SDEs to sampling and optimization. The first one is reflected mean-field Langevin dynamics (Section 2.1 ) for which we employ reflection coupling to study its long-time behavior and obtain non-asymptotic bounds (Section 5.1 ). In the convex domain setting, this study was conducted in [ 65 ] . The second class of models we consider is consensus-based optimization (CBO) models (Section 2.2 ) for which we establish convergence to the global minimum (Section 5.2 ). We add a repelling force in the CBO model to enhance exploration (Section 2.2.2 ) and observe its benefits in numerical testing on the Rosenbrock function (Section 6.5 ). We test two discretization schemes for reflected SDEs, namely the penalty and projection schemes, to implement the CBO models for a few benchmark constraint optimization problems including an inverse problem (Section 6 ). A natural question that arises is why one would formulate optimization and sampling problems with constraints in the setting of reflected SDEs. We first mention other strategies which have been proposed and employed to handle constraints in the literature on interacting particle system driven by SDEs for the purpose of optimization and sampling. In [ 8 ] , a CBO model is considered where a penalty function is added to the objective function f , which penalizes the objective when points are outside the feasible set \bar{G} ( f is defined on \mathbb{R}^{d} ). For a penalization multiplier \epsilon>0 , the following unconstrained problem is considered: \min\limits_{x\in\mathbb{R}^{d}}P(x;\epsilon), (1.1) where P(x;\epsilon)=f(x)+\epsilon r(x) with r(x)>0 if the feasible set \bar{G} is violated else it is zero. An Euler scheme is applied to simulate the corresponding particle system. Convergence of the algorithm to the optimal solution is shown, both when the exact penalty parameter \epsilon is known, and also when it is iteratively updated. In [ 15 ] , like [ 8 ] , the authors also use a penalized objective function presenting several numerical experiments. In [ 3 ] , a projection technique is considered for discrete time CBO model driven by common noise. It is observed in numerical tests on benchmark functions that common noise may result in less exploration producing a sub-standard performance (see [ 33 ] ). In the case of ensemble Kalman inversion, which is again an interacting particle based optimization method for inverse problems (see e.g. [ 31 ] ), in [ 16 ] box constraints are handled using projection scheme and in [ 28 ] a log-barrier penalty is added to deal with inequality constraints defining the convex feasible region. We now illustrate with a simple example to highlight why reflected SDEs (i.e., Skorokhod’s dynamics) are the natural candidate to handle constraints in models arising not only in biological and physical sciences but also in models underlying sampling and optimization techniques. Suppose we are interested in minimizing a continuously differentiable Lipschitz function f:\bar{G}\rightarrow\mathbb{R} where G\subset\mathbb{R}^{d} is a convex domain with boundary \partial G , and x_{\min}=\text{arg}\,\text{min}_{x\in\bar{G}}f(x) is the unique global minimum. In the continuous-time