An Adaptive Proximal Point Method for Nonsmooth and Nonconvex Optimization on Hadamard Manifolds
Vitaliano S. Amaral, Marcio Antônio de A. Bortoloti, Jurandir O. Lopes, Gilson N. Silva · 2025
Read An Adaptive Proximal Point Method for Nonsmooth and Nonconvex Optimization on Hadamard Manifolds by Vitaliano S. Amaral, Marcio Antônio de A. Bortoloti, Jurandir O. Lopes, Gilson N. Silva (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-14724.txt.
Introduction
Vitaliano S. Amaral, Marcio Antônio de A. Bortoloti, and two co-authors design optimization methods for curved spaces where the objective is rough and bent in hard ways. The problems live on Hadamard manifolds, complete spaces of nonpositive curvature. The objective mixes smooth, convex, and merely well-behaved parts, which covers a wide family of hard tasks.
Two variants of an adaptive proximal point method are offered. One uses a known smoothness constant for the gradient, while the other needs no such knowledge and so applies more broadly. The authors prove convergence, bound the cost, and test both versions on numerical examples. The work widens the reach of reliable manifold optimization.
Catalog record
| CREATOR | Vitaliano S. Amaral, Marcio Antônio de A. Bortoloti, Jurandir O. Lopes, Gilson N. Silva |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 47 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-14724
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
An Adaptive Proximal Point Method for Nonsmooth and Nonconvex Optimization on Hadamard Manifolds Vitaliano S. Amaral, Marcio Antônio de A. Bortoloti, Jurandir O. Lopes, Gilson N. Silva Abstract This paper addresses a class of nonsmooth and nonconvex optimization problems defined on complete Riemannian manifolds. The objective function has a composite structure, combining convex, differentiable, and lower semicontinuous terms, thereby generalizing the classical framework of difference-of-convex programming. Motivated by recent advances in proximal point methods in Euclidean and Riemannian settings, we propose two variants: one that uses the Lipschitz constant of the gradient of the smooth part, suitable when this parameter is accessible, and another that dispenses with such knowledge, expanding its applicability. We analyze the complexity of both approaches, establish their convergence, and illustrate their effectiveness through numerical experiments. Keywords: Riemannian manifolds; Nonconvex optimization; Nonsmooth optimization; Composite minimization MSC 2020: 90C30; 90C26; 49Q99 1 Introduction In this paper, we study a class of nonsmooth and nonconvex optimization problems defined on a complete Riemannian, called in this introduction of NNOP-CR . The objective function has a composite structure, where one term is convex, another term is continuously differentiable with a Lipschitz continuous gradient, and a third term is proper and lower semicontinuous but not necessarily convex. When the sum of the nonsmooth and the differentiable terms is assumed to be convex, the problem reduces to the well-known framework of difference-of-convex (DC) programming, which has been widely investigated in the literature. However, by allowing the nonsmooth component to be nonconvex, we obtain a broader and more challenging class of problems that generalizes the classical DC setting. Such formulations naturally arise in many areas of applied mathematics and engineering. Examples include machine learning [ 7 ] , image processing image processing [ 7 ] , compressed sensing [ 48 ] , location optimization [ 35 ] , biochemistry modeling [ 7 ] , sparse optimization [ 30 ] , clustering methods [ 8 , 13 ] , hierarchical clustering [ 36 ] , clusterwise linear regression [ 12 ] , multicast network design [ 29 ] , and multidimensional scaling [ 3 ] . We now focus our discussion on the efficient methods applied for solving problems belonging to NNOP-CR in the Euclidian context. A popular and probably the first algorithm developed to solve DC problems was the Difference of Convex Algorithm (DCA), see [ 42 , 43 ] . A significant progress in this field was the development of the Boosted DC Algorithm (BDCA) [ 6 , 8 , 9 ] , which enhances the convergence speed of the traditional DCA through the integration of a line search strategy; see also [ 7 , 49 ] for other recent contributions. This strategy enables larger step sizes compared to the standard DCA, leading to improved convergence efficiency and better solution quality by avoiding suboptimal local minima. The initial BDCA was mainly designed for scenarios where the first DC component is differentiable, ensuring a descent direction. However, its original formulation has limitations when both components are nondifferentiable. To overcome the challenge that BDCA encounters as mentioned in the previous paragraph, the recent work [ 28 ] introduced the nonmonotone Boosted Difference of Convex Algorithm (nmBDCA). The key difference between nmBDCA and BDCA arises when the first component is nondifferentiable. In such situations, the line search direction utilized in BDCA may not guarantee a descent direction, rendering the standard Armijo line search ineffective. To address this issue, nmBDCA incorporates a nonmonotone Armijo-like line search that remains effective even when the first component is not differentiable. This adjustment enables nmBDCA to tackle a wider range of problems, thereby broadening its applicability beyond BDCA and improving the efficiency of the line search. Further developments beyond BDCA and nmBDCA were recently explored in [ 27 ] , where the subproblem at each iteration of its inexact nmBDCA is solved approximately using a relative error tolerance. We now discuss on the recent developments on Riemannian DC problems. The crescent interest in optimization methods on Riemannian manifolds is due to the fact that practical applications arise whenever the natural structure of the data is modeled as an optimization problem on a Riemannian manifold. For instance see [ 11 , 19 , 20 , 22 , 25 , 30 , 39 , 47 , 50 ] . As far as we know, the study presented in [ 41 ] was the first to address DC functions within Riemannian manifolds. Specifically, the authors in [ 41 ] introduced the proximal point algorithm for DC functions and analyzed its convergence in the context of Hadamard manifolds. More recently, [ 1 ] proposed a refined version of the algorithm in [ 41 ] in the same Riemannian framework, aiming to enhance the convergence speed of the method introduced in [ 41 ] . In the recent paper [ 30 ] , a DC algorithm is presented for sparse optimization problems having a cardinality or rank constraint. The main idea in [ 30 ] is to transform the cardinality-constrained problem into a penalty function form and derive exact penalty parameter values for some optimization problems, especially for quadratic minimization problems which often appear in practice. Thus, the new problem belongs to NNOP-CR , i.e., a DC problem with three nonlinear functions. More relevant researches about the proximal point methods within the framework of Riemannian manifolds can be found in [ 5 , 16 , 15 , 24 , 26 , 17 , 33 , 45 ] and in [ 1 , 14 , 23 , 37 , 38 , 41 ] . In the case where the Riemannian manifold is the Euclidian space, in [ 4 ] is proposed a PPM to solve a problem in NNOP-CR , under the same conditions as mentioned before. The method proposed in [ 4 ] is based on a proximal-point framework. At each iteration, it solves a strongly convex subproblem that involves both the nonsmooth and smooth components of the objective. The construction of these subproblems requires knowledge of the Lipschitz constant associated with the gradient of the differentiable term. Similarly, in [ 2 ] the authors proposed an algorithm based on a proximal gradient method for a particular case by assuming that the smooth function has a gradient Hölder. In this paper, we present two variants for the proximal point methods for solving NNOP-CR . In our convergence analysis, we require that only one of the functions is convex. In the first method, prior knowledge of the Lipschitz constant associated to the gradient of the smooth part is required, making it more suitable for problems in which this constant is easy to compute. However, determining such a constant is not always straightforward. Therefore, in this paper, we propose a second method that does not require prior knowledge of the Lipschitz constant. We analyze the complexity of both methods and prove that they reach an approximate solution in a finite number of iterations, with complexity of order \mathcal{O}(\epsilon^{-2}) , with \epsilon>0 to be specified later. The remainder of this paper is organized as follows. In Section 2 , we present preliminary results to support the development of the proposed methods. Section 3 introduces the first version of the