Nonlinear forward-backward-half forward splitting with momentum for monotone inclusions
Liqian Qin, Yuchao Tang, Jigen Peng · 2025
Read Nonlinear forward-backward-half forward splitting with momentum for monotone inclusions by Liqian Qin, Yuchao Tang, Jigen Peng (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-24489.txt.
Introduction
Liqian Qin, Yuchao Tang, and Jigen Peng, three authors, design an algorithm. The task is a monotone inclusion, a math problem of finding a zero. Such problems mix three kinds of operators with distinct traits. Operators are rules that turn one input into a set of outputs. The team extend a known splitting method by adding momentum.
Splitting methods break a hard problem into steps for each operator. Momentum reuses past steps to speed the search, here in nonlinear form. With the right step size, their method is proved to converge weakly. Under a strong trait, the error shrinks at a linear rate. A random version cuts variance for sums of many terms. Tests on portfolio tasks beat rival methods in practice.
Catalog record
| CREATOR | Liqian Qin, Yuchao Tang, Jigen Peng |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 76 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2510-24489
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Nonlinear forward-backward-half forward splitting with momentum for monotone inclusions Liqian Qin, Yuchao Tang, Jigen Peng Abstract In this work, we propose a new splitting algorithm for solving structured monotone inclusion problems composed of a maximally monotone operator, a maximally monotone and Lipschitz continuous operator and a cocoercive operator. Our method augments the forward–backward-half forward splitting algorithm with a nonlinear momentum term. Under appropriate conditions on the step-size, we prove the weak convergence of the proposed algorithm. A linear convergence rate is also obtained under the strong monotonicity assumption. Furthermore, we investigate a stochastic variance-reduced forward-backward-half forward splitting algorithm with momentum for solving finite-sum monotone inclusion problems. Weak almost sure convergence and linear convergence are also established under standard condition. Preliminary numerical experiments on synthetic datasets and real-world quadratic programming problems in portfolio optimization demonstrate the effectiveness and superiority of the proposed algorithm. Keywords: Monotone inclusions; Forward-backward-half forward splitting algorithm; Momentum; Variance reduction. 1 Introduction In this work, we focus on solving the structured monotone inclusion problems in a real Hilbert space \mathcal{H} : \hbox{find}\ x\in\mathcal{H}\ \hbox{such that}\ 0\in Ax+Bx+Cx, (1) where A:\mathcal{H}\rightarrow 2^{\mathcal{H}} is a multi-valued maximally monotone operator, B:\mathcal{H}\rightarrow\mathcal{H} is a single-valued monotone and Lipschitz operator, and C:\mathcal{H}\rightarrow\mathcal{H} is a cocoercive operator. The monotone inclusion problem not only captures a wide range of convex minimization problems arising in fields such as signal and image processing [ 1 ] and machine learning [ 2 , 3 , 4 ] , but also encompasses certain structured monotone inclusion problems as special cases, see for example [ 5 , 6 , 7 , 8 ] . In particular, let \mathcal{H} and \mathcal{G} be real Hilbert spaces, and consider the following structured monotone inclusion problems: \hbox{find}\ x\in\mathcal{H}\ \hbox{such that}\ 0\in Ax+L^{*}(B\Box D\Box E)Lx+Cx, (2) where A:\mathcal{H}\rightarrow 2^{\mathcal{H}} is maximally monotone, C:\mathcal{H}\rightarrow\mathcal{H} is \frac{1}{\beta} -cocoercive, for some \beta>0, L:\mathcal{H}\rightarrow\mathcal{G} is a bounded linear operator with its adjoint L^{*}, B,\ D,\ E:\mathcal{G}\rightarrow 2^{\mathcal{G}} are maximally monotone, D^{-1} is L_{D} -Lipschitz, E^{-1} is \frac{1}{\beta_{E}} -cocoercive, and B\Box D\Box E=(B^{-1}+D^{-1}+E^{-1})^{-1} is known as the parallel sum of B,\ D and E . An element x is a solution of problem ( 2 ) if and only if there exists y\in\mathcal{G} such that 0\in\left[\begin{array}[]{cc}A&0\\ 0&B^{-1}\end{array}\right]\left[\begin{array}[]{c}x\\ y\end{array}\right]+\left[\begin{array}[]{cc}0&L^{*}\\ -L&D^{-1}\end{array}\right]\left[\begin{array}[]{c}x\\ y\end{array}\right]+\left[\begin{array}[]{cc}C&0\\ 0&E^{-1}\end{array}\right]\left[\begin{array}[]{c}x\\ y\end{array}\right]. (3) This inclusion corresponds to a special case of ( 1 ), since the first operator is maximally monotone, the second is monotone and Lipschitz continuous, and the third is cocoercive. This general framework provides a unified perspective for analyzing and solving diverse problems in optimization and variational analysis. Given the wide applicability of the structured monotone inclusion problem ( 1 ) and its special cases like ( 2 ), the development of efficient and practical solution algorithms has become a major research focus. Specifically, designing fully splitting algorithms that can process each operator individually and efficiently—multi-valued operators via their resolvents and single-valued operators via explicit evaluations—is critical for leveraging problem structure and enabling scalable implementations. In the following subsection, we review key related works in this field, focusing on algorithmic approaches for solving monotone inclusion problems, and highlighting the context and motivation behind the contributions presented in this paper. 1.1 Related works In the field of monotone inclusions, researchers are highly motivated to design fully splitting algorithms that allow each operator involved to be processed individually and efficiently, including but not limited to those presented in [ 5 , 7 , 9 , 10 , 11 , 8 , 12 ] . These algorithms aim to exploit the structure of the problem by treating different types of operators with appropriate strategies. Specifically, multi-valued monotone operators are typically handled via their resolvent operators, while single-valued (and often Lipschitz continuous) operators are incorporated through explicit evaluations. This splitting approach not only facilitates the implementation of the algorithms but also enhances their flexibility and scalability when applied to large-scale or structured problems. Forward–backward-half forward splitting algorithm. For monotone inclusion problems involving two operators, many classical algorithms have been proposed and extensively studied [ 13 , 14 , 15 , 16 ] , such as the forward-backward splitting algorithm [ 17 , 18 ] , the Douglas-Rachford splitting algorithm [ 19 ] , and Tseng’s forward-backward-forward splitting algorithm [ 20 ] . However, when the problem involves three operators, traditional approaches often resort to combining certain operators to reduce the problem to a two-operator setting. Although theoretically feasible, this strategy typically fails to fully exploit the structural properties of each operator, which may lead to suboptimal efficiency or convergence behavior. In particular, for the monotone inclusion problem considered in this paper, although B+C inherits monotonicity and Lipschitz continuity, Tseng’s method for solving problem ( 1 ) suffers from two limitations: (i) requiring two evaluations of each operator per iteration; (ii) failing to leverage the cocoercivity property of C . Consequently, designing fully splitting algorithms that can process all three operators separately while leveraging their individual properties remains a significant and active area of research. For problem ( 1 ), Briceño et al. [ 6 ] first proposed the forward-backward-half forward (FBHF) splitting algorithm. This algorithm fully exploits the cocoercivity of C . In their approach, while the continuous monotone operator still requires two evaluations per iteration, but reduce the cost for the cocoercive operator to a single evaluation by leveraging its cocoercivity. The FBHF splitting algorithm takes the advantage of the inherent structural properties of individual operators, providing a unified generalization of both Forward-Backward splitting algorithm and Tseng’s method. The detailed FBHF splitting algorithm is defined as follows: \left\{\begin{array}[]{lr}y_{k}=J_{\gamma_{k}A}(x_{k}-\gamma_{k}(B+C)x_{k}),&\\ x_{k+1}=y_{k}+\gamma_{k}(Bx_{k}-By_{k}),&\\ \end{array}\right. (4) where \gamma_{k} is the step-size, J_{\gamma_{k}A}=(\Id+\gamma_{k}A)^{-1} is the resolvent of A . They proved the weak convergence of Algorithm ( 4 ) with variable step-size: \gamma_{k}\in[\eta,\chi-\eta] , \eta\in(0,\frac{\chi}{2}) , \chi=\frac{4}{\beta+\sqrt{\beta^{2}+16L^{2}}} , and line search procedure. Furthermore, they also consider the FBHF splitting algorithm with non-self-adjoint linear operators. The algorithm iterates as follows: \left\{\begin{array}[]{lr}y_{k}=(M_{k}+A)^{-1}(M_{k}x_{k}-(B+C)x_{k}),&\\ x_{k+1}=x_{k}+\lambda_{k}(M_{k}(y_{k}-x_{k})+Bx_{k}-By_{k}),&\\ \end{array}\right. (5) where M_{k}:\mathcal{H}\rightarrow\mathcal{H} are bounded linear operators. Under certain boundedness and coercivity conditions on the self-adjoint and skew-symmetric parts of operators M_{k} , as well as constraints on associated Lipschitz and step-size parameters, the weak convergence of the iterative sequence ( 5 ) is established. Since the introduction of the FBHF splitting algorithm, numerous researchers have explored various extensions, such as inertial [ 12 ] , relaxed inertial [ 21 ] , multi-step inertial schemes [ 22 ] , and algorithms with deviations [ 23 ] . Warped resolvent. The resolvent operator plays a central role in the analysis and design of various operator splitting algorithms. To broaden its scope of applicability, the concept of the nonlinear or warped resolvent, as developed by Giselsson and B \grave{u} i-Combettes [ 24 , 25 ] , has been introduced. This generalized form of the resolvent has proven effective in modeling a broad range of both existing and novel monotone inclusion algorithms, thereby offering a unified and flexible framework for algorithm design in monotone operator theory. The primary motivation behind introducing warped resolvent lies in leveraging a strategically designed kernel, customized to match the inherent structure of an inclusion problem, to establish streamlined frameworks for devising and analyzing novel splitting algorithms. However, this increased flexibility might require computational trade-offs. The methods proposed in [ 24 , 25