Relocated Fixed-Point Iterations with Applications to Variable Stepsize Resolvent Splitting Felipe Atenas, Heinz H. Bauschke, Minh N. Dao, Matthew K. Tam Abstract In this work, we develop a convergence framework for iterative algorithms whose updates can be described by a one-parameter family of nonexpansive operators. Within the framework, each step involving one of the main algorithmic operators is followed by a second step which “relocates” fixed-points of the current operator to the next. As a consequence, our analysis does not require the family of nonexpansive operators to have a common fixed-point, as is common in the literature. Our analysis uses a parametric extension of the demiclosedness principle for nonexpansive operators. As an application of our convergence results, we develop a version of the graph-based extension of the Douglas–Rachford algorithm for finding a zero of the sum of N ≥ 2 N\geq 2 maximally monotone operators, which does not require the resolvent parameter to be constant across iterations. 2020 Mathematics Subject Classification: 47H05, 47H09, 47N10, 65K05, 47H04. Keywords: Fixed-point iterations, demiclosedness principle, nonexpansive operator, resolvent splitting, Douglas–Rachford. 1 Introduction Throughout this work we assume X is a real Hilbert space with inner product \left\langle{\cdot},{\cdot}\right\rangle and induced norm \|\cdot\| . We are interested in solving monotone inclusions of the form \text{find~~}x\in X\text{~~such that~~}0\in(A+B)x, (1) where A and B are maximally monotone operators on X with Z:=\operatorname{zer}(A+B)\neq\varnothing as well as various extensions thereof ( e.g., inclusions with more than two operators). The Douglas–Rachford (DR) algorithm [ 13 , 17 , 18 ] is a distinguished splitting method used to solve ( 1 ) by using the so-called resolvents of the individual operators A and B , without requiring any type of direct computation involving the operator A+B . Recall that the resolvent of A is the operator given by J_{A}:=(I+A)^{-1}, and the reflectent of A (also known as the reflected resolvent ) is the operator R_{A}:=2J_{A}-\operatorname{Id}. Given a stepsize \gamma\in\mathbb{R}_{++} and initial point x_{0}\in X , the DR algorithm for the ordered pair (\gamma A,\gamma B) generates a sequence (x_{n})_{{n\in{\mathbb{N}}}} according to x_{n+1}:=T_{\gamma}x_{n} where T_{\gamma} denotes to the DR operator defined by T_{\gamma}:=\operatorname{Id}-J_{\gamma A}+J_{\gamma B}R_{\gamma A}. (2) In the standard convergence analysis for the DR algorithm, which is based on an interpretation as a fixed-point iteration, firm nonexpansiveness of T_{\gamma} yields the inequality (\forall{n\in{\mathbb{N}}})(\forall y_{\gamma}\in\operatorname{Fix}T_{\gamma})\>\|x_{n+1}-y_{\gamma}\|^{2}+\|x_{n}-x_{n+1}\|^{2}\leq\|x_{n}-y_{\gamma}\|^{2}, (3) from which general theory [ 25 ] implies that (x_{n})_{{n\in{\mathbb{N}}}} converges weakly to a point x\in\operatorname{Fix}T_{\gamma} and that J_{\gamma A}x solves ( 1 ). In ( 3 ), we emphasise that the fixed-point y_{\gamma} depends on the constant \gamma . Despite J_{\gamma A} not being weakly continuous in general, with some additional work—leveraging on demiclosedness of maximally monotone operators—it can also be shown that (J_{\gamma A}x_{n})_{{n\in{\mathbb{N}}}} converges weakly to J_{\gamma A}x [ 32 ] . Convergence of the method has also been established in various nonmonotone settings [ 4 , 10 , 28 , 16 , 34 ] . For many resolvent-based iterative methods such as the proximal point and the forward-backward algorithms, the fixed-point set of the underlying algorithmic operator and the set of solutions coincide. Consequently, the fixed-point set does not depend on algorithm parameters such as the stepsize. This property allows the stepsize to be varied across iterations whilst preserving an inequality in the form of ( 3 ) and hence the original convergence analysis holds without significant changes. In contrast, this is not the case for the DR algorithm whose fixed-point set \operatorname{Fix}T_{\gamma} has a parametric dependence on \gamma\in\mathbb{R}_{++} and need not coincide with the solution set \operatorname{zer}(A+B) . In fact, due to [ 5 , Proposition 26.1(i) & Proposition 26.1(iii)(b)] , we have \operatorname{Fix}T_{\gamma}=\{z+\gamma w:w\in Az,-w\in Bz\}. (4) As a consequence of ( 4 ), the fixed-point sets of the DR operators for different parameters can be completely disjoint (see Remark 4.12 ) and thus ( 3 ) can no longer be used to directly analyse convergence of a variable stepsize version of of DR given by (T_{\gamma_{n}}^{n}x_{0})_{{n\in{\mathbb{N}}}} for (\gamma_{n}) in \mathbb{R}_{++} . Although the stepsize parameter \gamma\in\mathbb{R}_{++} in ( 2 ) does not usually play an important role in the DR algorithm convergence analysis itself, its value is critical in methods that extend the DR algorithm to incorporate an additional operator through forward steps such as Davis-Yin splitting [ 12 , 26 ] and the forward-reflected-backward methods [ 21 ] . In these methods, the stepsize parameter is typically required to be sufficiently small so that the forward operator satisfies a Lipschitz-type inequality. Furthermore, as these methods reduce to the DR algorithm in special cases, their underlying operators’ fixed-point sets inherit the parametric dependence on the stepsize. As a consequence, linesearches for these methods are not straightforward to develop and analyze. Another research direction where variable stepsize plays an important role is in extending [ 15 ] on the convergence rate of the proximal point algorithm to the DR algorithm. In order to tackle the challenge of allowing variable stepsizes for the DR algorithm, we develop an extension of the successive approximation scheme examined in [ 25 ] , allowing the use of a sequence (\gamma_{n})_{{n\in{\mathbb{N}}}} of variable stepsizes. To do so, we introduce the notion of a fixed-point relocator (Definition 4.1 ). A key property of these operators is the following: given an operator T_{\gamma} parametrized by a positive parameter \gamma\in\mathbb{R}_{++} , its fixed-point relocator operator, denoted Q_{\delta\leftarrow\gamma} , is a bijection which maps fixed-points of T_{\gamma} to fixed-points of T_{\delta} for a different parameter \delta\in\mathbb{R}_{++} . Given fixed-point relocators (Q_{\delta\leftarrow\gamma})_{\gamma,\delta\in\mathbb{R}_{++}} for (T_{\gamma})_{\gamma\in\mathbb{R}_{++}} , a stepsize sequence (\gamma_{n})_{n\in{\mathbb{N}}} and initial point x_{0}\in X , we consider iterations of the form (\forall{n\in{\mathbb{N}}})\quad x_{n+1}=Q_{\gamma_{n+1}\leftarrow\gamma_{n}}T_{\gamma_{n}}x_{n}. (5) We refer to the family of methods defined this way as relocated fixed-point iterations. For the DR operator, we show that a fixed-point relocator is given by (\forall\gamma,\delta\in\mathbb{R}_{++})(\forall x\in X)\;Q_{\delta\leftarrow\gamma}(x)=\tfrac{\delta}{\gamma}x+\big(1-\tfrac{\delta}{\gamma}\big)J_{\gamma A}x. (6) The corresponding relocated DR algorithm in the form of ( 5 ) can therefore be expressed as \left\{\begin{aligned} w_{n}&=x_{n}-J_{\gamma_{n}A}x_{n}+J_{\gamma_{n}B}R_{\gamma_{n}A}x_{n}\\ x_{n+1}&=\tfrac{\gamma_{n+1}}{\gamma_{n}}w_{n}+\left(1-\tfrac{\gamma_{n+1}}{\gamma_{n}}\right)J_{\gamma_{n}A}w_{n}.\end{aligned}\right. (7) Note that, in its current form, ( 7 ) appears to require an extra resolvent evaluation as compared to the standard DR algorithm. However, this can be circumvented using the equivalent implementation described in Algorithm 1 . For further details, see Proposition 5.6 . Input : Choose x_{0}\in X and a stepsize sequence (\gamma_{n})_{n\in{\mathbb{N}}} in \mathbb{R}_{++} . Set z_{0}=J_{\gamma_{0}A}x_{0} . for n=0,1,2,\dots do Step 1. Intermediate step. Compute \left\{\begin{aligned} y_{n}&=J_{\gamma_{n}B}(2z_{n}-x_{n})\\ w_{n}&=x_{n}-z_{n}+y_{n}.\\ \end{aligned}\right. (8) Step 2. Next iterate. Compute \left\{\begin{aligned} z_{n+1}&=J_{\gamma_{n}A}w_{n}\\ x_{n+1}&=\dfrac{\gamma_{n+1}}{\gamma_{n}}w_{n}+\left(1-\dfrac{\gamma_{n+1}}{\gamma_{n}}\right)z_{n+1}.\end{aligned}\right. (9) Algorithm 1 Relocated DR algorithm for finding a zero of A+B . Several resolvent splitting algorithms with constant stepsizes have been developed to solve monotone inclusions, see [ 18 , 12 , 31 , 22 , 7 ] and references therein. An instance of a method allowing variable stepsizes for splitting methods that only admit resolvent evaluations is proposed in [ 20 ] . Therein, the authors analyze a non-stationary extension of the DR algorithm by modifying the steps that define the DR operator based on a reformulation for the linear case. The main modification happens in the evaluation of the resolvent of B . The authors provide convergence guarantees under assumptions of the behaviour of the sequence of stepsizes covered in our framework (see Remark 4.9 ). In the present work, we take a different approach and propose to compose the original DR operator with a suitable fixed-point relocator operator, while keeping the classical steps that define the operator in ( 2 ). For the stepsize rule defined in [ 20 ] , the non-stationary DR algorithm in [ 20 , Eq. (12)] and Algorithm 1 coincide (see Remark 4.11 ). In both cases, when the sequence of stepsizes is constant, we retrieve the original DR algorithm. The perspective offered by our framework allows for the analysis of various other resolvent splitting algorithms for solving extensions of ( 1 ) involving N\geq 2 maximally monotone operators such as [ 31 , 22 ] . The remainder of this paper is organized as follows. In Section 2 , we introduce the notation used throughout the paper as well as recalling mathematical preliminaries for use in our analysis. In Section 3 , we present new calculus and continuity results for resolvents and the DR operator as well as introducing an extension of the demiclosedness principle for nonexpansive operators which we term the parametric demiclosedness principle . In Section 4 , we introduce the notion of a fixed-point relocator, establish our main results regarding convergence of relocated fixed-point iterations, and provide some examples of this type of iterative method. In Section 5 , we present further instances of the relocated fixed-point iteration framework, including a variable stepsize version of graph-based extensions of the DR algorithm introduced in [ 7 ] for N\geq 2 operators, and derive its convergence properties. We finish in Section 6 with some concluding remarks. 2 Preliminaries We denote the set of nonnegative real numbers by \mathbb{R}_{+} and the set of positive real numbers by \mathbb{R}_{++} . We say that a sequence of real numbers (\delta_{n})_{n\in{\mathbb{N}}} is decreasing (resp. increasing) if (\forall{n\in{\mathbb{N}}}) \delta_{n}\geq\delta_{n+1} (resp. \delta_{n}\leq\delta_{n+1} ). This is also called “nonincreasing” (resp. “nondecreasing”) in the literature. Given a real Hilbert space X , we use the notation X^{\text{strong}} to denote the space X endowed with the norm topology. Similarly, X^{\text{weak}} denotes X endowed with the weak topology. For a nonempty set D\subseteq X , D^{\text{weak}} denotes the set D with the topology induced by X^{\text{weak}} . Given a set C\subseteq X , \overline{C} denotes the closure of C in X^{\text{strong}} . For k\geq 1 , X^{k}:=X\times\dots\times X denotes the k -fold product space. Given a set-valued operator A:X\rightrightarrows X , its domain is denoted by \operatorname{dom}\,A:=\{x\in X:Ax\neq\varnothing\} , its graph by \operatorname{gra}A:=\{(x,y)\in X\times X:y\in Ax\} , its set of zeros by \operatorname{zer}A:=\{x\in X:0\in Ax\} , and its set of fixed-points by \operatorname{Fix}A:=\{x\in X:x\in Ax\} . We also denote the inverse of A by A^{-1}:X\rightrightarrows X which is defined by \operatorname{gra}A^{-1}:=\{(y,x)\in X\times X:y\in Ax\} . We say A is monotone if (\forall(x,y),(u,v)\in\operatorname{gra}A)\;\langle x-u,y-v\rangle\geq 0, and maximally monotone if it has no proper monotone extension. In the study of convergence of iterative algorithms, closure properties of an underlying maximally monotone operator often play a crucial role. Definition 2.1 (Demiclosedness). Let D\subseteq X be a nonempty weakly sequentially closed set. We say a set-valued operator T:D\rightrightarrows X is demiclosed if \operatorname{gra}T is sequentially closed in D^{\text{weak}}\times X^{\text{strong}} . Fact 2.2 ( [ 5 , Corollary 20.38(ii)] ). Let A be a maximally monotone operator on X . Then A is demiclosed. The sum of two maximally monotone operators need not be maximally monotone in general. However, under some additional assumptions [ 5 ] , the resulting sum operator is maximally monotone. We recall one setting of importance for our analysis in which this statement is true. Fact 2.3 ( [ 5 , Corollary 25.5(i)] ). Suppose A and B are maximally monotone operators on X , with one of them having full domain. Then A+B is maximally monotone. The convergence framework we develop in this work focuses on a particular type of iteration operators, the so-called nonexpansive operators. A single-valued operator T:X\to X is said to be: (i) nonexpansive if (\forall x,y\in X)\;\|Tx-Ty\|\leq\|x-y\|. (ii) firmly nonexpansive if (\forall x,y\in X)\;\|Tx-Ty\|^{2}+\|(\operatorname{Id}-T)x-(\operatorname{Id}-T)y\|^{2}\leq\|x-y\|^{2}. (iii) \alpha -averaged (nonexpansive) if \alpha\in(0,1) and (\forall x,y\in X)\;\|Tx-Ty\|^{2}+\frac{1-\alpha}{\alpha}\|(\operatorname{Id}-T)x-(\operatorname{Id}-T)y\|^{2}\leq\|x-y\|^{2}. Equivalent to (iii) , T is \alpha -averaged nonexpansive if there exists a nonexpansive operator R such that T=(1-\alpha)\operatorname{Id}+\alpha R . Thus, in particular, an operator T is firmly nonexpansive if and only if T is \frac{1}{2} -averaged. Given a nonempty set C\subseteq X , the normal cone to C at x\in C is given by N_{C}(x):=\{v\in C:(\forall y\in C)\;\langle v,y-x\rangle\leq 0\} , and if x\notin C , N_{C}(x):=\varnothing . If C\subseteq X is a nonempty closed convex set, then N_{C} is maximally monotone. The projection operator onto C is P_{C}=J_{N_{C}} . The following fact summarizes important properties of resolvents and averaged operators. Fact 2.4 (Properties of resolvents). Suppose A is a maximally monotone operator on X . Then, the following statements hold true. (i) (\forall\alpha\in\mathbb{R}_{++}) J_{\alpha A} and \operatorname{Id}-J_{\alpha A} are well-defined, have full domain, and are firmly nonexpansive and maximally monotone. (ii) (\forall\gamma,\lambda\in\mathbb{R}_{++})(\forall x\in X) J_{\gamma A}x=J_{\lambda\gamma A}(\lambda x+(1-\lambda)J_{\gamma A}x) . (iii) (\forall\gamma,\lambda\in\mathbb{R}_{++})(\forall x\in X) \|J_{\gamma A}x-J_{\lambda\gamma A}x\|\leq|1-\lambda|\|J_{\gamma A}x-x\| . (iv) (\forall x\in X) J_{\gamma A}x\to P_{\overline{\operatorname{dom}\,A}}x as \gamma\downarrow 0 . The properties in (i) follows from [ 23 ] , [ 5 , Corollary 23.9] and [ 5 , Corollary 23.11(i)] . Moreover, items (ii) – (iv) are, respectively, [ 5 , Proposition 23.31(i)] , [ 5 , Proposition 23.31(iii)] , and [ 5 , Theorem 23.48] . ∎ Fact 2.5 (Properties of averaged operators). Let \alpha\in(0,1) and T:X\to X be a nonexpansive operator. Then, the following hold. (i) T is \alpha -averaged operator if and only if (1-\frac{1}{\alpha})\operatorname{Id}+\frac{1}{\alpha}T is nonexpansive. (ii) (\forall\lambda\in(0,\frac{1}{\alpha})) T is \alpha -averaged operator if and only if (1-\lambda)\operatorname{Id}+\lambda T is \lambda\alpha -averaged. Item (i) is [ 5 , Proposition 4.35] , and item (ii) is [ 5 , Proposition 4.40] . ∎ In the following facts, we recall the standard convergence result of the DR algorithm. Fact 2.6 (Convergence of the DR algorithm). Suppose that A,B are maximally monotone operators on X such that Z:=\operatorname{zer}(A+B)\neq\varnothing , and that T_{\gamma} is the associated DR operator defined in ( 2 ). Then, given an arbitrary initial point x\in X and a stepsize parameter \gamma\in\mathbb{R}_{++} , the sequence (T_{\gamma}^{n}x)_{{n\in{\mathbb{N}}}} converges weakly to a point \bar{x}\in\operatorname{Fix}T_{\gamma} , and the sequence \big(J_{\gamma A}T_{\gamma}^{n}x)_{{n\in{\mathbb{N}}}} converges weakly to J_{\gamma A}\bar{x}\in Z . See, e.g., [ 18 , Theorem 1] and [ 32 , Theorem 1] . ∎ In Fact 2.6 , the weak limit of the sequence (T_{\gamma}^{n}x)_{{n\in{\mathbb{N}}}} is generally not a solution to problem ( 1 ). The sequence whose weak limit corresponds to a solution is (J_{\gamma A}T_{\gamma}^{n}x)_{{n\in{\mathbb{N}}}} , also known as the shadow sequence . Moreover, the sequence given by (J_{\gamma B}R_{\gamma A}T_{\gamma}^{n}x)_{{n\in{\mathbb{N}}}} also converges weakly to a solution to problem ( 1 ). The following is a fundamental result for proving convergence of iterative algorithms. We will use it in our analysis. Fact 2.7 (Robbins–Siegmund). Let (\alpha_{n})_{n\in{\mathbb{N}}},(\beta_{n})_{n\in{\mathbb{N}}},(\varepsilon_{n})_{n\in{\mathbb{N}}}\subseteq\mathbb{R}_{+} be sequences such that \sum_{n\in{\mathbb{N}}}\varepsilon_{n}<+\infty and (\forall{n\in{\mathbb{N}}})\;\alpha_{n+1}\leq(1+\varepsilon_{n})\alpha_{n}-\beta_{n}. Then (\alpha_{n})_{n\in{\mathbb{N}}} converges and \sum_{n\in{\mathbb{N}}}\beta_{n}<+\infty . This is a special deterministic case of a classical probabilistic result by Robbins and Siegmund [ 30 ] . See also [ 29 , Lemma 11 on page 50] , [ 9 , Lemma 3.1] , [ 5 , Lemma 5.31] , as well as [ 24 , Theorem 3.2] for a very recent quantitative version. ∎ The last component of our analysis relies on a generalization of Fejér monotonicity property for sequences called the Opial property [ 3 ] . Definition 2.8 (Opial sequence). Let C be a nonempty subset of X . A sequence (x_{n})_{n\in{\mathbb{N}}} in X is said to be Opial with respect to C if (\forall c\in C)\;\lim_{n\to\infty}\lVert x_{n}-c\rVert\; exists. Fact 2.9 ( [ 3 , Proposition 2.1, Corollary 2.3] , [ 27 , Lemma 5.2] ). Let (x_{n})_{n\in{\mathbb{N}}} be a sequence in X which is Opial with respect to a nonempty set C\subseteq X . Then, the following statements are true. (i) (x_{n})_{n\in{\mathbb{N}}} is bounded. (ii) (x_{n})_{n\in{\mathbb{N}}} converges weakly to a point in C if and only if all weak cluster points of (x_{n})_{n\in{\mathbb{N}}} lie in C . 3 Properties of resolvents and nonexpansive operators In this section, we derive a number of new properties of resolvents and explore their consequences for the Douglas–Rachford operator. The insights of this section will form the basis and motivating examples for the framework developed in the subsequent sections. 3.1 Properties of resolvents In this section, we first present a resolvent rule that yields a bijection between fixed-point sets of the DR operator as a function of the stepsize. This rule allows us to define an operator that transforms fixed-points of the DR operator as a function of stepsize. We also establish continuity properties of the map (x,\gamma)\mapsto J_{\gamma A}x for a given maximally monotone operator A . Lemma 3.1 . Let A be maximally monotone on X , and let \alpha,\beta\in\mathbb{R}_{++} . Then J_{\beta A}\Big(\tfrac{\beta}{\alpha}\operatorname{Id}+\big(1-\tfrac{\beta}{\alpha}\big)J_{\alpha A}\Big)=J_{\alpha A} (10) and \Big(\tfrac{\alpha}{\beta}\operatorname{Id}+\big(1-\tfrac{\alpha}{\beta}\big)J_{\beta A}\Big)\Big(\tfrac{\beta}{\alpha}\operatorname{Id}+\big(1-\tfrac{\beta}{\alpha}\big)J_{\alpha A}\Big)=\operatorname{Id}=\Big(\tfrac{\beta}{\alpha}\operatorname{Id}+\big(1-\tfrac{\beta}{\alpha}\big)J_{\alpha A}\Big)\Big(\tfrac{\alpha}{\beta}\operatorname{Id}+\big(1-\tfrac{\alpha}{\beta}\big)J_{\beta A}\Big). (11) Consequently, \tfrac{\alpha}{\beta}\operatorname{Id}+\big(1-\tfrac{\alpha}{\beta}\big)J_{\beta A}\colon X\to X\text{ is a bijection with inverse }\tfrac{\beta}{\alpha}\operatorname{Id}+\big(1-\tfrac{\beta}{\alpha}\big)J_{\alpha A}. (12) Applying Fact 2.4 (ii) with \gamma=\alpha and \lambda=\beta/\alpha yields ( 10 ). Using ( 10 ) in the second identity, we deduce \displaystyle\Big(\tfrac{\alpha}{\beta}\operatorname{Id}+\big(1-\tfrac{\alpha}{\beta}\big)J_{\beta A}\Big)\Big(\tfrac{\beta}{\alpha}\operatorname{Id}+\big(1-\tfrac{\beta}{\alpha}\big)J_{\alpha A}\Big) \displaystyle=\operatorname{Id}+\Big(\tfrac{\alpha}{\beta}-1\Big)J_{\alpha A}+\Big(1-\tfrac{\alpha}{\beta}\Big)J_{\beta A}\Big(\tfrac{\beta}{\alpha}\operatorname{Id}+\big(1-\tfrac{\beta}{\alpha}\big)J_{\alpha A}\Big) \displaystyle=\operatorname{Id}, and so the left identity in ( 11 ) holds. To obtain the right identity in ( 11 ), we use the left identity, with the roles of \alpha and \beta interchanged. Finally, ( 12 ) follows from ( 11 ). ∎ Lemma 3.1 provides a bijective map useful for computing resolvents with stepsizes only requiring linear algebra operations and the knowledge of the resolvent for one fixed parameter. In the next result, we study further properties of this bijection. Proposition 3.2 . Let A be maximally monotone on X , and let \alpha,\beta\in\mathbb{R}_{++} . Consider the operator defined by Q_{\beta\leftarrow\alpha}:=\tfrac{\beta}{\alpha}\operatorname{Id}+\big(1-\tfrac{\beta}{\alpha}\big)J_{\alpha A}. Then: (i) If \beta<\alpha , then Q_{\beta\leftarrow\alpha} is (\tfrac{1}{2}-\tfrac{\beta}{2\alpha}) -averaged and hence firmly nonexpansive. (ii) If \beta\geq\alpha , then Q_{\beta\leftarrow\alpha} is monotone, \tfrac{\beta}{\alpha} -Lipschitz continuous, and (\forall z,\bar{z}\in X)\quad\|Q_{\beta\leftarrow\alpha}z-Q_{\beta\leftarrow\alpha}\bar{z}\|^{2}+\bigl(\frac{\beta^{2}}{\alpha^{2}}-1\bigr)\|J_{\alpha A}z-J_{\alpha A}\bar{z}\|^{2}\leq\frac{\beta^{2}}{\alpha^{2}}\|z-\bar{z}\|^{2}. (13) (i) Since J_{\alpha A} is firmly nonexpansive from Fact 2.4 (i) and 0<1-\frac{\beta}{\alpha}<1<2 , the result follows from Fact 2.5 (ii) with \alpha=1/2 and \lambda=1-\beta/\alpha . (ii) Assume \beta\geq\alpha and let z,\bar{z}\in X . Since J_{\alpha A} is firmly nonexpansive, we have \|J_{\alpha A}z-J_{\alpha A}\bar{z}\|^{2}\leq\langle z-\bar{z},J_{\alpha A}z-J_{\alpha A}\bar{z}\rangle. Using this inequality and noting that 1-\frac{\beta}{\alpha}\leq 0 , we deduce \displaystyle\|Q_{\beta\leftarrow\alpha}z-Q_{\beta\leftarrow\alpha}\bar{z}\|^{2} \displaystyle=\left\|\frac{\beta}{\alpha}(z-\bar{z})+\left(1-\frac{\beta}{\alpha}\right)(J_{\alpha A}z-J_{\alpha A}\bar{z})\right\|^{2} \displaystyle=\frac{\beta^{2}}{\alpha^{2}}\|z-\bar{z}\|^{2}+\left(1-\frac{\beta}{\alpha}\right)^{2}\|J_{\alpha A}z-J_{\alpha A}\bar{z}\|^{2}+2\frac{\beta}{\alpha}\left(1-\frac{\beta}{\alpha}\right)\langle z-\bar{z},J_{\alpha A}z-J_{\alpha A}\bar{z}\rangle \displaystyle\leq\frac{\beta^{2}}{\alpha^{2}}\|z-\bar{z}\|^{2}+\left(1-\frac{\beta}{\alpha}\right)^{2}\|J_{\alpha A}z-J_{\alpha A}\bar{z}\|^{2}+2\frac{\beta}{\alpha}\left(1-\frac{\beta}{\alpha}\right)\|J_{\alpha A}z-J_{\alpha A}\bar{z}\|^{2} \displaystyle=\frac{\beta^{2}}{\alpha^{2}}\|z-\bar{z}\|^{2}+\left(1-\frac{\beta^{2}}{\alpha^{2}}\right)\|J_{\alpha A}z-J_{\alpha A}\bar{z}\|^{2}, which yields ( 13 ), and hence \tfrac{\beta}{\alpha} -Lipschitz continuity of Q_{\beta\leftarrow\alpha} . To see that Q_{\beta\leftarrow\alpha} is monotone, note the representation Q_{\beta\leftarrow\alpha}=\frac{\beta}{\alpha}(\operatorname{Id}-J_{\alpha A})+J_{\alpha A} . Since both \operatorname{Id}-J_{\alpha A} and J_{\alpha A} are monotone in view of Fact 2.4 (i) and \frac{\beta}{\alpha}\in\mathbb{R}_{++} , monotonicity of Q_{\beta\leftarrow\alpha} follows. ∎ Remark 3.3 . The Lipschitz bound in Proposition 3.2 (ii) is sharp. Indeed, taking A=N_{\{0\}} yields Q_{\beta\leftarrow\alpha}=\tfrac{\beta}{\alpha}\operatorname{Id} which is \tfrac{\beta}{\alpha} -Lipschitz continuous. Note that, due to ( 10 ), the operator Q_{\beta\leftarrow\alpha} in Proposition 3.2 satisfies J_{\beta A}Q_{\beta\leftarrow\alpha}=J_{\alpha A}. This identity will be used to propose a variable stepsize extension of the Douglas–Rachford algorithm. In order to analyze its convergence, we will also need the following continuity properties of the resolvent J_{\gamma A}x as a function of both x and \gamma , which were considered in [ 14 , Corollary 7] in the context of convex subdifferentials in finite dimensional Euclidean spaces. Proposition 3.4 . Let A be maximally monotone on X , and define S_{A}\colon X\times\mathbb{R}_{+}\to X according to S_{A}(x,\gamma):=\begin{cases}J_{\gamma A}x&\gamma\in\mathbb{R}_{++},\\ P_{\overline{\operatorname{dom}\,A}}x&\gamma=0.\\ \end{cases} Then S_{A} is continuous on X\times\mathbb{R}_{+} and Lipschitz continuous on compact subsets of X\times\mathbb{R}_{++} . We first show that S_{A} is continuous on X\times\mathbb{R}_{+} . To this end, let (x,\lambda)\in X\times\mathbb{R}_{+} and suppose (y,\gamma)\to(x,\lambda) . First, assume \lambda\in\mathbb{R}_{++} . Using Facts 2.4 (iii) and (i) , we deduce that \displaystyle\|S_{A}(x,\lambda)-S_{A}(y,\gamma)\| \displaystyle\leq\|J_{\lambda A}x-J_{\gamma A}x\|+\|J_{\gamma A}x-J_{\gamma A}y\| (14) \displaystyle\leq\frac{\|J_{\lambda A}x-x\|}{\lambda}|\lambda-\gamma|+\|x-y\|\to 0. Next, assume \lambda=0 . If \gamma>0 , using Fact 2.4 (i) , we deduce \displaystyle\|S_{A}(x,0)-S_{A}(y,\gamma)\| \displaystyle\leq\|P_{\overline{\operatorname{dom}\,A}}x-J_{\gamma A}x\|+\|J_{\gamma A}x-J_{\gamma A}y\| \displaystyle\leq\|P_{\overline{\operatorname{dom}\,A}}x-J_{\gamma A}x\|+\|x-y\|. And, if \gamma=0 , Fact 2.4 (i) gives \|S_{A}(x,0)-S_{A}(y,0)\|\leq\|P_{\overline{\operatorname{dom}\,A}}x-P_{\overline{\operatorname{dom}\,A}}y\|\leq\|x-y\|. Combining these two subcases and noting Fact 2.4 (iv) , we deduce that \|S_{A}(x,0)-S_{A}(y,\gamma)\|\to 0 . Thus, in all cases, \lim_{(y,\lambda)\to(x,\gamma)}S_{A}(y,\lambda)=S_{A}(x,\gamma) which establishes continuity of S_{A} on X\times\mathbb{R}_{+} . To show that S_{A} is Lipschitz continuous on compact subsets of X\times\mathbb{R}_{++} , let U\subseteq X\times\mathbb{R}_{++} be compact. Since S_{A} is continuous and the continuous image of compact sets is compact, we have L:=\max_{(x,\lambda)\in U}\frac{\|J_{\lambda A}x-x\|}{\lambda}<+\infty. Then, using ( 14 ), we obtain (\forall(x,\lambda),(y,\gamma)\in U) \|S_{A}(x,\lambda)-S_{A}(y,\gamma)\|\leq\max\{L,1\}\left(|\lambda-\gamma|+\|x-y\|\right)\leq\sqrt{2}\max\{L,1\}\|(x,\lambda)-(y,\gamma)\|, which shows that S_{A} is Lipschitz on U . ∎ 3.2 Properties of the Douglas–Rachford operator In this section, we explore a number of consequences of the resolvent properties derived in the previous section for the Douglas–Rachford operator T_{\gamma}:=\operatorname{Id}-J_{\gamma A}+J_{\gamma B}R_{\gamma A} . First, we show that the bijective map of Lemma 3.1 also defines a bijection between fixed-point sets of the DR operator for different stepsize parameters, and show continuity properties of the operator (x,\gamma)\mapsto T_{\gamma}x . Theorem 3.5 . Let A,B be maximally monotone on X , T_{\gamma} be the DR operator defined in ( 2 ), and \alpha,\beta\in\mathbb{R}_{++} . Then \Big(\tfrac{\beta}{\alpha}\operatorname{Id}+\big(1-\tfrac{\beta}{\alpha}\big)J_{\alpha A}\Big)\Big|_{\operatorname{Fix}T_{\alpha}}\colon\operatorname{Fix}T_{\alpha}\to\operatorname{Fix}T_{\beta}\text{ is a bijection, with inverse }\Big(\tfrac{\alpha}{\beta}\operatorname{Id}+\big(1-\tfrac{\alpha}{\beta}\big)J_{\beta A}\Big)\Big|_{\operatorname{Fix}T_{\beta}}. Let x\in\operatorname{Fix}T_{\alpha} . Then z:=J_{\alpha A}x=J_{\alpha B}R_{\alpha A}x\in\operatorname{zer}(A+B)\;\text{ and }\;R_{\alpha A}x=2z-x. Now set y:=\tfrac{\beta}{\alpha}x+\big(1-\tfrac{\beta}{\alpha}\big)J_{\alpha A}x=\tfrac{\beta}{\alpha}x+\big(1-\tfrac{\beta}{\alpha}\big)z. Using ( 10 ) thrice, we deduce that J_{\beta A}y=J_{\alpha A}x=z and \displaystyle J_{\beta A}y \displaystyle=J_{\beta A}\Big(\tfrac{\beta}{\alpha}\operatorname{Id}+\big(1-\tfrac{\beta}{\alpha}\big)J_{\alpha A}\Big)x=J_{\alpha A}x=z=J_{\alpha B}R_{\alpha A}x=J_{\alpha B}(2z-x) \displaystyle=J_{\beta B}\Big(\tfrac{\beta}{\alpha}(2z-x)+\big(1-\tfrac{\beta}{\alpha}\big)J_{\alpha B}(2z-x)\Big)=J_{\beta B}\Big(\tfrac{\beta}{\alpha}(2z-x)+\big(1-\tfrac{\beta}{\alpha}\big)z\Big) \displaystyle=J_{\beta B}\Big(2z-\big(1-\tfrac{\beta}{\alpha}\big)z-\tfrac{\beta}{\alpha}x\Big)=J_{\beta B}(2z-y)=J_{\beta B}R_{\beta A}y. Hence z=J_{\beta A}y=J_{\beta B}R_{\beta A}y and so y\in\operatorname{Fix}T_{\beta} . The conclusion now follows from Lemma 3.1 . ∎ Combining the previous theorem with the continuity result in Proposition 3.4 yields the following for the DR operator. Corollary 3.6 . Let A and B be maximally monotone on X , and T_{\gamma} be the DR operator defined in ( 2 ). The operator X\times\mathbb{R}_{+}\to X\colon(x,\gamma)\mapsto\begin{cases}T_{\gamma}x&\gamma\in\mathbb{R}_{++}\\ x-P_{\overline{\operatorname{dom}\,A}}x+P_{\overline{\operatorname{dom}\,B}}(2P_{\overline{\operatorname{dom}\,B}}x-x)&\gamma=0,\\ \end{cases} is continuous on X\times\mathbb{R}_{+} and locally Lipschitz continuous on compact subsets of X\times\mathbb{R}_{++} . Since T_{\gamma}=\operatorname{Id}-J_{\gamma A}+J_{\gamma B}(2J_{\gamma A}-\operatorname{Id}) , the result follows from Proposition 3.4 . ∎ The results proven in this section, in particular, Lemma 3.1 , Proposition 3.2 and Theorem 3.5 , motivate the abstract framework we develop in Section 4 . The operator Q_{\beta\leftarrow\alpha} defined in Proposition 3.2 will provide the first example of what we will soon call a fixed-point relocator (Definition 4.1 ). 3.3 Parametric demiclosedness principle As mentioned in the introduction, resolvents — and thus in particular the DR iteration operator in ( 2 ) — are not necessarily weakly continuous. Browder’s celebrated demiclosedness princple [ 8 ] provides an alternative to assuming weak continuity of the operator in infinite-dimensional spaces. In this section, we investigate a parametric version of the demiclosedness principle. We start by recalling the principle as it is presented in [ 5 ] . Fact 3.7 (Demiclosedness principle [ 5 , Theorem 4.27] ). Let D\subseteq X be a nonempty sequentially closed set, and let T:D\mapsto X be a nonexpansive operator. Then \operatorname{Id}-T is demiclosed. In their current forms, neither Definition 2.1 or Fact 3.7 apply to the Douglas–Rachford operator as a function of its stepsize. This motivates the following definition. Definition 3.8 (Parametric demiclosedess). Let D\subseteq X be a nonempty sequentially closed set, and \Gamma\subseteq\mathbb{R} be a nonempty set. We say an operator G:D\times\Gamma\to X is parametrically demiclosed if \operatorname{gra}G is sequentially closed in (X^{\text{weak}}\times\Gamma)\times X^{\text{strong}} . The following result establishes a parametric generalisation of Fact 3.7 . Theorem 3.9 (Parametric demiclosedness principle). Let D\subseteq X be a nonempty weakly sequentially closed set, \Gamma\subseteq\mathbb{R} be a nonempty closed set, and let (T_{\gamma})_{\gamma\in\Gamma} be a family of nonexpansive operators from D to X , such that (\forall x\in D)\;\gamma\mapsto T_{\gamma}x is (strongly) continuous. Then the operator \displaystyle D\times\Gamma \displaystyle\to X\colon(x,\gamma)\mapsto(\operatorname{Id}-T_{\gamma})x is parametrically demiclosed. Let (x_{n},\gamma_{n})_{n\in{\mathbb{N}}} be a sequence in D\times\Gamma such that x_{n}\>{\rightharpoonup}\>x\in D , \gamma_{n}\to\overline{\gamma}\in\Gamma , and x_{n}-T_{\gamma_{n}}x_{n}=(\operatorname{Id}-T_{\gamma_{n}})x_{n}\to u . We shall prove that (\operatorname{Id}-T_{\overline{\gamma}})x=u . Indeed, the continuity of \gamma\mapsto T_{\gamma}x yields T_{\overline{\gamma}}x-T_{\gamma_{n}}x\to 0 . Thus, using the nonexpansiveness of T_{\gamma_{n}} and the reverse triangle inequality, we have \displaystyle\liminf_{n\to\infty}\|x_{n}-x\| \displaystyle\geq\liminf_{n\to\infty}\|T_{\gamma_{n}}x_{n}-T_{\gamma_{n}}x\| \displaystyle=\liminf_{n\to\infty}\|(x_{n}-T_{\overline{\gamma}}x-u)+(u+T_{\gamma_{n}}x_{n}-x_{n})+(T_{\overline{\gamma}}x-T_{\gamma_{n}}x)\| \displaystyle\geq\liminf_{n\to\infty}\|x_{n}-T_{\overline{\gamma}}x-u\|-\|u+T_{\gamma_{n}}x_{n}-x_{n}\|-\|T_{\overline{\gamma}}x-T_{\gamma_{n}}x\| \displaystyle=\liminf_{n\to\infty}\|x_{n}-T_{\overline{\gamma}}x-u\|-\lim_{n\to\infty}\|u+T_{\gamma_{n}}x_{n}-x_{n}\|-\lim_{n\to\infty}\|T_{\overline{\gamma}}x-T_{\gamma_{n}}x\| \displaystyle=\liminf_{n\to\infty}\|x_{n}-T_{\overline{\gamma}}x-u\|. In view of [ 25 , Lemma 1] , we must have x=T_{\overline{\gamma}}x+u , or equivalently, (\operatorname{Id}-T_{\overline{\gamma}})x=u , which completes the proof. ∎ Remark 3.10 . When \Gamma is a singleton, parametric demiclosedness coincides and standard demiclosedness coincide. Consequently, Theorem 3.9 recovers Fact 3.7 . 4 Relocated fixed-point iterations In this section, we propose a framework for sequences constructed as fixed-point iterations of a parametrized family of operators (T_{\gamma})_{\gamma\in\Gamma} composed with operators (Q_{\delta\leftarrow\gamma})_{\gamma,\delta\in\Gamma} that relocate fixed-point sets. This setting covers resolvent-based algorithms with variable stepsizes, such as the DR algorithm, as discussed by the end of this section. We show that given a parametric family of nonexpansive operators (T_{\gamma})_{\gamma\in\Gamma} and a sequence of stepsizes (\gamma_{n})_{n\in{\mathbb{N}}} converging to some \overline{\gamma} , under appropriate assumptions, the corresponding relocated fixed-point iteration generates a sequence that converges weakly to a fixed-point of T_{\overline{\gamma}} . 4.1 Convergence of relocated fixed-point iterations We start by defining the concept of fixed-point relocator. Definition 4.1 (Fixed-point relocator). Let \Gamma\subseteq\mathbb{R}_{++} be a nonempty set, and let (T_{\gamma})_{\gamma\in\Gamma} be a family of operators from X to X . We say that the family of operators (Q_{\delta\leftarrow\gamma})_{\gamma,\delta\in\Gamma} on X defines fixed-point relocators for (T_{\gamma})_{\gamma\in\Gamma} with Lipschitz constants (\mathcal{L}_{\delta\leftarrow\gamma})_{\gamma,\delta\in\Gamma} in [1,+\infty[ if the following hold. (i) (\forall\gamma,\delta\in\Gamma) Q_{\delta\leftarrow\gamma}|_{\operatorname{Fix}T_{\gamma}} is a bijection from \operatorname{Fix}T_{\gamma} to \operatorname{Fix}T_{\delta} . (ii) (\forall\gamma\in\Gamma)(\forall x\in\operatorname{Fix}T_{\gamma}) \Gamma\to X\colon\delta\mapsto Q_{\delta\leftarrow\gamma}x is continuous. (iii) (\forall\gamma,\delta,\varepsilon\in\Gamma)(\forall x\in\operatorname{Fix}T_{\gamma}) Q_{\varepsilon\leftarrow\delta}Q_{\delta\leftarrow\gamma}x=Q_{\varepsilon\leftarrow\gamma}x . (iv) (\forall\gamma,\delta\in\Gamma) Q_{\delta\leftarrow\gamma} is \mathcal{L}_{\delta\leftarrow\gamma} -Lipschitz continuous. Remark 4.2 (Fixed-point relocators outside the fixed-point set). Given fixed-point relocators (Q_{\delta\leftarrow\gamma})_{\gamma,\delta\in\mathbb{R}_{++}} for (T_{\gamma})_{\gamma\in\mathbb{R}_{++}} , observe that Definition 4.1 (i) – (iii) only need to hold on \operatorname{Fix}T_{\gamma} . Therefore, a fixed-point relocator does not have to be unique. In fact, any Lipschitz operator \tilde{Q}_{\delta\leftarrow\gamma} such that Q_{\delta\leftarrow\gamma}|_{\operatorname{Fix}T_{\gamma}}=\tilde{Q}_{\delta\leftarrow\gamma}|_{\operatorname{Fix}T_{\gamma}} also defines a fixed-point relocator for (T_{\gamma})_{\gamma\in\mathbb{R}_{++}} . We give an example of a such a case in Proposition 5.5 . Within the context of Definition 4.1 , our goal is to analyze the sequence of successive approximations (T_{\gamma}x)_{\gamma\in\Gamma} , for a given x\in X , transformed by a fixed-point relocator. In order to do that, we consider the following assumption. Assumption 4.3 . Consider a nonempty set \Gamma\subseteq\mathbb{R}_{++} , and (T_{\gamma})_{\gamma\in\Gamma} a family of nonexpansive operators on X such that (i) (\exists\,\alpha\in\left]0,1\right[)(\forall\gamma\in\Gamma) T_{\gamma} is \alpha -averaged. (ii) X\times\Gamma\to X\colon(x,\gamma)\mapsto T_{\gamma}x is continuous. Note that an instance of operators T_{\gamma} in Definition 4.1 satisfying Assumption 4.3 is the DR operator in ( 2 ), in view of Corollary 3.6 . We are now ready for our main result. Theorem 4.4 (Convergence of relocated fixed-point iterations). Let \Gamma\subseteq\mathbb{R}_{++} be nonempty, (T_{\gamma})_{\gamma\in\Gamma} be a family of nonexpansive operators on X , such that (\forall\gamma\in\Gamma)\;\operatorname{Fix}T_{\gamma}\neq\varnothing , and (Q_{\delta\leftarrow\gamma})_{\gamma,\delta\in\Gamma} on X be fixed-point relocators for (T_{\gamma})_{\gamma\in\Gamma} with Lipschitz constant (\mathcal{L}_{\delta\leftarrow\gamma})_{\gamma,\delta\in\Gamma} in [1,+\infty[ . Furthermore, let (\gamma_{n})_{n\in{\mathbb{N}}}\text{~in~}\Gamma\text{~be a sequence that converges to~}\overline{\gamma}\in\Gamma\text{~and~}\sum_{n\in{\mathbb{N}}}(\mathcal{L}_{\gamma_{n+1}\leftarrow\gamma_{n}}-1)<+\infty. (15) Let x_{0}\in X and generate a sequence (x_{n})_{n\in{\mathbb{N}}} according to (\forall{n\in{\mathbb{N}}})\;x_{n+1}:=Q_{\gamma_{n+1}\leftarrow\gamma_{n}}T_{\gamma_{n}}x_{n}. Then the following hold. (i) The sequence (x_{n})_{n\in{\mathbb{N}}} is Opial with respect to \operatorname{Fix}T_{\overline{\gamma}} . (ii) If Assumption 4.3 (i) holds, then x_{n}-T_{\gamma_{n}}x_{n}\to 0 . (iii) If Assumption 4.3 (i) & (ii) hold, then both (x_{n})_{n\in{\mathbb{N}}} and (T_{\gamma_{n}}x_{n})_{n\in{\mathbb{N}}} converge weakly to the same point in \operatorname{Fix}T_{\overline{\gamma}} . (i) : Let C:=\operatorname{Fix}T_{\overline{\gamma}}\neq\varnothing . For arbitrary c\in C , set c_{0}:=Q_{\gamma_{0}\leftarrow\overline{\gamma}}c\in\operatorname{Fix}T_{\gamma_{0}} , which holds true in view of Definition 4.1 (i) . Define a sequence (c_{n})_{n\in{\mathbb{N}}} according to (\forall{n\in{\mathbb{N}}})\;c_{n+1}:=Q_{\gamma_{n+1}\leftarrow\gamma_{n}}c_{n}. From Definition 4.1 (i) , (ii) and (iii) , we see that (\forall{n\in{\mathbb{N}}})\quad c_{n+1}=Q_{\gamma_{n+1}\leftarrow\gamma_{n}}T_{\gamma_{n}}c_{n}\in\operatorname{Fix}T_{\gamma_{n+1}}\;\text{and}\;c_{n}=Q_{\gamma_{n}\leftarrow\gamma_{0}}c_{0}\to Q_{\overline{\gamma}\leftarrow\gamma_{0}}c_{0}=c\in\operatorname{Fix}T_{\overline{\gamma}}. Thus, using Definition 4.1 (iv) and nonexpansiveness of T_{\gamma_{n}} yields \displaystyle\|x_{n+1}-c_{n+1}\| \displaystyle=\|Q_{\gamma_{n+1}\leftarrow\gamma_{n}}T_{\gamma_{n}}x_{n}-Q_{\gamma_{n+1}\leftarrow\gamma_{n}}c_{n}\|\leq\mathcal{L}_{\gamma_{n+1}\leftarrow\gamma_{n}}\|T_{\gamma_{n}}x_{n}-c_{n}\| (16) \displaystyle=\mathcal{L}_{\gamma_{n+1}\leftarrow\gamma_{n}}\|T_{\gamma_{n}}x_{n}-T_{\gamma_{n}}c_{n}\|\leq\mathcal{L}_{\gamma_{n+1}\leftarrow\gamma_{n}}\|x_{n}-c_{n}\|. Set (\forall{n\in{\mathbb{N}}})\;\varepsilon_{n}=\mathcal{L}_{\gamma_{n+1}\leftarrow\gamma_{n}}-1\geq 0 , so that \sum_{n\in{\mathbb{N}}}\varepsilon_{n}<+\infty due to ( 15 ). In view of Fact 2.7 , (\|x_{n}-c_{n}\|)_{{n\in{\mathbb{N}}}} is convergent and hence there exists L\geq 0 such that \|x_{n}-c_{n}\|\to L . It follows that |\|x_{n}-c_{n}\|-\|c-c_{n}\||\leq\|x_{n}-c\|\leq\|x_{n}-c_{n}\|+\|c_{n}-c\| which implies \|x_{n}-c\|\to L , as c_{n}\to c , showing that (x_{n})_{n\in{\mathbb{N}}} is Opial with respect to C as claimed. (ii) : Suppose Assumption 4.3 (i) holds. Using \alpha -averagedness of the family (T_{\gamma})_{\gamma\in\Gamma} instead of nonexpansiveness in ( 16 ), we obtain \displaystyle\|x_{n+1}-c_{n+1}\|^{2} \displaystyle\leq\mathcal{L}_{\gamma_{n+1}\leftarrow\gamma_{n}}^{2}\|T_{\gamma_{n}}x_{n}-T_{\gamma_{n}}c_{n}\|^{2} \displaystyle\leq\mathcal{L}_{\gamma_{n+1}\leftarrow\gamma_{n}}^{2}\left(\|x_{n}-c_{n}\|^{2}-\frac{1-\alpha}{\alpha}\|T_{\gamma_{n}}x_{n}-x_{n}\|^{2}\right). Applying Fact 2.7 yields \sum_{n\in{\mathbb{N}}}\mathcal{L}_{\gamma_{n+1}\leftarrow\gamma_{n}}^{2}\|T_{\gamma_{n}}x_{n}-x_{n}\|^{2}<+\infty . Since (\forall{n\in{\mathbb{N}}})\;\mathcal{L}_{\gamma_{n+1}\leftarrow\gamma_{n}}\geq 1 from Assumption 4.1 (iv) , it follows that \sum_{n\in{\mathbb{N}}}\|T_{\gamma_{n}}x_{n}-x_{n}\|^{2}<+\infty . Hence x_{n}-T_{\gamma_{n}}x_{n}\to 0 which yields (ii) . (iii) : Suppose that Assumptions 4.3 (i) and (ii) hold. In view of Fact 2.9 (i) , (x_{n})_{n\in{\mathbb{N}}} is bounded. Let x be a weak cluster point of (x_{n})_{n\in{\mathbb{N}}} ; say x_{k_{n}}\>{\rightharpoonup}\>x . By (ii) , x_{k_{n}}-T_{\gamma_{k_{n}}}x_{k_{n}}\to 0 and hence, by the parameteric demiclosedness principle (Theorem 3.9 ), we have x\in\operatorname{Fix}T_{\overline{\gamma}} . Since x is an arbitrary cluster point, it follows that all weak cluster points of (x_{n})_{n\in{\mathbb{N}}} lie in \operatorname{Fix}T_{\overline{\gamma}} . Thus, from Fact 2.9 (ii) , it follows that (x_{n})_{n\in{\mathbb{N}}} converges weakly to x , and (ii) then implies (T_{\gamma_{n}}x_{n})_{n\in{\mathbb{N}}} converges weakly to x=T_{\overline{\gamma}}x . ∎ Remark 4.5 (On the dimension of X and the parametric demiclosedness property). Observe that for infinite-dimensional Hilbert spaces, Assumption 4.3 (ii) need not imply that the operator (x,\gamma)\mapsto T_{\gamma}x is (sequentially) weakly continuous on x (see, e.g., [ 35 , page 245] ). Thus the parametric demiclosedness principle (Theorem 3.9 ) is needed to obtain the results in Theorem 4.4 (iii) . 4.2 Variable stepsize DR algorithm In this section, we establish convergence of Algorithm 1 , the relocated fixed-point iteration extension of the DR algorithm. First, we show that the operator defined in Proposition 3.2 is a fixed-point relocator for the DR operator. Given this example, we see that the construction in Definition 4.1 is natural given the resolvent properties we prove in Section 3 . Lemma 4.6 (Fixed-point relocator for Douglas–Rachford). Given a nonempty set \Gamma\subseteq\mathbb{R}_{++} and the family of DR operators (T_{\gamma})_{\gamma\in\Gamma} from on X defined in ( 2 ), (\forall\gamma,\delta\in\Gamma) the operator Q_{\delta\leftarrow\gamma}:X\to X , such that Q_{\delta\leftarrow\gamma}:=\tfrac{\delta}{\gamma}\operatorname{Id}+\big(1-\tfrac{\delta}{\gamma}\big)J_{\gamma A}, defines a fixed-point relocator for T_{\gamma} with Lipschitz constant \mathcal{L}_{\delta\leftarrow\gamma}=\max\{1,\frac{\delta}{\gamma}\} . Assertions (i) and (ii) from Definition 4.1 directly follow from Theorem 3.5 and Proposition 3.4 , respectively. For Assertion (iii) , let \gamma,\delta,\varepsilon\in\mathbb{R}_{++} . Then, using ( 10 ) from Lemma 3.1 , we obtain \displaystyle Q_{\varepsilon\leftarrow\delta}Q_{\delta\leftarrow\gamma} \displaystyle=\Big(\tfrac{\varepsilon}{\delta}\operatorname{Id}+\big(1-\tfrac{\varepsilon}{\delta}\big)J_{\delta A}\Big)\Big(\tfrac{\delta}{\gamma}\operatorname{Id}+\big(1-\tfrac{\delta}{\gamma}\big)J_{\gamma A}\Big) \displaystyle=\tfrac{\varepsilon}{\gamma}\operatorname{Id}+\big(\tfrac{\varepsilon}{\delta}-\tfrac{\varepsilon}{\gamma}\big)J_{\gamma A}+\big(1-\tfrac{\varepsilon}{\delta}\big)J_{\delta A}\Big(\tfrac{\delta}{\gamma}\operatorname{Id}+\big(1-\tfrac{\delta}{\gamma}\big)J_{\gamma A}\Big) \displaystyle=\tfrac{\varepsilon}{\gamma}\operatorname{Id}+\big(\tfrac{\varepsilon}{\delta}-\tfrac{\varepsilon}{\gamma}\big)J_{\gamma A}+\big(1-\tfrac{\varepsilon}{\delta}\big)J_{\gamma A}=\tfrac{\varepsilon}{\gamma}\operatorname{Id}+\big(1-\tfrac{\varepsilon}{\gamma}\big)J_{\gamma A} \displaystyle=Q_{\varepsilon\leftarrow\gamma}. Finally, assertion (iv) holds due to Proposition 3.2 . ∎ In Section 5 , we provide a number of additional examples of fixed-point relocators based on the one constructed in Lemma 4.6 . In the next result, we show that the iteration scheme in ( 7 ) and Algorithm 1 are equivalent. Proposition 4.7 (Equivalence between relocated fixed-point iteration and efficient implementation of DR). Given x_{0}\in X , the sequences (x_{n})_{n\in{\mathbb{N}}},(w_{n})_{n\in{\mathbb{N}}},(y_{n})_{n\in{\mathbb{N}}},(z_{n})_{n\in{\mathbb{N}}}\subseteq X are generated by Algorithm 2 if and only if (x_{n})_{n\in{\mathbb{N}}} and (w_{n})_{n\in{\mathbb{N}}} conform to ( 7 ) and (\forall{n\in{\mathbb{N}}}) y_{n}=J_{\gamma_{n}B}R_{\gamma_{n}A}x_{n} and z_{n}=J_{\gamma_{n-1}A}w_{n-1} . It follows directly that ( 9 ) is equivalent to the second identity in ( 7 ). To conclude, it suffices to show that 2z_{n}-x_{n}=R_{\gamma_{n}}x_{n} . From ( 10 ) and ( 9 ), it holds that z_{n+1}=J_{\gamma_{n}A}w_{n}=J_{\gamma_{n+1}A}x_{n+1} . The claim follows now from the definition of the reflectent.∎ In the following, we prove a technical result which defines the conditions on the stepsizes that guarantee convergence of Algorithm 1 . Lemma 4.8 . Let \Gamma\subseteq\mathbb{R}_{++} be nonempty and (\gamma_{n})_{n\in{\mathbb{N}}} be a sequence such that \gamma_{\text{low}}:=\inf_{n\in{\mathbb{N}}}\gamma_{n}>0\text{~and~}\sum_{n\in{\mathbb{N}}}(\gamma_{n+1}-\gamma_{n})_{+}<+\infty. (17) Then, the sequence (\varepsilon_{n})_{n\in{\mathbb{N}}} defined by (\forall{n\in{\mathbb{N}}})\;\varepsilon_{n}:=\max\left\{0,\frac{\gamma_{n+1}}{\gamma_{n}}-1\right\} satisfies \sum_{n\in{\mathbb{N}}}\varepsilon_{n}<+\infty. From the assumption, there exists \gamma_{\text{low}}\in\mathbb{R}_{++} such that (\forall{n\in{\mathbb{N}}})\;\gamma_{\text{low}}\leq\gamma_{n} . Then 0\leq\varepsilon_{n}\leq\tfrac{(\gamma_{n+1}-\gamma_{n})_{+}}{\gamma_{\text{low}}}, and hence ( 17 ) implies \sum_{n\in{\mathbb{N}}}\varepsilon_{n}<+\infty. ∎ Remark 4.9 (On the stepsizes assumptions). In the following, we comment on assumption ( 17 ). (i) The assumption \sum_{n\in{\mathbb{N}}}(\gamma_{n+1}-\gamma_{n})_{+}<+\infty is not enough to guarantee convergence of (\gamma_{n})_{n\in{\mathbb{N}}} . Indeed, let (\forall{n\in{\mathbb{N}}})\;a_{n}:=\gamma_{n+1}-\gamma_{n}. (18) Then, (\forall{n\in{\mathbb{N}}})\;\gamma_{n+1}=\gamma_{1}+\sum_{i=1}^{n}a_{i}. Define a_{n}=(\tfrac{1}{2})^{n}\text{~if~}n\text{~is odd} and a_{n}=-1\text{~otherwise.} Then (\forall{n\in{\mathbb{N}}})\;(a_{n})_{+}=(\tfrac{1}{2})^{n}\text{~if~}n\text{~is odd} and (a_{n})_{+}=0\text{~~otherwise,} and \sum_{n\in{\mathbb{N}}}(a_{n})_{+}<+\infty , but (\gamma_{n})_{n\in{\mathbb{N}}} does not converge. (ii) Assumption ( 17 ) is equivalent to the stepsize condition in [ 20 , Theorem 3.2] , namely, (\exists\gamma_{\text{low}},\gamma_{\text{up}}\in\mathbb{R}_{++})\;\gamma_{\text{low}}\leq\gamma_{n}\leq\gamma_{\text{up}}\text{~~and~}\sum_{n\in{\mathbb{N}}}|\gamma_{n+1}-\gamma_{n}|<+\infty. (19) In fact, let ( 19 ) hold. Clearly \sum_{n\in{\mathbb{N}}}(\gamma_{n+1}-\gamma_{n})_{+}\leq\sum_{n\in{\mathbb{N}}}|\gamma_{n+1}-\gamma_{n}| . Since ( 19 ) implies (\gamma_{n})_{n\in{\mathbb{N}}} is a Cauchy sequence, then the limit \overline{\gamma} is bounded below by \gamma_{\text{low}}\in\mathbb{R}_{++} , and thus ( 17 ) holds. Conversely, suppose ( 17 ) holds. Let (a_{n})_{n\in{\mathbb{N}}} be as in ( 18 ). Note that (\forall{n\in{\mathbb{N}}}) (a_{n})_{+}=\frac{a_{n}+|a_{n}|}{2} and \sum_{k=0}^{n}a_{k}=\gamma_{n+1}-\gamma_{0} . Then 2\sum_{k=0}^{n}(a_{k})_{+}=\gamma_{n+1}-\gamma_{0}+\sum_{k=0}^{n}|a_{k}| . In view of ( 17 ), \gamma_{\text{low}}\leq\gamma_{n+1}=\gamma_{0}+2\sum_{k=0}^{n}(a_{k})_{+}-\sum_{k=0}^{n}|a_{k}| , which in turn implies \sum_{k=0}^{n}|a_{k}|\leq\gamma_{0}-\gamma_{\text{low}}+2\sum_{k=0}^{n}(a_{k})_{+} . Taking the limit as n\to+\infty , ( 17 ) implies \sum_{{n\in{\mathbb{N}}}}|\gamma_{n+1}-\gamma_{n}|=\sum_{{n\in{\mathbb{N}}}}|a_{n}|\leq\gamma_{0}-\gamma_{\text{low}}+2\sum_{{n\in{\mathbb{N}}}}(\gamma_{n+1}-\gamma_{n})_{+}<+\infty . Therefore (\gamma_{n})_{n\in{\mathbb{N}}} converges and \gamma_{\text{up}}:=\sup_{n\in{\mathbb{N}}}\gamma<+\infty , yielding ( 19 ). (iii) A sequence (\gamma_{n})_{n\in{\mathbb{N}}} satisfying ( 17 ) can be easily found, for instance, any bounded decreasing sequence of positive real numbers. Furthermore, the construction in ( 18 ) reveals that increasing sequences of stepsizes (\gamma_{n})_{n\in{\mathbb{N}}} can also be included in our analysis, as long as \sum_{n\in{\mathbb{N}}}a_{n} converges. Another example is due to (ii) , as it allows to use the stepsize rules defined in [ 20 , Section 4] . A similar stepsize rule is used in [ 19 ] . The following corollary is our main result regarding convergence of the relocated DR algorithm (Algorithm 1 ). Corollary 4.10 (Convergence of relocated DR algorithm). Let \Gamma\subseteq\mathbb{R}_{++} . Suppose A,B are maximally monotone operators on X such that Z:=\operatorname{zer}(A+B)\neq\varnothing . Let (\gamma_{n})_{n\in{\mathbb{N}}}\text{~in~}\Gamma\text{~be a sequence that converges to~}\overline{\gamma}\in\Gamma\text{~and~}\sum_{n\in{\mathbb{N}}}(\gamma_{n+1}-\gamma_{n})_{+}<+\infty. Given x_{0}\in X , generate the sequences (x_{n})_{n\in{\mathbb{N}}},(w_{n})_{n\in{\mathbb{N}}},(y_{n})_{n\in{\mathbb{N}}},(z_{n})_{n\in{\mathbb{N}}} with Algorithm 1 . Then, (x_{n})_{n\in{\mathbb{N}}} and (w_{n})_{n\in{\mathbb{N}}} converge weakly to some x\in\operatorname{Fix}T_{\overline{\gamma}} , where T_{\gamma} is the DR operator in ( 2 ), and (z_{n})_{n\in{\mathbb{N}}} and (y_{n})_{n\in{\mathbb{N}}} converge weakly to J_{\overline{\gamma}A}x\in Z . First, \operatorname{Fix}T_{\gamma}\neq\varnothing from ( 4 ). Since T_{\gamma} is firmly nonexpansive, Assumption 4.3 (i) holds with \alpha=\tfrac{1}{2} . Assumption 4.3 (ii) follows from Corollary 3.6 . In view of Proposition 4.7 , ( 5 ) holds for the fixed-point relocators of (T_{\gamma})_{\gamma\in\Gamma} given in Lemma 4.6 . Due to Lemma 4.8 , the Lipschitz constants of the fixed-point relocators satisfy ( 15 ). Hence, from Theorem 4.4 , since w_{n}=T_{\gamma_{n}}x_{n} , then x_{n}-w_{n}\to 0 , and (x_{n})_{n\in{\mathbb{N}}} and (w_{n})_{n\in{\mathbb{N}}} converge weakly to some x\in\operatorname{Fix}T_{\overline{\gamma}} Turning to the other sequences, we have z_{n}=J_{\gamma_{n}A}x_{n} , y_{n}=J_{\gamma_{n}B}(2z_{n}-x_{n}) and w_{n}=x_{n}-z_{n}+y_{n} . Then \frac{x_{n}-z_{n}}{\gamma_{n}}\in Az_{n} and y_{n}\in B^{-1}(\frac{z_{n}-w_{n}}{\gamma_{n}}) . With this notation, y_{n}-z_{n}=w_{n}-x_{n}\to 0 . Moreover, rearranging terms, we have \begin{pmatrix}\frac{x_{n}-w_{n}}{\gamma_{n}}\\ w_{n}-x_{n}\end{pmatrix}\in\left(\begin{bmatrix}A\\ B^{-1}\end{bmatrix}+\begin{bmatrix}0&\operatorname{Id}\\ -\operatorname{Id}&0\end{bmatrix}\right)\begin{pmatrix}z_{n}\\ \frac{z_{n}-w_{n}}{\gamma_{n}}\end{pmatrix}. Note that the operator above is maximally monotone (Fact 2.3 ), and hence demiclosed in view of Fact 2.2 . Since (x_{n})_{n\in{\mathbb{N}}} is bounded, so is (z_{n})_{n\in{\mathbb{N}}} due to Proposition 3.4 . Given a weak cluster point z of (z_{n})_{n\in{\mathbb{N}}} and z_{k_{n}}\>{\rightharpoonup}\>z , then taking the limits x_{k_{n}}\>{\rightharpoonup}\>x , w_{k_{n}}\>{\rightharpoonup}\>x and \gamma_{k_{n}}\to\overline{\gamma} in the relation above yields \begin{pmatrix}0\\ 0\end{pmatrix}\in\begin{bmatrix}A\\ B^{-1}\end{bmatrix}\begin{pmatrix}z\\ \frac{z-x}{\overline{\gamma}}\end{pmatrix}+\begin{pmatrix}\frac{z-x}{\overline{\gamma}}\\ -z\end{pmatrix}. Hence x-z\in\overline{\gamma}A(z) and z-x\in\overline{\gamma}B(z) , so that z\in Z and z=J_{\overline{\gamma}A}(x) . In other words, all cluster points of (z_{n})_{n\in{\mathbb{N}}} coincide and z_{n}\>{\rightharpoonup}\>J_{\overline{\gamma}A}x . As y_{n}-z_{n}\to 0 , we also have that y_{n}\>{\rightharpoonup}\>J_{\overline{\gamma}A}x . ∎ Remark 4.11 (Relationship with non-stationary DR). The non-stationary DR algorithm in [ 20 , Eq. (12)] is a particular case of Algorithm 1 . Indeed, given w_{0}\in X and \gamma_{0}\in\mathbb{R}_{++} , consider the sequences generated by [ 20 , Eq. (12)] : (\forall{n\in{\mathbb{N}}})\;z_{n}=J_{\gamma_{n-1}A}w_{n-1} , \kappa_{n}=\tfrac{\|z_{n}\|}{\|z_{n}-w_{n-1}\|} , \gamma_{n}=\kappa_{n}\gamma_{n-1} , y_{n}=J_{\gamma_{n}B}((1+\kappa_{n})z_{n}-\kappa_{n}w_{n-1}) , and w_{n}=y_{n}+\kappa_{n}(w_{n-1}-z_{n}) . By setting x_{n}=\kappa_{n}w_{n-1}+(1-\kappa_{n})z_{n} , then ( 9 ) holds. Furthermore, since x_{n}-z_{n}=\tfrac{\gamma_{n}}{\gamma_{n-1}}(w_{n-1}-z_{n}) , then w_{n}=y_{n}+x_{n}-z_{n} , and y_{n}=J_{\gamma_{n}B}(z_{n}+\kappa_{n}(z_{n}-w_{n-1}))=J_{\gamma_{n}B}(2z_{n}-x_{n}) , and thus ( 8 ) holds, recovering Algorithm 1 . Hence, in view of Remark 4.9 (ii) , Corollary 4.10 recovers the convergence results in [ 20 , Theorem 3.2] . Remark 4.12 (Disjoint fixed-point sets). Let us stress that Theorem 4.4 —and thus also Corollary 5.7 —can lead to cases where all fixed-point sets \operatorname{Fix}T_{\gamma} are pairwise disjoint. Indeed, suppose that X=\mathbb{R} and consider the optimization problem of minimizing f(x)+g(x) , where f=\iota_{\{1\}} and g=-\ln (with \operatorname{dom}\,g=\mathbb{R}_{++} ). This problem has only one feasible point, z:=1 , which is also the minimizer of f+g . Set A=\partial f=N_{\{1\}} and B=\partial g . Then Z=\operatorname{zer}(A+B)=\{1\} . Now let \gamma\in\mathbb{R}_{++} . First, J_{\gamma A}=P_{\{1\}} is a constant operator while J_{\gamma B}x=\frac{x+\sqrt{x^{2}+4\gamma}}{2} by, e.g., [ 5 , Example 24.40] . Now R_{\gamma A}x=2z-x=2-x and so the Douglas–Rachford operator T_{\gamma} satisfies T_{\gamma}x=x-1+\frac{(2-x)+\sqrt{(2-x)^{2}+4\gamma}}{2}=\frac{x+\sqrt{(2-x)^{2}+4\gamma}}{2}\;\;\text{and so}\;\;\operatorname{Fix}T_{\gamma}=\{1+\gamma\}. This motivates the need for the proposed notion of an Opial sequence with respect to a sequence of sets that may be pairwise disjoint. 5 Resolvent splitting methods with variable stepsize In this section, we generalize our analysis in Section 4.2 , and develop a variable stepsize resolvent splitting framework to solve (maximally) monotone inclusions of the form \text{find~~}x\in X\text{~~such that~~}0\in\sum_{i=1}^{N}A_{i}(x), (20) for N\geq 2 , based upon the graph-based DR framework introduced in [ 7 ] . We show that the relocated fixed-point iteration associated with the graph-based DR method converges weakly to a fixed-point of the underlying nonexpansive operator—in the sense of Theorem 4.4 —and then leverage this result to deduce variable stepsize extensions of some known resolvent splitting algorithms. 5.1 Graph-based DR with variable stepsize The resolvent splitting methods we analyze in this section are constructed using directed graphs, in which each node belongs to one of the operators in ( 20 ), and the arcs determine the order of evaluation of the resolvents of each operator. We follow [ 7 ] to define the setting. Let N\geq 2 and G=(\mathcal{N},\mathcal{E}) be a connected directed graph such that \mathcal{N}:=\{1,\dots,N\}\text{~~and~~}(i,j)\in\mathcal{E}\implies ij\\ -L_{ij}&\text{otherwise}\end{cases}\text{~~and~~}P_{ij}:=\begin{cases}\overline{d}_{i}&\text{~~if~~}i=j\\ -2&\text{~~if~~}(j,i)\in\mathcal{E}\setminus\mathcal{E}^{\prime}\\ 0&\text{otherwise}\end{cases}. By denoting \mathcal{R}:=R\otimes I_{1} and \mathcal{P}:=P\otimes I_{1} , set (\forall\gamma\in\mathbb{R}_{++})\;\mathcal{A}_{L,\gamma}:=\gamma\text{diag}(A_{1},\dots,A_{N})+\mathcal{R}+\mathcal{P}, where \text{diag}(A_{1},\dots,A_{N}):(x_{1},\dots,x_{N})\mapsto(A_{1}x_{1},\dots,A_{N}x_{N}) is the diagonal operator , and \mathcal{A}_{\gamma}:=\begin{bmatrix}\mathcal{A}_{L,\gamma}&-\mathcal{Z}\\ \mathcal{Z}^{*}&0_{N-1}\end{bmatrix} with 0_{N-1} being the zero operator in X^{N-1} . The operator \mathcal{A}_{\gamma} is maximally monotone [ 7 , Theorem 3.1] . In this manner, given \theta\in\left]0,2\right[ and \gamma\in\mathbb{R}_{++} , the iteration operator T_{\gamma}:X^{N-1}\to X^{N-1} for the graph-based DR method is given by (\forall\mathbf{x}\in X^{N-1})\;T_{\gamma}\mathbf{x}:=(1-\theta)\mathbf{x}+\theta J_{\mathcal{C}^{*}\vartriangleright\mathcal{A}_{\gamma}}\mathbf{x}\text{~~where~~}\mathcal{C}^{*}\vartriangleright\mathcal{A}_{\gamma}:=(\mathcal{C}^{*}\mathcal{A}^{-1}_{\gamma}\mathcal{C})^{-1}. (24) Note that J_{\mathcal{C}^{*}\vartriangleright\mathcal{A}_{\gamma}} is well-defined as \mathcal{C}^{*}\vartriangleright\mathcal{A}_{\gamma} is maximally monotone due to [ 6 , Lemma 2.3] . In view of [ 7 , Eqs. (3.9)–(3.10) & Step 5 of Algorithm 3.1] , it holds (\forall\mathbf{x}\in X^{N-1})\;T_{\gamma}\mathbf{x}=\mathbf{x}-\theta\mathcal{Z}^{*}\mathbf{z}, (25) where (\forall i=1,\dots,N)\;z_{i}:=J_{\frac{\gamma}{d_{i}}A_{i}}\left(\tfrac{2}{d_{i}}\sum_{(h,i)\in\mathcal{E}}z_{h}+\tfrac{1}{d_{i}}\sum_{j=1}^{N-1}Z_{ij}x_{j}\right). (26) Having described the setting that builds the graph-based DR method of [ 7 ] , we next collect some facts that sets this algorithm in the framework of Section 4.1 with the goal of applying Theorem 4.4 to obtain convergence of the corresponding relocated fixed-point iteration. Fact 5.1 . Let G=(\mathcal{N},\mathcal{E}) be a connected directed graph satisfying ( 21 ), and G^{\prime}=(\mathcal{N},\mathcal{E}^{\prime}) be a connected subgraph of G . Let A_{1},\dots,A_{N} be N maximally monotone operators on X , and \gamma\in\mathbb{R}_{++} . Then, (i) d_{1}=1 , \sum_{i=2}^{N}d_{i}^{+}=\sum_{i=1}^{N-1}d_{i}^{-}=|\mathcal{E}| and \sum_{i=1}^{N}d_{i}=2|\mathcal{E}| . (ii) (\forall\mathbf{z}\in X^{N})(\exists{\mathbf{v}}\in X^{N-1}) (\mathbf{z},{\mathbf{v}})\in\operatorname{zer}(\mathcal{A}_{\gamma}) if and only if z:=z_{1}=\dots=z_{N} solves ( 20 ). (iii) T_{\gamma} defined in ( 24 ) is \theta/2 -averaged on X^{N-1} . (iv) \operatorname{Fix}T_{\gamma}=\mathcal{C}^{*}\operatorname{zer}(\mathcal{A}_{\gamma}) . Item (i) follows directly from ( 21 ). Item (ii) is shown in [ 7 , Theorem 3.1] . For item (iii) , as \mathcal{C}^{*}\vartriangleright\mathcal{A}_{\gamma} is maximally monotone [ 6 , Lemma 2.3] , its resolvent is 1/2 -averaged and T_{\gamma} is \theta/2 -averaged by Fact 2.5 (ii) . As for item (iv) , as argued in the proof of [ 6 , Theorem 2.14] , \operatorname{Fix}T_{\gamma}=\operatorname{Fix}J_{\mathcal{C}^{*}\vartriangleright\mathcal{A}_{\gamma}}=\mathcal{C}^{*}\operatorname{Fix}(\mathcal{M}+\mathcal{A}_{\gamma})^{-1}\mathcal{M} and \operatorname{Fix}(\mathcal{M}+\mathcal{A}_{\gamma})^{-1}\mathcal{M}=\operatorname{zer}(\mathcal{A}_{\gamma}) , from which the result follows. ∎ The next result is the basis of the fixed-point relocator for the graph-based DR algorithm. Lemma 5.2 . Let \gamma,\delta\in\mathbb{R}_{++} , \mathbf{x}\in X^{N-1} , \mathcal{Z}=Z\otimes I_{1} , and \mathbf{z}(\mathbf{x}):=(z_{1},\dots,z_{N}) as defined in ( 26 ). Set \mathbf{e}(\mathbf{x}):=(d_{1}z_{1},(d_{2}-2d_{2}^{+})z_{2},\dots,(d_{N}-2d_{N}^{+})z_{N})-\frac{1}{N}\left(d_{1}z_{1}+\sum_{i=2}^{N}(d_{i}-2d_{i}^{+})z_{i}\right){\boldsymbol{1}}. (27) Then, the following hold. (i) \mathbf{e}(\mathbf{x})\in\text{Im}(\mathcal{Z}) and the unique solution to \mathcal{Z}\mathbf{y}=\tfrac{\delta}{\gamma}\mathcal{Z}\mathbf{x}+\left(1-\tfrac{\delta}{\gamma}\right)\mathbf{e}(\mathbf{x}) (28) is given by \mathbf{y}=\tfrac{\delta}{\gamma}\mathbf{x}+\left(1-\tfrac{\delta}{\gamma}\right)\mathcal{Z}^{\dagger}\mathbf{e}(\mathbf{x}), (29) where \mathcal{Z}^{\dagger} denotes the pseudo-inverse of \mathcal{Z} . (ii) Let T_{\gamma} be the operator defined in ( 24 ). If \mathbf{x}\in\operatorname{Fix}T_{\gamma} , then \mathbf{y} given by ( 29 ) satisfies \mathbf{y}\in\operatorname{Fix}T_{\delta} and there exists \mathbf{z}:=(z,\dots,z)\in X^{N} such that (\forall i\in\mathcal{N})\;z=z_{i}=J_{\frac{\delta}{d_{i}}A_{i}}\left(\tfrac{2}{d_{i}}\sum_{(h,i)\in\mathcal{E}}z_{h}+\tfrac{1}{d_{i}}\sum_{j=1}^{N-1}Z_{ij}y^{j}\right). (30) Let \mathbf{x}\in X^{N-1} and \gamma,\delta\in\mathbb{R}_{++} . (i) Using properties of the Kronecker product and the injectivity of Z , it follows that the operator \mathcal{Z} is also injective. Moreover, \displaystyle\sum_{i=1}^{N}e_{i}=\left(d_{1}z_{1}+\sum_{i=2}^{N}(d_{i}-2d_{i}^{+})z_{i}\right)-N\tfrac{1}{N}\left(d_{1}z_{1}+\sum_{i=2}^{N}(d_{i}-2d_{i}^{+})z_{i}\right)=0, and thus \mathbf{e}(\mathbf{x})\in\text{Im}(\mathcal{Z}) from ( 22 ). Then, from [ 5 , Proposition 3.30(ii)] , \mathbf{e}(\mathbf{x})=P_{\text{Im}(\mathcal{Z})}\mathbf{e}(\mathbf{x})=\mathcal{Z}\mathcal{Z}^{\dagger}\mathbf{e}(\mathbf{x}) , and thus ( 29 ) is a solution to ( 28 ). Uniqueness follows from injectivity of \mathcal{Z} . (ii) Suppose \mathbf{x}\in\operatorname{Fix}T_{\gamma} . From ( 25 ), we have \mathcal{Z}^{*}\mathbf{z}(\mathbf{x})=0 . From ( 22 ), there exists z\in X such that (\forall i\in\mathcal{N})\;z=z_{i}=J_{\frac{\gamma}{d_{i}}A_{i}}\left(\tfrac{2}{d_{i}}\sum_{(h,i)\in\mathcal{E}}z+\tfrac{1}{d_{i}}\sum_{j=1}^{N-1}Z_{ij}x_{j}\right)=J_{\frac{\gamma}{d_{i}}A_{i}}\left(\tfrac{2d_{i}^{+}}{d_{i}}z+\tfrac{1}{d_{i}}\sum_{j=1}^{N-1}Z_{ij}x_{j}\right). (31) Thus, using ( 31 ) and Fact 5.1 (i) , we deduce d_{1}z_{1}+\sum_{i=2}^{N}(d_{i}-2d_{i}^{+})z_{i}=\sum_{i=1}^{N}d_{i}z-2\sum_{i=2}^{N}d_{i}^{+}z=2|\mathcal{E}|z-2|\mathcal{E}|z=0. (32) Thus, from ( 27 ), we have \mathbf{e}(\mathbf{x})=(d_{1}z,(d_{2}-2d_{2}^{+})z,\dots,(d_{N}-2d_{N}^{+})z) and hence ( 28 ) simplifies to \mathcal{Z}\mathbf{y}=\tfrac{\delta}{\gamma}\mathcal{Z}\mathbf{x}+\left(1-\tfrac{\delta}{\gamma}\right)(d_{1}z,(d_{2}-2d_{2}^{+})z,\dots,(d_{N}-2d_{N}^{+})z). (33) We need to prove that \mathbf{y}\in\operatorname{Fix}T_{\delta} . To see this, note that combining ( 31 ) for i=1 with ( 33 ) and ( 10 ) yields \displaystyle\tilde{z}_{1}:=J_{\frac{\delta}{d_{1}}A_{1}}\left(\tfrac{1}{d_{1}}\sum_{j=1}^{N-1}Z_{1j}y^{j}\right) \displaystyle=J_{\tfrac{\delta}{d_{1}}A_{1}}\left(\tfrac{\delta}{\gamma}\tfrac{1}{d_{1}}\sum_{j=1}^{N-1}Z_{1j}x_{j}+\left(1-\tfrac{\delta}{\gamma}\right)z\right) \displaystyle=J_{\tfrac{\delta}{d_{1}}A_{1}}\left(\tfrac{\delta}{\gamma}\tfrac{1}{d_{1}}\sum_{j=1}^{N-1}Z_{1j}x_{j}+\left(1-\tfrac{\delta}{\gamma}\right)J_{\frac{\gamma}{d_{1}}A_{1}}\left(\tfrac{1}{d_{1}}\sum_{j=1}^{N-1}Z_{1j}x_{j}\right)\right) \displaystyle=J_{\frac{\gamma}{d_{1}}A_{1}}\left(\tfrac{1}{d_{1}}\sum_{j=1}^{N-1}Z_{1j}x_{j}\right)=z. Similarly, for i=2,\dots,N , combining ( 33 ) with ( 31 ) and ( 10 ) yields \displaystyle\tilde{z}_{i} \displaystyle:=J_{\frac{\delta}{d_{i}}A_{i}}\left(\tfrac{2}{d_{i}}\sum_{(h,i)\in\mathcal{E}}\tilde{z}_{h}+\tfrac{1}{d_{i}}\sum_{j=1}^{N-1}Z_{ij}y^{j}\right)=J_{\frac{\delta}{d_{i}}A_{i}}\left(\tfrac{2d_{i}^{+}}{d_{i}}z+\tfrac{1}{d_{i}}\sum_{j=1}^{N-1}Z_{ij}y^{j}\right) \displaystyle=J_{\tfrac{\delta}{d_{1}}A_{1}}\left(\tfrac{\delta}{\gamma}\left(\tfrac{2d_{i}^{+}}{d_{i}}z+\tfrac{1}{d_{i}}\sum_{j=1}^{N-1}Z_{ij}x_{j}\right)+\left(1-\tfrac{\delta}{\gamma}\right)z\right) \displaystyle=J_{\tfrac{\delta}{d_{1}}A_{1}}\left(\tfrac{\delta}{\gamma}\left(\tfrac{2d_{i}^{+}}{d_{i}}z+\tfrac{1}{d_{i}}\sum_{j=1}^{N-1}Z_{ij}x_{j}\right)+\left(1-\tfrac{\delta}{\gamma}\right)J_{\frac{\gamma}{d_{i}}A_{i}}\left(\tfrac{2d_{i}^{+}}{d_{i}}z+\tfrac{1}{d_{i}}\sum_{j=1}^{N-1}Z_{ij}x_{j}\right)\right) \displaystyle=J_{\frac{\gamma}{d_{i}}A_{i}}\left(\tfrac{2d_{i}^{+}}{d_{i}}z+\tfrac{1}{d_{i}}\sum_{j=1}^{N-1}Z_{ij}x_{j}\right)=z. Hence, it follows that (\forall i\in\mathcal{N})\;z=\tilde{z}_{i} , that is, for \tilde{\mathbf{z}}=\mathbf{z}(\mathbf{y}) , it holds \mathcal{Z}^{*}\tilde{\mathbf{z}}=0 . In view of ( 25 ) and ( 30 ), \mathbf{y}\in\operatorname{Fix}T_{\delta} . Furthermore, observe that we have also shown that (\forall i\in\mathcal{N})\;z_{i}=z=\tilde{z}_{i} . ∎ In the following, we prove the existence of a fixed-point relocator for the graph-based DR algorithm. Proposition 5.3 (Fixed-point relocator for graph-based DR). Let \gamma,\delta\in\mathbb{R}_{++} . Consider the operator Q_{\delta\leftarrow\gamma}:X^{N-1}\to X^{N-1} given by (\forall\mathbf{x}\in X^{N-1})\;Q_{\delta\leftarrow\gamma}\mathbf{x}=\tfrac{\delta}{\gamma}\mathbf{x}+\left(1-\tfrac{\delta}{\gamma}\right)\mathcal{Z}^{\dagger}\mathbf{e}(\mathbf{x}), where \mathbf{e}(\mathbf{x}) is defined in ( 27 ) and \mathcal{Z}^{\dagger} denotes the pseudo-inverse of \mathcal{Z}=Z\otimes I_{1} . Then (Q_{\delta\leftarrow\gamma})_{\gamma,\delta\in\mathbb{R}_{++}} defines fixed-point relocators for the graph-based DR operators (T_{\gamma})_{\gamma\in\mathbb{R}_{++}} given by ( 25 )-( 26 ) with is Lipschitz constant (\forall\gamma,\delta\in\mathbb{R}_{++})\;\mathcal{L}_{\delta\leftarrow\gamma}\leq\tfrac{\delta}{\gamma}+\left|1-\tfrac{\delta}{\gamma}\right|\|\mathcal{Z}^{\dagger}\|\sqrt{\sum_{i=1}^{N}\tfrac{(d_{i}-2d_{i}^{+})^{2}}{d_{i}^{2}}L_{i}^{2}}. (34) Let \gamma,\delta,\varepsilon\in\mathbb{R}_{++} . Let \mathbf{x}\in\operatorname{Fix}T_{\gamma} and \mathbf{z}(\mathbf{x})=(z,\dots,z)\in X^{N} be the corresponding point given by ( 26 ) and ( 30 ). Then, from ( 27 ), we have Q_{\delta\leftarrow\gamma}\mathbf{x}=\tfrac{\delta}{\gamma}\mathbf{x}+\left(1-\tfrac{\delta}{\gamma}\right)\mathcal{Z}^{\dagger}(z,(d_{2}-2d_{2}^{+})z,\dots,(d_{N}-2d_{N}^{+})z). (35) Using ( 30 ), \mathbf{z}(\mathbf{x})=\mathbf{z}(Q_{\delta\leftarrow\gamma}\mathbf{x})=(z,\dots,z) , and thus ( 35 ) yields \displaystyle Q_{\varepsilon\leftarrow\delta}Q_{\delta\leftarrow\gamma}\mathbf{x} \displaystyle=\tfrac{\varepsilon}{\delta}Q_{\delta\leftarrow\gamma}\mathbf{x}+\left(1-\tfrac{\varepsilon}{\delta}\right)\mathcal{Z}^{\dagger}(z,(d_{2}-2d_{2}^{+})z,\dots,(d_{N}-2d_{N}^{+})z) (36) \displaystyle=\tfrac{\varepsilon}{\delta}\left(\tfrac{\delta}{\gamma}\mathbf{x}+\left(1-\tfrac{\delta}{\gamma}\right)\mathcal{Z}^{\dagger}(z,(d_{2}-2d_{2}^{+})z,\dots,(d_{N}-2d_{N}^{+})z)\right) \displaystyle+\left(1-\tfrac{\varepsilon}{\delta}\right)\mathcal{Z}^{\dagger}(z,(d_{2}-2d_{2}^{+})z,\dots,(d_{N}-2d_{N}^{+})z) \displaystyle=\tfrac{\varepsilon}{\gamma}\mathbf{x}+\left(1-\tfrac{\varepsilon}{\gamma}\right)\mathcal{Z}^{\dagger}(z,(d_{2}-2d_{2}^{+})z,\dots,(d_{N}-2d_{N}^{+})z) \displaystyle=Q_{\varepsilon\leftarrow\gamma}\mathbf{x}. It remains to show that Q_{\delta\leftarrow\gamma} satisfies Definition 4.1 . (i) From Lemma 5.2 (ii) , Q_{\delta\leftarrow\gamma}\operatorname{Fix}T_{\gamma}\subseteq\operatorname{Fix}T_{\delta} . Furthermore, we claim that the inverse of Q_{\delta\leftarrow\gamma}:\operatorname{Fix}T_{\gamma}\to\operatorname{Fix}T_{\delta} is given by Q_{\gamma\leftarrow\delta}:\operatorname{Fix}T_{\delta}\to\operatorname{Fix}T_{\gamma} . Indeed, ( 35 ) with \varepsilon=\gamma yields (\forall\mathbf{x}\in\operatorname{Fix}T_{\gamma})\;Q_{\gamma\leftarrow\delta}Q_{\delta\leftarrow\gamma}\mathbf{x}=Q_{\gamma\leftarrow\gamma}\mathbf{x}=\mathbf{x}. This shows that Definition 4.1 (i) holds. (ii) From ( 35 ), (\forall\mathbf{x}\in\operatorname{Fix}T_{\gamma}) \delta\mapsto Q_{\delta\leftarrow\gamma}\mathbf{x} is continuous. Hence Definition 4.1 (ii) holds. (iii) Definition 4.1 (iii) follows from ( 36 ). (iv) Let \mathbf{u},{\mathbf{v}}\in X^{N-1} and \delta,\gamma\in\mathbb{R}_{++} . Then \displaystyle Q_{\delta\leftarrow\gamma}\mathbf{u}-Q_{\delta\leftarrow\gamma}{\mathbf{v}}=\tfrac{\delta}{\gamma}(\mathbf{u}-{\mathbf{v}})+\left(1-\tfrac{\delta}{\gamma}\right)\mathcal{Z}^{\dagger}(\mathbf{e}(\mathbf{u})-\mathbf{e}({\mathbf{v}})), Since \mathbf{e}(\mathbf{x})\in\text{Im}(\mathcal{Z}) , then \mathbf{e}(\mathbf{x})=P_{\text{Im}(\mathcal{Z})}\overline{\mathbf{e}}(\mathbf{x}) for \overline{\mathbf{e}}(\mathbf{x})=(d_{1}z_{1},(d_{2}-2d_{2}^{+})z_{2},\dots,(d_{N}-2d_{N}^{+})z_{N}) . Nonexpansiveness of the projection yields \|\mathbf{e}(\mathbf{u})-\mathbf{e}({\mathbf{v}})\|^{2}\leq d_{1}^{2}\|z_{1}(\mathbf{u})-z_{1}({\mathbf{v}})\|^{2}+\sum_{i=2}^{N}(d_{i}-2d_{i}^{+})^{2}\|z_{i}(\mathbf{u})-z_{i}({\mathbf{v}})\|^{2} From nonexpansiveness of J_{\tfrac{\gamma}{d_{1}}A_{1}} and the Cauchy-Schwarz inequality, it follows that \|z_{1}(\mathbf{u})-z_{1}({\mathbf{v}})\|\leq\tfrac{1}{d_{1}}\sum_{j=1}^{N-1}|Z_{1j}|\|u_{i}-v_{i}\|\leq\tfrac{L_{1}}{d_{1}}\|\mathbf{u}-{\mathbf{v}}\|\text{~~for~~}L_{1}:=\sqrt{\sum_{j=1}^{N-1}Z_{1j}^{2}} Inductively, (\forall i=2,\dots,N) \displaystyle\|z_{i}(\mathbf{u})-z_{i}({\mathbf{v}})\| \displaystyle\leq\tfrac{2}{d_{i}}\sum_{(h,i)\in\mathcal{E}}\|z_{h}(\mathbf{u})-z_{h}({\mathbf{v}})\|+\tfrac{1}{d_{i}}\sum_{j=1}^{N-1}|Z_{ij}|\|u_{j}-v_{j}\| \displaystyle\leq\tfrac{L_{i}}{d_{i}}\|\mathbf{u}-{\mathbf{v}}\|\text{~~for~~}L_{i}:=\left(2\sum_{(h,i)\in\mathcal{E}}\tfrac{L_{h}}{d_{h}}+\sqrt{\sum_{j=1}^{N-1}Z_{ij}^{2}}\right). Then \|\mathbf{e}(\mathbf{u})-\mathbf{e}({\mathbf{v}})\|\leq\sqrt{\sum_{i=1}^{N}\tfrac{(d_{i}-2d_{i}^{+})^{2}}{d_{i}^{2}}L_{i}^{2}}\|\mathbf{u}-{\mathbf{v}}\|. ∎ We are now ready to state the main convergence result for the relocated fixed-point version of the graph-based DR algorithm (cf. [ 7 , Theorem 3.2] ). Corollary 5.4 (convergence of relocated fixed-point graph-based DR). Let G=(\mathcal{N},\mathcal{E}) be a connected directed graph satisfying ( 21 ), and let G^{\prime}=(\mathcal{N},\mathcal{E}^{\prime}) be a connected subgraph of G . Let A_{1},\dots,A_{N} be maximally monotone operators on X such that \operatorname{zer}(\sum_{i=1}^{N}A_{i})\neq\varnothing , and \Gamma\subseteq\mathbb{R}_{++} be nonempty. Let \theta\in\left]0,2\right[ and (\gamma_{n})_{n\in{\mathbb{N}}} in \Gamma be a sequence and \overline{\gamma}\in\Gamma satisfying ( 15 ). Given \mathbf{x}_{0}\in X^{N-1} , define (\forall{n\in{\mathbb{N}}}) \left\{\begin{aligned} {\mathbf{w}}_{n}&=\mathbf{x}_{n}-\theta\mathcal{Z}^{*}\mathbf{z}_{n}\\ \mathbf{x}_{n+1}&=\tfrac{\gamma_{n+1}}{\gamma_{n}}{\mathbf{w}}_{n}+\left(1-\tfrac{\gamma_{n+1}}{\gamma_{n}}\right)\mathcal{Z}^{\dagger}\mathbf{e}({\mathbf{w}}_{n}),\end{aligned}\right. where (\mathbf{z}_{n})_{n\in{\mathbb{N}}} and (\mathbf{e}({\mathbf{w}}_{n}))_{n\in{\mathbb{N}}} are defined in ( 26 ) and ( 27 ), respectively, and \mathcal{Z}^{\dagger} is the pseudo-inverse of \mathcal{Z} . Then, (\mathbf{x}_{n})_{n\in{\mathbb{N}}} and ({\mathbf{w}}_{n})_{n\in{\mathbb{N}}} converge weakly to some \mathbf{x}\in\operatorname{Fix}T_{\overline{\gamma}} and (\forall i\in\mathcal{N}) the sequence (z_{n}^{i})_{n\in{\mathbb{N}}} converges weakly to z\in\operatorname{zer}(\sum_{i=1}^{N}A_{i}) given in ( 30 ). In view of Fact 5.1 (iii) , (\forall\theta\in\left]0,2\right[)(\forall\gamma\in\Gamma) the operator T_{\gamma} in ( 25 ) is \frac{\theta}{2}- averaged, hence Assumption 4.3 (i) holds. In view of ( 26 ), Proposition 3.4 shows that (\mathbf{x},\gamma)\mapsto T_{\gamma}\mathbf{x} is continuous, hence Assumption 4.3 (ii) holds. Moreover, from Facts 5.1 (ii) & (iv) and \operatorname{zer}(\sum_{i=1}^{N}A_{i})\neq\varnothing , \operatorname{Fix}T_{\gamma}=\mathcal{C}^{*}\operatorname{zer}(\mathcal{A}_{\gamma})\neq\varnothing . For the fixed-point relocator in Proposition 5.3 , (\forall{n\in{\mathbb{N}}})\;\mathbf{x}_{n+1}=Q_{\gamma_{n+1}\leftarrow\gamma_{n}}T_{\gamma_{n}}\mathbf{x}_{n} and {\mathbf{w}}_{n}=T_{\gamma_{n}}\mathbf{x}_{n} . Then Theorem 4.4 implies that \mathbf{x}_{n}-{\mathbf{w}}_{n}\to 0 , and (\mathbf{x}_{n})_{n\in{\mathbb{N}}} and ({\mathbf{w}}_{n})_{n\in{\mathbb{N}}} converge weakly to some \mathbf{x}\in\operatorname{Fix}T_{\overline{\gamma}} . We now show (\forall i\in\mathcal{N})\;z_{n}^{i}\rightharpoonup z for some point z\in X^{N} to be defined. Let s\in(\text{span}\,\{{\boldsymbol{1}}\})^{\perp} be arbitrary. Then, since \text{Im}(Z)=\ker(Z^{*})^{\perp}=(\text{span}\,\{{\boldsymbol{1}}\})^{\perp} , there exists t\in\mathbb{R}^{N-1} such that s=Zt and \sum_{i=1}^{N}s_{i}z_{n}^{i}=\big(s^{\top}\otimes I_{N}\big)\mathbf{z}_{n}=\big(t^{\top}Z^{*}\otimes I_{N}\big)\mathbf{z}_{n}=\big(t^{\top}\otimes I_{N-1}\big)\mathcal{Z}^{*}\mathbf{z}_{n}=\tfrac{1}{\theta}\big(t^{\top}\otimes I_{N-1}\big)(\mathbf{x}_{n}-T_{\gamma_{n}}\mathbf{x}_{n})\to 0. (37) In particular, we have (\forall i,j\in\mathcal{N})\;z_{n}^{i}-z_{n}^{j}\to 0 . Using the definition of the resolvent together with ( 26 ) yields \displaystyle(\forall i\in\mathcal{N})\;\tfrac{d_{i}}{\gamma_{n}}\left(p_{n}^{i}-z_{n}^{i}\right)\in A_{i}z_{n}^{i} where \displaystyle p_{n}^{1}=\tfrac{1}{d_{1}}\sum_{j=1}^{N-1}Z_{1j}x_{n}^{j}\text{~~and~~}(\forall i=2,\dots,N)\;p_{n}^{i}=\tfrac{2}{d_{i}}\sum_{(h,i)\in\mathcal{E}}z_{n}^{h}+\tfrac{1}{d_{i}}\sum_{j=1}^{N-1}Z_{ij}x_{n}^{j}. Compactly, this system can be expressed as the inclusion \hskip-9.95863pt\mathcal{S}\begin{pmatrix}\tfrac{d_{1}}{\gamma_{n}}\left(p_{n}^{1}-z_{n}^{1}\right)\\ \tfrac{d_{2}}{\gamma_{n}}\left(p_{n}^{2}-z_{n}^{2}\right)\\ \vdots\\ \tfrac{d_{N-1}}{\gamma_{n}}\left(p_{n}^{N-1}-z_{n}^{N-1}\right)\\ z_{n}^{N}\end{pmatrix}\ni\begin{pmatrix}z_{n}^{1}-z_{n}^{N}\\ z_{n}^{2}-z_{n}^{N}\\ \vdots\\ z_{n}^{N-1}-z_{n}^{N}\\ \sum_{i=1}^{N}\tfrac{d_{i}}{\gamma_{n}}\big(p_{n}^{i}-z_{n}^{i}\big)\\ \end{pmatrix} (38) for \mathcal{S}:=\begin{pmatrix}A_{1}^{-1}\\ A_{2}^{-1}\\ \vdots\\ A_{N-1}^{-1}\\ A_{N}\\ \end{pmatrix}+\begin{pmatrix}0&0&\dots&0&-\operatorname{Id}\\ 0&0&\dots&0&-\operatorname{Id}\\ \vdots&\vdots&\ddots&\vdots&\vdots\\ 0&0&\dots&0&-\operatorname{Id}\\ \operatorname{Id}&\operatorname{Id}&\dots&\operatorname{Id}&0\\ \end{pmatrix}. As (\mathbf{x}_{n})_{n\in{\mathbb{N}}} is bounded, nonexpansiveness of the resolvent of A_{1} implies (z_{n}^{1})_{n\in{\mathbb{N}}} is bounded, where (\forall{n\in{\mathbb{N}}})\;z_{n}^{1}=J_{\frac{\gamma}{d_{1}}A_{1}}p_{n}^{1} . Let \check{z} be a weak cluster point of (z_{n}^{1})_{n\in{\mathbb{N}}} , say z_{k_{n}}^{1}\rightharpoonup\check{z} . Since (\forall i=2,\dots,N)\;z_{n}^{i-1}-z_{n}^{i}\to 0 , then z_{k_{n}}^{i}\>{\rightharpoonup}\>\check{z} . Consequently, for \displaystyle p^{1}=\tfrac{1}{d_{1}}\sum_{j=1}^{N-1}Z_{1j}x^{j}\text{~~and~~}(\forall i=2,\dots,N)\;p^{i}=\tfrac{2d_{i}^{+}}{d_{i}}\check{z}+\tfrac{1}{d_{i}}\sum_{j=1}^{N-1}Z_{ij}x^{j}, it holds that p_{n}^{1}\rightharpoonup p^{1} and, inductively, (\forall i=2,\dots,N)\;p_{k_{n}}^{i}\rightharpoonup p^{i} . Observe that, from the definition of p_{n}^{i} , \displaystyle\sum_{i=1}^{N}\tfrac{d_{i}}{\gamma_{n}}\big(p_{n}^{i}-z_{n}^{i}\big) \displaystyle=\tfrac{1}{\gamma_{n}}\sum_{i=1}^{N}\sum_{j=1}^{N-1}Z_{ij}x_{n}^{j}-\tfrac{d_{1}}{\gamma_{n}}z_{n}^{1}+\tfrac{1}{\gamma_{n}}\sum_{i=2}^{N}\left(2\sum_{(h,i)\in\mathcal{E}}z_{n}^{h}-d_{i}z_{n}^{i}\right) (39) \displaystyle=0+0+\tfrac{1}{\gamma_{n}}\sum_{i=1}^{N}\left(2\sum_{(h,i)\in\mathcal{E}}z_{n}^{h}-d_{i}z_{n}^{i}\right) \displaystyle=\tfrac{1}{\gamma_{n}}\left(2\sum_{i=1}^{N}d_{i}^{-}z_{n}^{i}-\sum_{i=1}^{N}d_{i}z_{n}^{i}\right)=\tfrac{1}{\gamma_{n}}\sum_{i=1}^{N}(d_{i}^{-}-d_{i}^{+})z_{n}^{i}\to 0, where the second equality follows from ( 22 ) as \sum_{i=1}^{N}\sum_{j=1}^{N-1}Z_{ij}x_{n}^{j}=\sum_{i=1}^{N}(\mathcal{Z}\mathbf{x}_{n})_{i}=0 combined with the fact that d_{1}^{+}=0 , the third equality follows from the definition of d_{i}^{-} , and the last equality follows from the identity d_{i}=d_{i}^{+}+d_{i}^{-} . The convergence to 0 follows from ( 37 ) and the fact that s\in\mathbb{R}^{N} , defined by (\forall i\in\mathcal{N})\;s_{i}=d_{i}^{-}-d_{i}^{+} , belongs to (\text{span}\,\{{\boldsymbol{1}}\})^{\perp} in view of Fact 5.1 (i) . Taking the (weak) limit above along the subsequence k_{n}\to+\infty yields \sum_{i=1}^{N}\tfrac{d_{i}}{\overline{\gamma}}\big(p_{i}-\check{z}\big)=0. Further, the operator \mathcal{S} in ( 38 ) is the sum of a maximally monotone operator and a skew symmetric matrix, hence maximally monotone (Fact 2.3 ) and demiclosed (Fact 2.2 ). By taking the limits (\forall i=1,\dots,N-1) z_{k_{n}}^{i+1}-z_{k_{n}}^{i}\to 0 , x_{k_{n}}^{i}\>{\rightharpoonup}\>x_{i} and \gamma_{k_{n}}\to\overline{\gamma} in ( 38 ), and using ( 39 ), we obtain (\forall i=1,\dots,N-1)\;A_{i}^{-1}\big(\tfrac{d_{i}}{\overline{\gamma}}(p^{i}-\check{z})\big)-\check{z}\ni 0 , and A_{N}\check{z}+\sum_{i=1}^{N-1}\tfrac{d_{i}}{\overline{\gamma}}(p^{i}-\check{z})\ni 0 . Then, (\forall i\in 1,\dots N-1) , \check{z}=J_{\tfrac{\overline{\gamma}}{d_{i}}A_{i}}p^{i} and, in view of ( 39 ), \check{z}=J_{\tfrac{\overline{\gamma}}{d_{N}}A_{N}}p_{N} . Observe that p^{1} , from definition, is only determined by \mathbf{x} , the unique limit of (\mathbf{x}_{n})_{n\in{\mathbb{N}}} . Hence \check{z}=J_{\tfrac{\overline{\gamma}}{d_{1}}A_{1}}p^{1} is the unique cluster point of (z_{n}^{1})_{n\in{\mathbb{N}}} , and z_{n}^{1}\>{\rightharpoonup}\>\check{z} . Since (\forall i=2,\dots,N) z_{n}^{i-1}-z_{n}^{i}\to 0 , then z_{n}^{i}\>{\rightharpoonup}\>\check{z} . The result then follows for z=\check{z} . ∎ Having established the convergence of the relocated fixed-point iteration of graph-based DR splitting, we proceed to deduce a variable stepsize extension of the Malitsky–Tam resolvent splitting algorithm [ 22 ] . 5.2 Variable stepsize Malitsky–Tam resolvent splitting for N\geq 2 operators In [ 22 ] , the authors propose a resolvent splitting algorithm to solve problem ( 20 ) that only requires one resolvent evaluation per maximally monotone operator in each iteration. This algorithm is a special case of the graph-based DR algorithm [ 7 , Section 3.1] by taking \mathcal{E}^{\prime}=\{(i,i+1):i=1,\dots,N-1\}\text{~~and~~}\mathcal{E}=\{(1,N)\}\cup\mathcal{E}^{\prime}. In particular, (\forall i=1,\dots,N)\;d_{i}=2 , d_{1}^{+}=0 , (\forall i=2,\dots,N-1)\;d_{i}^{+}=1 and d_{N}^{+}=2 . As explained in [ 7 , Section 3.1] , the onto decomposition of the Laplacian of a connected tree, such as \mathcal{E}^{\prime} , is given by its incidence matrix Z . For the Malitsky–Tam resolvent splitting algorithm, this is given by: Z=\begin{bmatrix}1&0&0&\dots&0&0\\ -1&1&0&\dots&0&0\\ 0&-1&1&\dots&0&0\\ \vdots&\vdots&\vdots&\dots&\vdots&\vdots\\ 0&0&0&\dots&-1&1\\ 0&0&0&\dots&0&-1\\ \end{bmatrix}. (40) A direct application of ( 25 )–( 26 ) and the change of variables \gamma\leftarrow\tfrac{\gamma}{2},\theta\leftarrow\tfrac{\theta}{2}\text{~and~}\mathbf{x}\leftarrow\tfrac{1}{2}\mathbf{x} (41) yields the Malitsky–Tam iteration operator T_{\gamma} . For \theta\in\left]0,1\right[ and \gamma\in\mathbb{R}_{++} , T_{\gamma}:X^{N-1}\to X^{N-1} is given by (\forall\mathbf{x}\in X^{N-1})\;T_{\gamma}\mathbf{x}=\mathbf{x}+\theta\begin{pmatrix}z_{2}-z_{1}\\ \vdots\\ z_{N}-z_{N-1}\end{pmatrix} (42) where \left\{\begin{aligned} z_{1}&=J_{\gamma A_{1}}(x_{1})&\\ z_{i}&=J_{\gamma A_{i}}(z_{i-1}+x_{i}-x_{i-1})&\text{~for~}i=2,\dots,N-1\\ z_{N}&=J_{\gamma A_{N}}(z_{1}+z_{N-1}-x_{N-1}).&\end{aligned}\right. (43) In view of Proposition 5.3 , finding an appropriate fixed-point relocator for the iteration operator defined in ( 25 )–( 26 ) amounts to solving the system of equations ( 28 ). In the following, we define a fixed-point relocatorfor this operator by employing Remark 4.2 . Proposition 5.5 (Fixed-point relocator for Malitsky–Tam operator). For \gamma,\delta\in\mathbb{R}_{++} , consider the operator \tilde{Q}_{\delta\leftarrow\gamma}=(\tilde{Q}_{\delta\leftarrow\gamma}^{1},\dots,\tilde{Q}_{\delta\leftarrow\gamma}^{N-1}):X^{N-1}\to X^{N-1} defined (\forall\mathbf{x}=(x_{1},\dots,x_{N-1})\in X^{N-1}) as \left\{\begin{aligned} \tilde{Q}_{\delta\leftarrow\gamma}^{1}(\mathbf{x})&=\left(\tfrac{\delta}{\gamma}\operatorname{Id}+\big(1-\tfrac{\delta}{\gamma}\big)J_{\gamma A_{1}}\right)(x_{1})\\ \tilde{Q}_{\delta\leftarrow\gamma}^{i}(\mathbf{x})&=\tfrac{\delta}{\gamma}(x_{i}-x_{1})+\tilde{Q}_{\delta\leftarrow\gamma}^{1}(\mathbf{x}),\text{~~for~~}i=2,\dots,N-1.\\ \end{aligned}\right. (44) Then, (\tilde{Q}_{\delta\leftarrow\gamma})_{\gamma,\delta\in\mathbb{R}_{++}} defines fixed-point relocators for (T_{\gamma})_{\gamma\in\mathbb{R}_{++}} given by ( 42 )–( 43 ), with Lipschitz constant \tilde{\mathcal{L}}_{\delta\leftarrow\gamma}=\max\{1,\tfrac{\delta}{\gamma}\}+(N-2)|1-\tfrac{\delta}{\gamma}|. (45) Using the change of variables ( 41 ), (Q_{\delta\leftarrow\gamma})_{\gamma,\delta\in\mathbb{R}_{++}} defined (\forall\mathbf{x}\in X^{N-1}) by \left\{\begin{aligned} Q_{\delta\leftarrow\gamma}^{1}(\mathbf{x})&=\left(\tfrac{\delta}{\gamma}\operatorname{Id}+\big(1-\tfrac{\delta}{\gamma}\big)J_{\gamma A_{1}}\right)(x_{1})-\tfrac{1}{N}\big(1-\tfrac{\delta}{\gamma}\big)(J_{\gamma A_{1}}(x_{1})-z_{N}))\\ Q_{\delta\leftarrow\gamma}^{i}(\mathbf{x})&=\tfrac{\delta}{\gamma}(x_{i}-x_{i-1})+Q_{\delta\leftarrow\gamma}^{i-1}(\mathbf{x})-\tfrac{1}{N}\big(1-\tfrac{\delta}{\gamma}\big)(J_{\gamma A_{1}}(x_{1})-z_{N}),\text{~~for~~}i=2,\dots,N-1.\\ \end{aligned}\right. (46) where z_{N} is given in ( 43 ), are fixed-point relocators for (T_{\gamma})_{\gamma\in\mathbb{R}_{++}} in view of Proposition 5.3 and ( 40 ). Furthermore, from ( 44 ), it holds that (\forall i=2,\dots,N-1)\;\tilde{Q}_{\delta\leftarrow\gamma}^{i}(x_{1},\dots,x_{N-1})=\tfrac{\delta}{\gamma}(x_{i}-x_{i-1})+\tilde{Q}_{\delta\leftarrow\gamma}^{i-1}(x_{1},\dots,x_{N-1}), (47) which implies Q_{\delta\leftarrow\gamma}|_{\operatorname{Fix}T_{\gamma}}=\tilde{Q}_{\delta\leftarrow\gamma}|_{\operatorname{Fix}T_{\gamma}} . To see this, take x\in\operatorname{Fix}T_{\gamma} , so that from ( 42 ), z_{1}=z_{N} . Then Q_{\delta\leftarrow\gamma}^{1}(\mathbf{x})=\tilde{Q}_{\delta\leftarrow\gamma}^{1}(\mathbf{x}) , and from ( 47 ), (\forall i=2,\dots,N-1) Q_{\beta\leftarrow\alpha}^{i}(\mathbf{x})-Q_{\beta\leftarrow\alpha}^{i-1}(\mathbf{x})=\tilde{Q}_{\beta\leftarrow\alpha}^{i}(\mathbf{x})-\tilde{Q}_{\beta\leftarrow\alpha}^{i-1}(\mathbf{x}) . In turn, by induction, it follows that Q_{\delta\leftarrow\gamma}^{i}(\mathbf{x})=\tilde{Q}_{\delta\leftarrow\gamma}^{i}(\mathbf{x}) , which proves the claim. We next show \tilde{Q}_{\delta\leftarrow\gamma} is Lipschitz continuous. Take \mathbf{x},{\mathbf{w}}\in X^{N-1} . It follows from Proposition 3.2 that \|\tilde{Q}_{\delta\leftarrow\gamma}^{1}(\mathbf{x})-\tilde{Q}_{\delta\leftarrow\gamma}^{1}({\mathbf{w}})\|\leq\max\left\{1,\tfrac{\delta}{\gamma}\right\}\|x_{1}-w_{1}\|. Furthermore, for i=2,\dots,N-1 , ( 44 ) and Fact 2.4 (i) yield \displaystyle\|\tilde{Q}_{\delta\leftarrow\gamma}^{i}(\mathbf{x})-\tilde{Q}_{\delta\leftarrow\gamma}^{i}({\mathbf{w}})\| \displaystyle=\left\|\tfrac{\delta}{\gamma}(x_{i}-w_{i})+\left(1-\tfrac{\delta}{\gamma}\right)(J_{\gamma A_{1}}x_{1}-J_{\gamma A_{1}}w_{1})\right\| \displaystyle\leq\tfrac{\delta}{\gamma}\|x_{i}-w_{i}\|+\left|1-\tfrac{\delta}{\gamma}\right|\|x_{1}-w_{1}\|. Hence, \|\tilde{Q}_{\delta\leftarrow\gamma}(\mathbf{x})-\tilde{Q}_{\delta\leftarrow\gamma}({\mathbf{w}})\|\leq\left(\max\left\{1,\tfrac{\delta}{\gamma}\right\}+(N-2)\left|1-\tfrac{\delta}{\gamma}\right|\right)\|x_{1}-w_{1}\|+\tfrac{\delta}{\gamma}\sum_{i=2}^{N-1}\|x_{i}-w_{i}\|. Therefore, \tilde{Q}_{\delta\leftarrow\gamma} is Lipschitz continuous with constant ( 45 ). The conclusion now follows from Remark 4.2 . ∎ In Algorithm 2 , we introduce a variable stepsize resolvent splitting algorithm for finding a zero of \sum_{i=1}^{N}A_{i} , a variant of the Malitsky–Tam method [ 22 ] , stemming from the relocated fixed-point iteration associated with the fixed-point relocator introduced in Proposition 5.5 . This fixed-point relocator produces an algorithm that only requires one resolvent evaluation per maximally monotone operator in each iteration, just as its original form, i.e. the method with constant stepsize. Although using the fixed-point relocators ({Q}_{\delta\leftarrow\gamma})_{\gamma,\delta\in\mathbb{R}_{++}} in ( 46 ) gives a convergent variable stepsize variant of the Malitsky-Tam algorithm, it result in a method that needs more resolvent evaluations than the original algorithm. Input : Choose x_{0}^{1},\dots,x_{0}^{N-1}\in X and \theta\in\left]0,1\right[ . Define z_{0}^{1}=J_{\gamma_{1}A_{1}}(x_{0}^{1}) . for n=0,1,\dots do Step 1. Intermediate step. Compute {\mathbf{w}}_{n}=\mathbf{x}_{n}+\theta\begin{pmatrix}z_{n}^{2}-z_{n}^{1}\\ \vdots\\ z_{n}^{N}-z_{n}^{N-1}\end{pmatrix} (48) where z_{n}^{1},\dots,z_{n}^{N}\in X are given by \left\{\begin{aligned} z_{n}^{i}&=J_{\gamma_{n}A_{i}}(x_{n}^{i}+z_{n}^{i-1}-x_{n}^{i-1})&\text{~for~}i=2,\dots,N-1\\ z_{n}^{N}&=J_{\gamma_{n}A_{N}}(z_{n}^{1}+z_{n}^{N-1}-x_{n}^{N-1}).&\end{aligned}\right. Step 2. Next iterate. Compute \begin{cases}z_{n+1}^{1}=J_{\gamma_{n}A_{1}}w_{n}^{1}\\ x_{n+1}^{1}=\dfrac{\gamma_{n+1}}{\gamma_{n}}w_{n}^{1}+\left(1-\dfrac{\gamma_{n+1}}{\gamma_{n}}\right)z_{n+1}^{1}\end{cases} (49) For i=2,\dots,N-2 , x_{n+1}^{i}=\dfrac{\gamma_{n+1}}{\gamma_{n}}(w_{n}^{i}-w_{n}^{1})+x_{n+1}^{1}. (50) Algorithm 2 Variable stepsize resolvent splitting for finding a zero of \sum_{i=1}^{N}A_{i} , N\geq 2 . In the following, we formalize the idea that Algorithm 2 can be reformulated as a relocated fixed-point iteration of the operator defined in ( 42 )–( 43 ) for the fixed-point relocator in Proposition 5.5 . Then, we show convergence of Algorithm 2 using Corollary 5.4 . Proposition 5.6 (Equivalence between relocated fixed-point iteration and efficient implementation). Given \mathbf{x}_{0}\in X^{N-1} and \theta\in\left]0,1\right[ , the sequences (\mathbf{x}_{n})_{n\in{\mathbb{N}}},({\mathbf{w}}_{n})_{n\in{\mathbb{N}}}\subseteq X^{N-1} and (\mathbf{z}_{n})_{n\in{\mathbb{N}}}\subseteq X^{N} are generated by Algorithm 2 if and only if (\mathbf{z}_{n})_{n\in{\mathbb{N}}} conforms to ( 43 ) and \left\{\begin{aligned} {\mathbf{w}}_{n}&=T_{\gamma_{n}}\mathbf{x}_{n}\\ \mathbf{x}_{n+1}&=\tilde{Q}_{\gamma_{n+1}\leftarrow\gamma_{n}}{\mathbf{w}}_{n}\\ \end{aligned}\right. where the operators (T_{\gamma})_{\gamma\in\mathbb{R}_{++}} are defined in ( 42 )–( 43 ) and (\tilde{Q}_{\delta\leftarrow\gamma})_{\gamma,\delta\in\mathbb{R}_{++}} in ( 44 ). From ( 10 ) and ( 49 ), it follows that z_{n+1}^{1}=J_{\gamma_{n}A_{1}}(w_{n}^{1})=J_{\gamma_{n+1}A_{1}}(x_{n+1}^{1}). Therefore ( 43 ) holds for (\mathbf{z}_{n})_{n\in{\mathbb{N}}} . In this manner, ( 43 ) and ( 48 ) yield {\mathbf{w}}_{n}=T_{\gamma_{n}}\mathbf{x}_{n} . Moreover, ( 49 ) implies x_{n+1}^{1}=\tilde{Q}^{1}_{\gamma_{n+1}\leftarrow\gamma_{n}}({\mathbf{w}}_{n}) , and ( 50 ) yields (\forall i=2,\dots,N) x_{n+1}^{i}=\tilde{Q}^{i}_{\gamma_{n+1}\leftarrow\gamma_{n}}({\mathbf{w}}_{n}) . ∎ Corollary 5.7 (Convergence of variable stepsize Malitsky–Tam resolvent splitting). Given N\geq 2 , suppose that A_{1},\dots,A_{N} are N maximally monotone operators on X such that \operatorname{zer}(\sum_{i=1}^{N}A_{i})\neq\varnothing . Let \Gamma\subseteq\mathbb{R}_{++} be nonemtpy, \theta\in\left]0,1\right[ and (\gamma_{n})_{n\in{\mathbb{N}}}\text{~in~}\Gamma\text{~be a sequence that converges to~}\overline{\gamma}\in\Gamma\text{~and~}\sum_{n\in{\mathbb{N}}}(\gamma_{n+1}-\gamma_{n})_{+}<+\infty. Given \mathbf{x}_{0}\in X^{N-1} , consider the sequences (\mathbf{x}_{n})_{n\in{\mathbb{N}}},({\mathbf{w}}_{n})_{n\in{\mathbb{N}}}\subseteq X^{N-1} and (\mathbf{z}_{n})_{n\in{\mathbb{N}}}\subseteq X^{N} generated by Algorithm 2 . Then, both sequences (\mathbf{x}_{n})_{n\in{\mathbb{N}}} and ({\mathbf{w}}_{n})_{n\in{\mathbb{N}}} converge weakly to some point \mathbf{x}\in\operatorname{Fix}T_{\overline{\gamma}} , where T_{\gamma} is the iteration operator defined in ( 42 )–( 43 ), and (\forall i\in\mathcal{N}) (z_{n}^{i})_{n\in{\mathbb{N}}} converges weakly to J_{\overline{\gamma}A_{1}}x_{1}\in Z . First, (\mathbf{x}_{n})_{n\in{\mathbb{N}}} is a relocated fixed-point iteration (Proposition 5.6 ) of the operator T_{\gamma} with fixed-point relocator given in ( 44 ). Moreover, from Remark 4.9 (ii) , there exists \gamma_{low}\in\mathbb{R}_{++} such that (\forall{n\in{\mathbb{N}}})\;\gamma_{low}\leq\gamma_{n} . Thus, from ( 45 ), \displaystyle\tilde{\mathcal{L}}_{\gamma_{n+1}\leftarrow\gamma_{n}}-1 \displaystyle=\max\left\{0,\frac{\gamma_{n+1}}{\gamma_{n}}-1\right\}+(N-2)\left|1-\frac{\gamma_{n+1}}{\gamma_{n}}\right| \displaystyle=\max\left\{0,\frac{\gamma_{n+1}}{\gamma_{n}}-1\right\}+\frac{N-2}{\gamma_{low}}|\gamma_{n}-\gamma_{n+1}|. The first term in the last line defines a convergent series in view of Lemma 4.8 , while the second term conforms a finite series due to Remark 4.9 (ii) , therefore \sum_{{n\in{\mathbb{N}}}}(\mathcal{L}_{\gamma_{n+1}\leftarrow\gamma_{n}}-1)<+\infty . From Corollary 5.4 , (\mathbf{x}_{n})_{n\in{\mathbb{N}}} converges weakly to some \mathbf{x}\in\operatorname{Fix}T_{\overline{\gamma}} and (\forall i=1,\dots,N) (z_{n}^{i})_{n\in{\mathbb{N}}} converges weakly to z\in\operatorname{zer}(\sum_{i=1}^{N}A_{i}) given in ( 30 ). In particular, it holds that z=z_{1}=J_{\overline{\gamma}A_{1}}x_{1} . ∎ 6 Final remarks In this work, we proposed the relocated fixed-point iteration framework for a parametrized family of nonexpansive operators. An instance of this setting is the graph-based extension of the DR splitting algorithm, in which the parameter is the stepsize, yielding convergence of variable stepsize resolvent splitting methods. Among future research directions, the authors plan to investigate other splitting methods under the lenses of the relocated fixed-point iteration framework. In particular, we are interested in exploring three-operator splitting methods that allow forward and resolvent evaluations such as [ 12 ] , and the extensions examined in [ 11 , 2 , 1 ] . We also plan to investigate implementations of the stepsize sequence (\gamma_{n})_{{n\in{\mathbb{N}}}} beyond Remark 4.9 (iii) , and examine rates of convergence of resolvent splitting methods with variable stepsizes, similar to the approach developed in [ 15 ] for the proximal point algorithm.