A Unifying View of Anchoring via Operator-Side Tikhonov Regularization

Zihao Chen · 2026

Read A Unifying View of Anchoring via Operator-Side Tikhonov Regularization by Zihao Chen (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-30905.txt.

Introduction

Chen gives a unified view of anchoring in fixed-point methods. These methods add a fading pull toward an anchor point, but anchor choice often looks opaque. He shows it admits a recipe: adjust the operator with a vanishing Tikhonov term, then run the base method. Picard iteration gives Halpern iteration; applied to forward step, extragradient, and past extragradient, it yields three variants. The forward variant gives a new error guarantee, while these variants give new adjusted forms, sharing a residual pattern and giving a one-over-k Halpern rate.

Catalog record

CREATORZihao Chen
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE90059
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.30905

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

A Unifying View of Anchoring via Operator-Side Tikhonov Regularization Zihao Chen Abstract Anchored fixed point and monotone equation methods, including Halpern iteration, extra anchored gradient, and their relatives, add a vanishing pull toward a reference point to obtain last-iterate guarantees. Existing anchored variants often achieve sharp last-iterate guarantees, but from the update-level perspective the placement of the anchor can be algorithm-specific and conceptually opaque. We show that anchoring admits a single operator-side construction: regularize the operator queried by the base method with a vanishing Tikhonov term, then run the unmodified base method. Applied to the Picard iteration, this recipe reproduces the Halpern iteration; applied to the forward step, extragradient (EG), and past extragradient (PEG, also known as Popov’s method), it yields three variants whose anchor placements inherit the base method’s query pattern. The forward-step instantiation gives a new residual convergence guarantee, while the EG and PEG instantiations give new regularized variants. The four analyses share a residual recurrence, recovering the O ⁡ ( 1 / k ) O(1/k) Halpern residual-norm convergence rate, giving O ⁡ ( 1 / k ) O(1/\sqrt{k}) for the regularized forward step, and giving O ⁡ ( 1 / k ) O(1/k) for the regularized EG and PEG variants in the unconstrained monotone Lipschitz setting. 1 Introduction Many equilibrium conditions and first-order convex optimality conditions can be written as fixed point or monotone equation problems. In a fixed point problem, one seeks \mathbf{x}^{\star} such that T(\mathbf{x}^{\star})=\mathbf{x}^{\star} . In a monotone equation problem, one seeks \mathbf{x}^{\star} such that F(\mathbf{x}^{\star})=\mathbf{0} , where F is monotone in the standard sense made precise in Section 2 . For instance, the first-order conditions of a smooth unconstrained convex-concave minmax problem give a monotone saddle operator. In this work, we focus on last-iterate residual convergence, measured by \left\|T(\mathbf{x}_{k})-\mathbf{x}_{k}\right\|,\qquad\left\|F(\mathbf{x}_{k})\right\|. The simplest fixed point method is Picard iteration, \mathbf{x}_{k+1}=T(\mathbf{x}_{k}) . When T is a contraction, the usual contraction argument gives convergence; for a merely nonexpansive T , that argument no longer applies. The corresponding method for F(\mathbf{x})=\mathbf{0} is the forward step \mathbf{x}_{k+1}=\mathbf{x}_{k}-\eta_{k}F(\mathbf{x}_{k}) . When F=\nabla f for a smooth convex function f , this is gradient descent. It behaves well, with suitable step sizes, under stronger assumptions such as cocoercivity, but for a merely monotone Lipschitz operator it can diverge. Anchoring repairs or sharpens this last-iterate behavior by adding a vanishing pull toward a reference point \mathbf{x}_{0} . Halpern iteration does this for nonexpansive fixed point problems [ 15 , 7 , 35 ] . Its Tikhonov interpretation is direct: the regularization makes the current problem better conditioned, and the regularization is then slowly removed. For extragradient (EG) and past extragradient (PEG, also known as Popov’s method), the picture is less clear. These methods already stabilize monotone Lipschitz problems by changing the query pattern and achieve last-iterate convergence [ 18 , 26 , 13 , 14 ] . Anchored variants of these methods improve the last-iterate residual rate in related settings [ 38 , 20 , 3 , 32 , 4 , 33 , 1 ] . These guarantees are obtained through method-specific analyses and sometimes carefully chosen Lyapunov functions. This leaves a basic structural question about the mechanism of acceleration: can the anchor placement be derived systematically from the query pattern of the base method? This paper proposes to regularize the operator being queried, then run the original template method unchanged. For fixed point problems, the regularized map is T_{k}(\mathbf{x})=(1-\delta_{k})T(\mathbf{x})+\delta_{k}\mathbf{x}_{0}. For monotone equations, the regularized object is the scaled displacement queried by the method: G_{k}(\mathbf{x})=\eta_{k}F(\mathbf{x})+\delta_{k}(\mathbf{x}-\mathbf{x}_{0}). The anchor terms that appear after expanding the update are then determined by the query points of the base method. The fixed point case gives the first example. Applying Picard iteration to T_{k} gives \mathbf{x}_{k+1}=T_{k}(\mathbf{x}_{k})=(1-\delta_{k})T(\mathbf{x}_{k})+\delta_{k}\mathbf{x}_{0}, which is Halpern iteration. As another example, extragradient shows the anchor-placement mechanism more visibly. With a fixed \eta , applying the two-query template to G_{k} gives \mathbf{x}_{k+1/2}=\mathbf{x}_{k}-G_{k}(\mathbf{x}_{k}),\qquad\mathbf{x}_{k+1}=\mathbf{x}_{k}-G_{k}(\mathbf{x}_{k+1/2}). Expanding the second line yields \mathbf{x}_{k+1}=\mathbf{x}_{k}-\eta F(\mathbf{x}_{k+1/2})-\delta_{k}(\mathbf{x}_{k+1/2}-\mathbf{x}_{0}). Hence, under this operator-side rule, the second anchor term is evaluated at the lookahead point because that is where the second operator query is made. Contributions. Existing anchored extragradient and Popov-type methods achieve accelerated last-iterate residual rates [ 38 , 20 , 3 , 32 , 4 ] . Instead of explaining why each of those particular anchored updates achieves acceleration, we give a separate operator-side route to anchored algorithms. The rule is simple: regularize the operator (or its scaled displacement) with a vanishing Tikhonov term, and run the unmodified base template on the result. Applied to Picard, the rule recovers Halpern iteration and the known O(R/k) residual bound. Applied to the forward step, it stabilizes the method and gives an O(LR/\sqrt{k}) residual-norm guarantee under monotonicity and Lipschitz continuity, the first such guarantee without extragradient or the Popov-type past query. 1 1 1 The regularized forward-step result first appeared in the author’s dissertation [ 9 ] . It was later independently discovered via AI-assisted formal proof search in Lean by Surina et al. [ 30 ] . Applied to EG and PEG, it gives the new regularized variants Reg-EG and Reg-PEG, both with O(LR/k) residual-norm bounds. The four analyses then reduce to the same recurrence. This perspective results in a single intuitive derivation that produces new accelerated anchored variants and their analyses uniformly. Organization. Section 2 introduces the setup, base methods, and related work. Section 3 discusses the operator-side regularization principle and uses Halpern iteration as the fixed point prototype. Section 4 establishes the monotone equation results for the regularized forward step, Reg-EG, and Reg-PEG. Section 5 concludes. 2 Background and Preliminaries 2.1 Problem Setup We use two operator templates throughout the paper. The fixed point results study a map T and certify an iterate by its fixed point residual, while the monotone equation results study an operator F and certify an iterate by the norm of F(\mathbf{x}) . The notation differs slightly across the two settings, but the role of the residual is the same: it is the last-iterate certificate controlled by the regularized dynamics. For fixed point problems, we work in a general normed space (\mathcal{X},\left\|\cdot\right\|) with a map T:\mathcal{X}\to\mathcal{X} . The map is nonexpansive if \left\|T(\mathbf{x})-T(\mathbf{y})\right\|\leq\left\|\mathbf{x}-\mathbf{y}\right\|\qquad\text{for all }\mathbf{x},\mathbf{y}\in\mathcal{X}. It is a contraction if the right-hand side can be multiplied by some \gamma<1 . For monotone equations, we work in a real Hilbert space (\mathcal{H},\left\langle\cdot,\cdot\right\rangle) with a single-valued operator F:\mathcal{H}\to\mathcal{H} . The operator is monotone if \left\langle F(\mathbf{x})-F(\mathbf{y}),\mathbf{x}-\mathbf{y}\right\rangle\geq 0\qquad\text{for all }\mathbf{x},\mathbf{y}\in\mathcal{H}. We use two standard quantitative refinements: F is \mu -strongly monotone if the left-hand side is at least \mu\left\|\mathbf{x}-\mathbf{y}\right\|^{2} , and it is L -Lipschitz if \left\|F(\mathbf{x})-F(\mathbf{y})\right\|\leq L\left\|\mathbf{x}-\mathbf{y}\right\|. The operator F is \beta -cocoercive if \left\langle F(\mathbf{x})-F(\mathbf{y}),\mathbf{x}-\mathbf{y}\right\rangle\geq\beta\left\|F(\mathbf{x})-F(\mathbf{y})\right\|^{2}. Cocoercivity is stronger than monotonicity and gives a direct bridge between the two settings: if F is \beta -cocoercive, then I-\eta F is nonexpansive for 0<\eta\leq 2\beta . The main monotone equation results below do not assume cocoercivity. The corresponding solution sets are \operatorname{Fix}(T)=\left\{\mathbf{x}\in\mathcal{X}:T(\mathbf{x})=\mathbf{x}\right\},\qquad\operatorname{Zer}(F)=\left\{\mathbf{x}\in\mathcal{H}:F(\mathbf{x})=\mathbf{0}\right\}. Every theorem assumes the relevant solution set is nonempty. We fix an anchor \mathbf{x}_{0} , choose a reference solution \mathbf{x}^{\star} , and write R\coloneqq\left\|\mathbf{x}_{0}-\mathbf{x}^{\star}\right\|. All bounds are stated relative to this anchored radius. With this notation in place, the residuals reported throughout are r_{T}(\mathbf{x})\coloneqq\left\|T(\mathbf{x})-\mathbf{x}\right\|,\qquad r_{F}(\mathbf{x})\coloneqq\left\|F(\mathbf{x})\right\|. The auxiliary residual \left\|G_{k}(\mathbf{x})\right\| used in the analyses is introduced

Read the complete text