Stochastic Krasnosel skii-Mann Iterations in Banach Spaces with Bregman Distances Saeed Hashemi Sababe, Ehsan Lotfali Ghasab Abstract . We propose a generalization of the stochastic Krasnoselskil-Mann ( S ​ K ​ M ) (SKM) algorithm to reflexive Banach spaces endowed with Bregman distances. Under standard martingale-difference noise assumptions in the dual space and mild conditions on the distance-generating function, we establish almost-sure convergence to a fixed point and derive non-asymptotic residual bounds that depend on the uniform convexity modulus of the generating function. Extensions to adaptive Bregman geometries and robust noise models are also discussed. Numerical experiments on entropy-regularized reinforcement learning and mirror-descent illustrate the theoretical findings. 1991 Mathematics Subject Classification 47H05, 47J25, 49M27, 65K10, 90C25. 1. Introduction Fixed-point iterations for finding a point \zeta^{*} satisfying \hbar(\zeta)=\zeta^{*} , where \hbar is a nonexpansive operator, are fundamental in nonlinear analysis and optimization [ 2 , 1 , 3 ] . The classical Krasnosel skii-Mann (KM) scheme, (1) \zeta_{n+1}=(1-\alpha_{n})\zeta_{n}+\alpha_{n}hbar(\zeta_{n}), has been extensively studied in Hilbert spaces, with convergence rates and error bounds established under various deterministic and stochastic settings [ 3 , 9 ] . Despite its successes, the Hilbertian framework of ( 1 ) limits applications to Euclidean geometries. In many modern contexts-such as mirror-descent in machine learning, entropy-regularized reinforcement learning, and imaging inverse problems-algorithms naturally operate in non-Euclidean spaces modeled by Banach spaces, using Bregman distances induced by a Legendre function \vartheta [ 4 , 5 , 6 , 7 ] . Bregman distances capture the local geometry of the problem and underpin methods like mirror descent [ 12 ] , proximal Bregman splitting [ 8 ] , and stochastic mirror-prox [ 10 ] . Recently, Cegielski [ 9 ] extended KM to a stochastic setting (SKM) , allowing additive martingale-difference noise \mho_{n} in Hilbert spaces. This stochastic Krasnosel skiĭ-Mann algorithm achieves almost-sure convergence and O(1/\sqrt{n}) residual bounds under suitable step-size rules. However, the theory remains confined to inner-product spaces and Euclidean norms. Bridging this gap, we propose a Bregman- SKM algorithm that generalizes SKM to reflexive Banach spaces equipped with a Legendre distance-generating function \vartheta . Our contributions are threefold, we formulate the Bregman- SKM update in general Banach spaces and prove almost-sure convergence under martingale-difference noise in the dual space, we derive non-asymptotic residual bounds for the Bregman distance D_{\vartheta}(\zeta_{n},\hbar(\zeta_{n})) , revealing the influence of the modulus of uniform convexity of \vartheta on convergence rates and we discuss extensions to adaptive Bregman geometries, robust noise models, and potential hybrids with inertial and variance-reduced schemes. The remainder of the paper is organized as follows. Section 2 reviews Banach-space geometry and Bregman distances. Section 3 presents the algorithm and almost-sure convergence analysis. Section 4 derives non-asymptotic residual bounds. Section 5 explores extensions. Section 6 reports numerical experiments, and Section 7 concludes with future directions. 2. Preliminaries In this section we fix notation and recall definitions and key lemmas that will be used throughout. Let (\mathcal{X},\|\cdot\|) be a real reflexive Banach space and \mathcal{X}^{*} its continuous dual, with duality pairing \langle\zeta^{*},\zeta\rangle . Definition 2.1 (Duality mapping) . The (normalized) duality mapping \mathcal{J}\colon\mathcal{X}\to 2^{\mathcal{X}^{*}} is \mathcal{J}(\zeta)=\bigl\{\zeta^{*}\in\mathcal{X}^{*}:\,\langle\zeta^{*},\zeta\rangle=\|\zeta\|^{2}=\|\zeta^{*}\|_{*}^{2}\bigr\}. If \mathcal{X} is smooth, then \mathcal{J} is single-valued; we denote its value by j(\zeta) when no ambiguity arises [ 13 ] . Definition 2.2 (Legendre function) . A convex function \vartheta\colon\mathcal{X}\to(-\infty,+\infty] is Legendre if it is (1) proper and lower semi-continuous, (2) essentially smooth and essentially strictly convex on \operatorname{int}(\operatorname{dom}\vartheta) , (3) its Fenchel conjugate \vartheta^{*} satisfies the same properties. On \operatorname{int}(\operatorname{dom}\vartheta) , \vartheta is Gateaux-differentiable; we denote its gradient by \nabla\vartheta(\zeta)\in\mathcal{X}^{*} [ 11 ] . Definition 2.3 (Bregman distance) . For \zeta,\varsigma\in\operatorname{int}(\operatorname{dom}\vartheta) , the Bregman distance induced by \vartheta is D_{\vartheta}(\zeta,\varsigma)\;=\;\vartheta(\zeta)-\vartheta(\varsigma)-\bigl\langle\nabla\vartheta(\varsigma),\,\zeta-\varsigma\bigr\rangle. Lemma 2.4 (Three-Point Identity) . For all \zeta,\varsigma,z\in\operatorname{int}(\operatorname{dom}\vartheta) , D_{\vartheta}(\zeta,z)=D_{\vartheta}(\zeta,\varsigma)+D_{\vartheta}(\varsigma,z)+\bigl\langle\nabla\vartheta(z)-\nabla\vartheta(\varsigma),\,\zeta-\varsigma\bigr\rangle. Proof. See [ 8 , Lemma 2.2] . ∎ Definition 2.5 (Uniform convexity) . A Legendre function \vartheta is uniformly convex with modulus \delta\colon[0,\infty)\to[0,\infty) if (2) \vartheta\Bigl(\tfrac{\zeta+\varsigma}{2}\Bigr)+\delta\bigl(\|\zeta-\varsigma\|\bigr)\;\leq\;\tfrac{1}{2}\bigl[\vartheta(\zeta)+\vartheta(\varsigma)\bigr]\quad\forall\,\zeta,\varsigma\in\mathcal{X}. Uniform convexity implies the estimate \|\zeta-\varsigma\|^{2}\;\leq\;\frac{2}{\delta(\|\zeta-\varsigma\|)}\,D_{\vartheta}(\zeta,\varsigma), which links the norm error to the Bregman distance [ 7 ] . A mapping \hbar\colon\mathcal{X}\to\mathcal{X} is called nonexpansive if \|\hbar(\zeta)-\hbar(\varsigma)\|\;\leq\;\|\zeta-\varsigma\|\quad\forall\,\zeta,\varsigma\in\mathcal{X}. Given an iterate \zeta_{n} , we define its Bregman residual \mathcal{R}_{n}\;:=\;D_{\vartheta}\bigl(\zeta_{n},\,\hbar(\zeta_{n})\bigr). Let (\Omega,\mathcal{F},\lx@paragraphsign) be a probability space with a filtration \{\mathcal{F}_{n}\}_{n\geq 0} . Definition 2.6 (Martingale-difference noise) . A sequence \{\mho_{n}\}\subset\mathcal{X}^{*} is a martingale-difference if \mathbb{E}\bigl[\,\mho_{n+1}\mid\mathcal{F}_{n}\bigr]=0,\quad\mathbb{E}\bigl[\|\mho_{n+1}\|_{*}^{2}\mid\mathcal{F}_{n}\bigr]<\infty\quad\text{a.s.} Lemma 2.7 (Robbins-Siegmund) . Let \{a_{n}\},\{b_{n}\},\{c_{n}\} be nonnegative \mathcal{F}_{n} -adapted sequences satisfying \mathbb{E}[a_{n+1}\mid\mathcal{F}_{n}]+b_{n}\;\leq\;(1+\alpha_{n})\,a_{n}+c_{n},\quad\sum_{n}\alpha_{n}<\infty,\quad\sum_{n}c_{n}<\infty\quad\text{a.s.} Then a_{n} converges a.s. and \sum_{n}b_{n}<\infty a.s. [ 15 ] . 3. Bregman-SKM Algorithm and Almost-Sure Convergence In this section we introduce the stochastic Bregman-Krasnosel skiĭ -Mann (Bregman- SKM ) iteration in a Banach space, state the main convergence Theorem, and prove almost-sure convergence under martingale-difference noise. Definition 3.1 (Bregman- SKM iteration) . Let \hbar\colon\mathcal{X}\to\mathcal{X} be nonexpansive and let \vartheta be a Legendre function on \mathcal{X} . Given \zeta_{0},\zeta_{1}\in\operatorname{int}(\operatorname{dom}\vartheta) and step-sizes (\alpha_{n})\subset(0,1) , the Bregman- SKM iterates \{\zeta_{n}\} are defined by \displaystyle\varsigma_{n}\;=\;\nabla\vartheta^{*}\!\bigl((1-\alpha_{n})\,\nabla\vartheta(\zeta_{n})+\alpha_{n}\,\nabla\vartheta\bigl(\hbar(\zeta_{n})+\mho_{n}\bigr)\bigr), \displaystyle\zeta_{n+1}\;=\;\varsigma_{n}, where (\mho_{n})\subset\mathcal{X}^{*} is a martingale-difference sequence modeling noise. In the Hilbertian case \vartheta(\zeta)=\tfrac{1}{2}\|\zeta\|^{2} , \nabla\vartheta=\nabla\vartheta^{*}=I , and the above reduces to \zeta_{n+1}=(1-\alpha_{n})\,\zeta_{n}+\alpha_{n}\bigl(\hbar(\zeta_{n})+\mho_{n}\bigr), which is the classical stochastic KM ( SKM ) scheme [ 9 ] . Consider the following assumptions: (A1) \hbar\colon\mathcal{X}\to\mathcal{X} is non-expansive and has at least one fixed point. (A2) \vartheta is Legendre and uniformly convex with modulus \delta satisfying \delta(r)>0 for r>0 . (A3) Step-sizes satisfy \alpha_{n}\in(0,1),\quad\sum_{n=0}^{\infty}\alpha_{n}=\infty,\quad\sum_{n=0}^{\infty}\alpha_{n}^{2}<\infty. (A4) (\mho_{n})_{n\geq 1} is a martingale-difference with respect to \{\mathcal{F}_{n}\} and \mathbb{E}\bigl[\|\mho_{n+1}\|_{*}^{2}\mid\mathcal{F}_{n}\bigr]<\infty\quad\text{a.s.} Lemma 3.2 (One-Step Bregman Decrease) . Under (A1)–(A4) , the Bregman residuals \mathcal{R}_{n}=D_{\vartheta}(\zeta_{n},\hbar(\zeta_{n})) satisfy \mathbb{E}[D_{\vartheta}(\zeta_{n+1},\hbar(\zeta_{n+1}))\mid\mathcal{F}_{n}]+\tfrac{\delta(\|\zeta_{n}-\hbar(\zeta_{n})\|)}{2}\,\alpha_{n}\;\leq\;(1+\alpha_{n}^{2L})D_{\vartheta}(\zeta_{n},\hbar(\zeta_{n}))+\alpha_{n}^{2}\,\sigma^{2}, for constants L,\sigma^{2}>0 depending on the Lipschitz and noise bounds. Proof. Recall that \zeta_{n+1}=\nabla\vartheta^{*}\bigl((1-\alpha_{n})\,\nabla\vartheta(\zeta_{n})+\alpha_{n}\,\nabla\vartheta\bigl(\hbar(\zeta_{n})+\mho_{n}\bigr)\bigr). Set a_{n}:=(1-\alpha_{n})\,\nabla\vartheta(\zeta_{n})+\alpha_{n}\,\nabla\vartheta\bigl(\hbar(\zeta_{n})\bigr),\quad b_{n}:=\alpha_{n}\,\bigl[\nabla\vartheta\bigl(\hbar(\zeta_{n})+\mho_{n}\bigr)-\nabla\vartheta\bigl(\hbar(\zeta_{n})\bigr)\bigr]. Then \zeta_{n+1}=\nabla\vartheta^{*}(a_{n}+b_{n}). By Lemma 2.4 , for any \varsigma,z , D_{\vartheta}(\varsigma,z)=D_{\vartheta}(\varsigma,\zeta_{n})+D_{\vartheta}(\zeta_{n},z)+\bigl\langle\nabla\vartheta(z)-\nabla\vartheta(\zeta_{n}),\,\varsigma-\zeta_{n}\bigr\rangle. Apply this with \varsigma=\zeta_{n+1} and z=\hbar(\zeta_{n+1}) to get (3) \displaystyle D_{\vartheta}\bigl(\zeta_{n+1},\hbar(\zeta_{n+1})\bigr) \displaystyle=D_{\vartheta}\bigl(\zeta_{n+1},\hbar(\zeta_{n})\bigr)+D_{\vartheta}\bigl(\hbar(\zeta_{n}),\hbar(\zeta_{n+1})\bigr) \displaystyle+\bigl\langle\nabla\vartheta\bigl(\hbar(\zeta_{n+1})\bigr)-\nabla\vartheta\bigl(\hbar(\zeta_{n})\bigr),\,\zeta_{n+1}-\hbar(\zeta_{n})\bigr\rangle. Since \hbar is nonexpansive and \vartheta is uniformly convex with modulus \delta , one shows via ( 2 ) that D_{\vartheta}\bigl(\hbar(\zeta_{n}),\hbar(\zeta_{n+1})\bigr)\;\leq\;\frac{1}{2}\,\delta\bigl(\|\zeta_{n}-\zeta_{n+1}\|\bigr). By uniform convexity and smoothness of \vartheta , its gradient is Lipschitz on bounded sets: there exists L>0 such that \bigl\|\nabla\vartheta\bigl(\hbar(\zeta_{n+1})\bigr)-\nabla\vartheta\bigl(\hbar(\zeta_{n})\bigr)\bigr\|_{*}\;\leq\;L\,\|\hbar(\zeta_{n+1})-\hbar(\zeta_{n})\|\;\leq\;L\,\|\zeta_{n+1}-\zeta_{n}\|. Hence, by Cauchy-Schwarz and Youngs inequalities, \bigl\langle\nabla\vartheta(\hbar(\zeta_{n+1}))-\nabla\vartheta(\hbar(\zeta_{n})),\,\zeta_{n+1}-\hbar(\zeta_{n})\bigr\rangle\;\leq\;\frac{\delta(\|\zeta_{n}-\hbar(\zeta_{n})\|)}{4}\,\alpha_{n}\;+\;L\,\|\zeta_{n+1}-\zeta_{n}\|^{2}. Since \nabla\vartheta^{*} is Lipschitz (by uniform convexity of \vartheta ) with constant L , and using the definitions of a_{n},b_{n} , we get \|\zeta_{n+1}-\zeta_{n}\|\;=\;\bigl\|\nabla\vartheta^{*}(a_{n}+b_{n})-\nabla\vartheta^{*}(a_{n})\bigr\|\;\leq\;L\,\|b_{n}\|\;\leq\;L\,\alpha_{n}\,\|\mho_{n}\|. Thus \|\zeta_{n+1}-\zeta_{n}\|^{2}\;\leq\;L^{2}\,\alpha_{n}^{2}\,\|\mho_{n}\|^{2}. Substitute the provided bounds into ( 3 ), then take \mathbb{E}[\cdot\mid\mathcal{F}_{n}] . Using \mathbb{E}[\|\mho_{n}\|^{2}\mid\mathcal{F}_{n}]\leq\sigma^{2} and collecting terms yields \mathbb{E}\bigl[D_{\vartheta}(\zeta_{n+1},\hbar(\zeta_{n+1}))\mid\mathcal{F}_{n}\bigr]+\tfrac{\delta(\|\zeta_{n}-\hbar(\zeta_{n})\|)}{2}\,\alpha_{n}\;\leq\;\bigl(1+\alpha_{n}^{2}L\bigr)D_{\vartheta}(\zeta_{n},\hbar(\zeta_{n}))+\alpha_{n}^{2}\,\sigma^{2}, as claimed. ∎ Theorem 3.3 (Almost-Sure Convergence) . Under (A1)–(A4) , the Bregman- KM iterates satisfy \zeta_{n}\;\to\;\zeta^{*}\quad\text{a.s.}, for some fixed point \zeta^{*}\in\operatorname{Fix}(\hbar) , and D_{\vartheta}(\zeta_{n},\hbar(\zeta_{n}))\;\to\;0\quad\text{a.s.} Proof. By Lemma 3.2 , with a_{n}=D_{\vartheta}(\zeta_{n},\hbar(\zeta_{n})),\quad b_{n}=\tfrac{1}{2}\,\delta\bigl(\|\zeta_{n}-\hbar(\zeta_{n})\|\bigr)\,\alpha_{n},\quad c_{n}=\alpha_{n}^{2}\,\sigma^{2}, we have almost surely \mathbb{E}\bigl[a_{n+1}\mid\mathcal{F}_{n}\bigr]+b_{n}\;\leq\;(1+\alpha_{n}^{2}L)\,a_{n}+c_{n}. Since by assumption \sum_{n}\alpha_{n}^{2}<\infty and \sum_{n}c_{n}=\sigma^{2}\sum_{n}\alpha_{n}^{2}<\infty , the coefficients in ( 3 ) satisfy the hypotheses of Lemma 2.7 . Therefore: a_{n}\;\to\;a_{\infty}\quad\text{a.s.},\quad\sum_{n=0}^{\infty}b_{n}<\infty\quad\text{a.s.} In particular, a_{n} converges almost surely to some nonnegative random variable a_{\infty} . Since \sum_{n=0}^{\infty}b_{n}=\sum_{n=0}^{\infty}\tfrac{1}{2}\,\delta(\|\zeta_{n}-\hbar(\zeta_{n})\|)\,\alpha_{n}<\infty\quad\text{a.s.}, but \sum_{n}\alpha_{n}=\infty , the only way the series can converge is if \delta\bigl(\|\zeta_{n}-\hbar(\zeta_{n})\|\bigr)\;\to\;0\quad\text{a.s.} By uniform convexity of \vartheta , \delta(r)>0 for r>0 , so \|\zeta_{n}-\hbar(\zeta_{n})\|\to 0 and hence a_{n}=D_{\vartheta}(\zeta_{n},\hbar(\zeta_{n}))\;\to\;0\quad\text{a.s.} Since (\zeta_{n}) lives in the reflexive Banach space \mathcal{X} and \|\zeta_{n}-\hbar(\zeta_{n})\|\to 0 , any weak cluster point \bar{\zeta} of (\zeta_{n}) must satisfy \bar{\zeta}=\hbar(\bar{\zeta}) , i.e. \bar{\zeta}\in\operatorname{Fix}(\hbar) (see [ 3 , Thm. 5.14] ). Furthermore, the Fejér monotonicity induced by the BM- SKM update in Bregman distance implies that all cluster points coincide. Therefore the entire sequence (\zeta_{n}) converges weakly to some \zeta^{*}\in\operatorname{Fix}(\hbar) . If in addition \mathcal{X} is uniformly convex (or \vartheta is strongly-convex), one can upgrade weak convergence to strong convergence via standard arguments (e.g. Opials Lemma). Hence \zeta_{n}\to\zeta^{*} and D_{\vartheta}(\zeta_{n},\hbar(\zeta_{n}))\to 0 almost surely, completing the proof. ∎ Corollary 3.4 . If, in addition, \vartheta is 2 -uniformly convex (i.e. \delta(r)\geq\kappa r^{2} ), then \sum_{n=0}^{\infty}\alpha_{n}\,\|\zeta_{n}-\hbar(\zeta_{n})\|^{2}<\infty\quad\text{a.s.} Proof. From the proof of Theorem 3.3 , we know that \sum_{n=0}^{\infty}b_{n}\;=\;\sum_{n=0}^{\infty}\frac{1}{2}\,\delta\bigl(\|\zeta_{n}-\hbar(\zeta_{n})\|\bigr)\,\alpha_{n}\;<\;\infty\quad\text{a.s.} If, in addition, \vartheta is 2 -uniformly convex with modulus \delta(r)\geq\kappa\,r^{2} , then b_{n}\;=\;\frac{1}{2}\,\delta\bigl(\|\zeta_{n}-\hbar(\zeta_{n})\|\bigr)\,\alpha_{n}\;\geq\;\frac{1}{2}\,\kappa\,\|\zeta_{n}-\hbar(\zeta_{n})\|^{2}\,\alpha_{n}. Hence \sum_{n=0}^{\infty}\alpha_{n}\,\|\zeta_{n}-\hbar(\zeta_{n})\|^{2}\;\leq\;\frac{2}{\kappa}\sum_{n=0}^{\infty}b_{n}\;<\;\infty\quad\text{a.s.}, as claimed. ∎ Example 1 (Entropy-Regularized Q-Learning) . Let \mathcal{X}=\Delta^{d} be the probability simplex and \vartheta(\zeta)=\sum_{i=1}^{d}\zeta_{i}\ln\zeta_{i} . Then Bregman- SKM specializes to a stochastic mirror-descent scheme for computing the Q-optimal policy under entropy regularization [ 12 ] . Theorem 3.3 implies almost-sure convergence of the policy iterates. 4. Non-Asymptotic Residual Bounds in Banach Spaces In this section we derive explicit non-asymptotic bounds on the Bregman residual \mathcal{R}_{n}\;=\;D_{\vartheta}\bigl(\zeta_{n},\,\hbar(\zeta_{n})\bigr), highlighting the role of the uniform convexity modulus \delta of \vartheta . Definition 4.1 (Modulus-Dependent Rate Exponent) . Let \vartheta be uniformly convex with modulus \delta(r)\geq c\,r^{q} for some c>0 and q\geq 2 . We define the rate exponent p\;:=\;\frac{q-1}{q}\,\in\bigl[\tfrac{1}{2},1\bigr). Definition 4.2 (Residual Averaging) . For a window size N\in\mathbb{N} , define the averaged residual \bar{\mathcal{R}}_{N}\;:=\;\frac{1}{A_{N}}\sum_{n=0}^{N-1}\alpha_{n}\,\mathcal{R}_{n},\quad A_{N}:=\sum_{n=0}^{N-1}\alpha_{n}. Theorem 4.3 (Non-Asymptotic Bregman-Residual Bound) . Under assumptions (A1)–(A4) and if \delta(r)\geq c\,r^{q} , then there exist constants C_{1},C_{2}>0 such that for all N\geq 1 , \bar{\mathcal{R}}_{N}\;\leq\;\frac{C_{1}+C_{2}\sum_{n=0}^{N-1}\alpha_{n}^{2}}{A_{N}^{p}}\;=\;\mathcal{O}\bigl(A_{N}^{-p}\bigr). In particular, if \alpha_{n}=1/n , then A_{N}=\Theta(\ln N) and \bar{\mathcal{R}}_{N}=O\bigl((\ln N)^{-p}\bigr) . Proof. Throughout the proof, write D_{n}:=D_{\vartheta}(\zeta_{n},\hbar(\zeta_{n})),\quad A_{N}:=\sum_{n=0}^{N-1}\alpha_{n},\quad\bar{D}_{N}:=\frac{1}{A_{N}}\sum_{n=0}^{N-1}\alpha_{n}D_{n}. Let p=(q-1)/q\in[1/2,1) as in the statement. Since \delta(r)\geq c\,r^{q} and by the Definition of D_{n}=D_{\vartheta}(\zeta_{n},\hbar(\zeta_{n})) one shows (e.g. from the midpoint-convexity inequality) that D_{n}\;\geq\;\delta\bigl(\|\zeta_{n}-\hbar(\zeta_{n})\|\bigr)\;\geq\;c\,\|\zeta_{n}-\hbar(\zeta_{n})\|^{q}, hence \|\zeta_{n}-\hbar(\zeta_{n})\|^{q}\;\leq\;D_{n}/c. Lemma 3.2 gives \mathbb{E}\bigl[D_{n+1}\mid\mathcal{F}_{n}\bigr]+\tfrac{1}{2}\,\delta\bigl(\|\zeta_{n}-\hbar(\zeta_{n})\|\bigr)\,\alpha_{n}\leq(1+L\alpha_{n}^{2})\,D_{n}+\sigma^{2}\alpha_{n}^{2}. Substitute \delta\bigl(\|\zeta_{n}-\hbar(\zeta_{n})\|\bigr)\geq c\,\|\zeta_{n}-\hbar(\zeta_{n})\|^{q}\geq c(D_{n}/c)=D_{n} to obtain \mathbb{E}\bigl[D_{n+1}\mid\mathcal{F}_{n}\bigr]+\tfrac{1}{2}\,D_{n}\,\alpha_{n}\;\leq\;(1+L\alpha_{n}^{2})\,D_{n}+\sigma^{2}\alpha_{n}^{2}. Rearrange: \mathbb{E}\bigl[D_{n+1}\mid\mathcal{F}_{n}\bigr]\;\leq\;\bigl(1-\tfrac{1}{2}\alpha_{n}+L\alpha_{n}^{2}\bigr)\,D_{n}+\sigma^{2}\alpha_{n}^{2}. Define E_{n}:=\frac{D_{n}}{A_{n}^{p}}, with the convention A_{0}=0 , E_{0}=D_{0} . Observe that for p\in(0,1) and \alpha_{n}>0 , \frac{1}{A_{n+1}^{p}}=\frac{1}{(A_{n}+\alpha_{n})^{p}}\geq\frac{1}{A_{n}^{p}}\Bigl[1-p\,\frac{\alpha_{n}}{A_{n}}\Bigr] by the binomial-type inequality (1+t)^{-p}\geq 1-p\,t for t\geq 0 . Hence \frac{D_{n+1}}{A_{n+1}^{p}}\leq\bigl(1-\tfrac{1}{2}\alpha_{n}+L\alpha_{n}^{2}\bigr)\,E_{n}\Bigl[1-p\,\tfrac{\alpha_{n}}{A_{n}}\Bigr]\;+\;\sigma^{2}\,\frac{\alpha_{n}^{2}}{A_{n+1}^{p}}. Using A_{n}\leq A_{n+1} and absorbing higher-order \alpha_{n}^{2} -terms into constants, there are C_{1},C_{2}>0 so that \mathbb{E}\bigl[E_{n+1}\mid\mathcal{F}_{n}\bigr]\;\leq\;E_{n}-\tfrac{1}{2}\,\frac{\alpha_{n}}{A_{n}^{p}}\,D_{n}-p\,\frac{\alpha_{n}}{A_{n}^{p+1}}\,D_{n}+C_{1}\,\alpha_{n}^{2}\,E_{n}+C_{2}\,\frac{\alpha_{n}^{2}}{A_{n}^{p}}. Noting that \frac{D_{n}}{A_{n}^{p}}=E_{n} and \frac{D_{n}}{A_{n}^{p+1}}=E_{n}/A_{n} , we get \mathbb{E}\bigl[E_{n+1}\mid\mathcal{F}_{n}\bigr]\;\leq\;E_{n}\Bigl[1-\tfrac{1}{2}\,\alpha_{n}-p\,\tfrac{\alpha_{n}}{A_{n}}+C_{1}\,\alpha_{n}^{2}\Bigr]\;+\;C_{2}\,\frac{\alpha_{n}^{2}}{A_{n}^{p}}. Since \sum_{n}\alpha_{n}=\infty and \sum_{n}\alpha_{n}^{2}<\infty , the negative terms -\tfrac{1}{2}\alpha_{n} and -p\,\alpha_{n}/A_{n} dominate eventually, yielding a super-martingale structure for (E_{n}) . An application of a discrete martingale-difference summation argument shows that E_{N}\;\leq\;E_{0}+C_{2}\sum_{n=0}^{N-1}\frac{\alpha_{n}^{2}}{A_{n}^{p}}\;\leq\;\frac{D_{0}}{A_{0}^{p}}+C_{2}\sum_{n=0}^{N-1}\frac{\alpha_{n}^{2}}{A_{n}^{p}}. But A_{n}\leq A_{N} for all n0 . Proof. The proof proceeds in the same spirit as Theorem 3.3 , but with the time-varying Legendre functions \{\vartheta_{n}\} and their moduli \{\delta_{n}\} . By the argument of Lemma 3.2 , applied at iteration n with the distance-generating function \vartheta_{n} , there exist constants L_{n},\sigma^{2}_{n}>0 (depending on the Lipschitz and noise bounds for \vartheta_{n} ) such that \displaystyle\mathbb{E}\bigl[D_{\vartheta_{n}}(\zeta_{n+1},\hbar(\zeta_{n+1}))\mid\mathcal{F}_{n}\bigr] \displaystyle+\;\tfrac{1}{2}\,\delta_{n}\bigl(\|\zeta_{n}-\hbar(\zeta_{n})\|\bigr)\,\alpha_{n} \displaystyle\leq\;(1+L_{n}\,\alpha_{n}^{2})\;D_{\vartheta_{n}}(\zeta_{n},\hbar(\zeta_{n}))\;+\;\sigma_{n}^{2}\,\alpha_{n}^{2}. Define the adapted sequences a_{n}\;=\;D_{\vartheta_{n}}(\zeta_{n},\hbar(\zeta_{n})),\quad b_{n}\;=\;\tfrac{1}{2}\,\delta_{n}\bigl(\|\zeta_{n}-\hbar(\zeta_{n})\|\bigr)\,\alpha_{n},\quad c_{n}\;=\;\sigma_{n}^{2}\,\alpha_{n}^{2}. Then \mathbb{E}[a_{n+1}\mid\mathcal{F}_{n}]+b_{n}\;\leq\;(1+L_{n}\,\alpha_{n}^{2})\,a_{n}+c_{n}. By assumption (B2) there is \bar{\kappa} such that \vartheta_{n}(\zeta)\leq\bar{\kappa}\,\vartheta(\zeta)\quad\Longrightarrow\quad\nabla\vartheta_{n},\;\nabla\vartheta_{n}^{*}\text{ are Lipschitz with constant }\bar{\kappa}\,L, and the noise bound gives \sigma_{n}^{2}\leq\bar{\kappa}^{2}\,\sigma^{2} . Thus we may take L_{n}\leq\bar{\kappa}^{2}\,L,\quad\sigma_{n}^{2}\leq\bar{\kappa}^{2}\,\sigma^{2}, so \mathbb{E}[a_{n+1}\mid\mathcal{F}_{n}]+b_{n}\;\leq\;\bigl(1+(\bar{\kappa}^{2}L)\,\alpha_{n}^{2}\bigr)\,a_{n}+(\bar{\kappa}^{2}\sigma^{2})\,\alpha_{n}^{2}. Since \sum_{n}\alpha_{n}^{2}<\infty and \bar{\kappa}^{2}L is constant, the Robbins-Siegmund Lemma (Lemma 2.7 ) applies, yielding a_{n}\;\to\;a_{\infty}\quad\text{a.s.},\qquad\sum_{n=0}^{\infty}b_{n}<\infty\quad\text{a.s.} By (B1), \inf_{n}c_{n}>0 , so each \delta_{n}(r)\geq c_{n}\,r^{q_{n}} with c_{n}\geq\underline{c}>0 . Then \sum_{n=0}^{\infty}b_{n}=\sum_{n=0}^{\infty}\tfrac{1}{2}\,\delta_{n}(\|\zeta_{n}-\hbar(\zeta_{n})\|)\,\alpha_{n}\geq\tfrac{1}{2}\,\underline{c}\sum_{n=0}^{\infty}\|\zeta_{n}-\hbar(\zeta_{n})\|^{q_{n}}\,\alpha_{n}, which can converge only if \|\zeta_{n}-\hbar(\zeta_{n})\|\to 0 a.s. Hence a_{n}=D_{\vartheta_{n}}(\zeta_{n},\hbar(\zeta_{n}))\to 0 a.s. Since \|\zeta_{n}-\hbar(\zeta_{n})\|\to 0 , any weak cluster point \bar{\zeta} satisfies \bar{\zeta}=\hbar(\bar{\zeta}) , so \bar{\zeta}\in\operatorname{Fix}(\mathcal{hbar}) . Moreover, the Bregman-Fejér monotonicity D_{\vartheta_{n}}(\zeta_{n+1},\zeta^{*})\leq D_{\vartheta_{n}}(\zeta_{n},\zeta^{*}) for any fixed \zeta^{*}\in\operatorname{Fix}(\hbar) (by nonexpansivity and three-point identity) ensures all cluster points coincide. Reflexivity of \mathcal{X} then gives \zeta_{n}\;\rightharpoonup\;\zeta^{*}\quad\text{and hence}\quad\zeta_{n}\to\zeta^{*}, where strong convergence follows under uniform convexity of \mathcal{X} or \vartheta_{n} . Thus D_{\vartheta_{n}}(\zeta_{n},\hbar(\zeta_{n}))\to 0 and \zeta_{n}\to\zeta^{*}\in\operatorname{Fix}(\hbar) almost surely. ∎ Adaptive geometries can track local curvature or empirically estimated Hessian information (e.g. quasi-Newton style), offering potential acceleration without sacrificing convergence guarantees. Definition 5.3 (Trimming operator) . For a vector u\in\mathcal{X}^{*} and integer k\geq 0 , let \operatorname{Trim}_{k}(u) zero out the k largest-magnitude coordinates of u (in a chosen basis), modeling robustification against outliers. Algorithm 2 Robust Bregman-SKM 1: initial \zeta_{0} , (\alpha_{n}) , Legendre \vartheta , trimming level (k_{n}) 2: for n=0,1,2,\dots do 3: \tilde{\mho}_{n}\leftarrow\operatorname{Trim}_{k_{n}}(\mho_{n}) 4: \varsigma_{n}\leftarrow\nabla\vartheta^{*}((1-\alpha_{n})\,\nabla\vartheta(\zeta_{n})+\alpha_{n}\,\nabla\vartheta(\hbar(\zeta_{n})+\tilde{\mho}_{n})) 5: \zeta_{n+1}\leftarrow\varsigma_{n} 6: end for Assumption [Heavy-Tail Noise] The noise \mho_{n} satisfies \mathbb{E}[\|\mho_{n+1}\|_{*}^{1+\epsilon}\mid\mathcal{F}_{n}]<\infty for some \epsilon\in(0,1) . Proposition 5.4 (Convergence with Trimming) . Under (A1),(A3), Assumption 5 , and if k_{n}=o(n^{\epsilon/(1+\epsilon)}) , the iterates of Algorithm 2 converge a.s. to \operatorname{Fix}(\hbar) and D_{\vartheta}(\zeta_{n},\hbar(\zeta_{n}))\to 0 . Proof. We adapt the proof of Theorem 3.3 to the trimmed-noise case. By Assumption, there is \epsilon\in(0,1) and M<\infty such that \mathbb{E}\bigl[\|\mho_{n+1}\|_{*}^{1+\epsilon}\mid\mathcal{F}_{n}\bigr]\leq M\quad\text{a.s.} Let \tilde{\mho}_{n}=\operatorname{Trim}_{k_{n}}(\mho_{n}) zero out the k_{n} largest-magnitude coordinates of \mho_{n} . Then, writing \mho_{n}=\tilde{\mho}_{n}+r_{n} with r_{n} the removed remainder, one shows by standard order-statistic / Markov-inequality arguments that there exists \delta>0 and C>0 so that (4) \mathbb{E}\bigl[\|\tilde{\mho}_{n}\|_{*}^{2}\mid\mathcal{F}_{n-1}\bigr]\;\leq\;C\,k_{n}^{-\epsilon}\;\leq\;C\,n^{-\delta}, provided k_{n}=o\bigl(n^{\epsilon/(1+\epsilon)}\bigr) (choose any \delta<\epsilon/(1+\epsilon) ). The same argument as in Lemma 3.2 gives, for some constants L,\sigma^{2}>0 , \mathbb{E}\bigl[D_{\vartheta}(\zeta_{n+1},\hbar(\zeta_{n+1}))\mid\mathcal{F}_{n}\bigr]+\tfrac{1}{2}\,\delta\bigl(\|\zeta_{n}-\hbar(\zeta_{n})\|\bigr)\,\alpha_{n}\;\leq\;\bigl(1+L\,\alpha_{n}^{2}\bigr)D_{\vartheta}(\zeta_{n},\hbar(\zeta_{n}))+\alpha_{n}^{2}\,\mathbb{E}\bigl[\|\tilde{\mho}_{n}\|_{*}^{2}\mid\mathcal{F}_{n}\bigr]. Using the trimmed-noise bound ( 4 ), \mathbb{E}\bigl[D_{\vartheta}(\zeta_{n+1},\hbar(\zeta_{n+1}))\mid\mathcal{F}_{n}\bigr]+\tfrac{1}{2}\,\delta(\|\zeta_{n}-\hbar(\zeta_{n})\|)\,\alpha_{n}\;\leq\;\bigl(1+L\alpha_{n}^{2}\bigr)\,D_{\vartheta}(\zeta_{n},\hbar(\zeta_{n}))\;+\;C\,\alpha_{n}^{2}\,n^{-\delta}. Under (A3), \sum_{n}\alpha_{n}^{2}<\infty . Moreover, since \delta>0 , also \sum_{n=1}^{\infty}\alpha_{n}^{2}\,n^{-\delta}\;<\;\infty. Hence by defining a_{n}=D_{\vartheta}(\zeta_{n},\hbar(\zeta_{n})),\quad b_{n}=\tfrac{1}{2}\,\delta(\|\zeta_{n}-\hbar(\zeta_{n})\|)\,\alpha_{n},\quad c_{n}=C\,\alpha_{n}^{2}\,n^{-\delta}, we see that \sum_{n}c_{n}<\infty . By the one-step descent inequality and the summability above, the Robbins-Siegmund Lemma 2.7 yields a_{n}=D_{\vartheta}(\zeta_{n},\hbar(\zeta_{n}))\;\to\;0\quad\text{a.s.},\qquad\sum_{n=0}^{\infty}b_{n}<\infty\quad\text{a.s.} In particular \|\zeta_{n}-\hbar(\zeta_{n})\|\to 0 a.s. Since (\zeta_{n}) lies in reflexive \mathcal{X} and \|\zeta_{n}-\hbar(\zeta_{n})\|\to 0 , any weak cluster point \bar{\zeta} satisfies \bar{\zeta}=\hbar(\bar{\zeta}) (see [ 3 , Thm. 5.14] ). Fejér-monotonicity in Bregman distance ensures uniqueness of the cluster point, hence \zeta_{n}\rightharpoonup\zeta^{*}\in\operatorname{Fix}(\hbar) . Uniform convexity of \vartheta or \mathcal{X} upgrades weak to strong convergence, giving \zeta_{n}\to\zeta^{*} . Therefore the trimmed Bregman- SKM iterates converge almost surely to a fixed point and D_{\vartheta}(\zeta_{n},\hbar(\zeta_{n}))\to 0 , as required. ∎ Corollary 5.5 . If \mho_{n} has only finite first moments ( \epsilon\to 0 ), setting k_{n}\sim\ln n still ensures convergence. One can integrate inertia (momentum) into Algorithms 1 and 2 by adding an extrapolation term \zeta_{n}+\beta_{n}(\zeta_{n}-\zeta_{n-1}) before the Bregman update. Proving convergence in this setting, especially under adaptive or heavy-tailed noise, remains an open challenge. Example 3 (Adaptive-Robust Hybrid) . Combine \vartheta_{n} evolving by online Hessian approximations with trimming levels k_{n} , to obtain an algorithm resilient to both curvature changes and outliers. Developing explicit residual bounds for this hybrid is left for future work. 6. Numerical Experiments In this section, we provide two numerical experiments to illustrate the convergence behavior and robustness of the proposed Bregman- SKM algorithms in both adaptive and heavy-tailed settings. All experiments were implemented in Python with NumPy and CVXPY, and run on a standard laptop. Example 4 (Entropy-Regularized Policy Iteration) . We solve a discounted policy evaluation problem with entropy regularization. Let \mathcal{X}=\Delta^{d} , the probability simplex in \mathbb{R}^{d} , and define the mapping \hbar(\zeta)=\frac{\exp(\eta\,Ax)}{\mathbf{1}^{\top}\exp(\eta\,Ax)}, where A\in\mathbb{R}^{d\times d} is a transition reward matrix and \eta>0 is a regularization parameter. The Bregman geometry is induced by the negative entropy function: \vartheta(\zeta)=\sum_{i=1}^{d}\zeta_{i}\log\zeta_{i}. We compare the following three algorithms: (1) Classical SKM with Euclidean geometry; (2) Bregman- SKM with fixed \vartheta(\zeta) ; (3) Adaptive Bregman- SKM using time-varying entropy weights. We choose d=10 , \eta=2.0 , and initialize \zeta_{0}=\frac{1}{d}\mathbf{1} . We simulate additive martingale noise \mho_{n}\sim\mathcal{N}(0,\sigma^{2}I_{d}) , with \sigma=0.1 , and use a step-size \alpha_{n}=\frac{1}{n+10} . Each algorithm is run for N=1000 iterations. Table 1. Final Bregman residuals after 1000 iterations Algorithm \bar{\mathcal{R}}_{1000} \|\zeta_{N}-\zeta^{*}\|_{1} Runtime (s) SKM (Euclidean) 0.0213 0.0845 0.17 Bregman-SKM (fixed) 0.0064 0.0432 0.18 Adaptive Bregman-SKM 0.0049 0.0301 0.21 Observation: Both Bregman-SKM variants significantly outperform the classical SKM, with the adaptive version showing the fastest decay in residuals. Example 5 (Robust Policy Update under Heavy-Tailed Noise) . We now consider a robust learning problem with synthetic heavy-tailed noise. The setup is the same as in Example 1, but noise is generated from a Student- t distribution with 2 degrees of freedom, i.e., \mho_{n}\sim t_{2} , inducing infinite variance. We compare: (1) Bregman- SKM (no trimming); (2) Robust Bregman- SKM with trimming k_{n}=\lceil\log(n+2)\rceil . Table 2. Effect of trimming under heavy-tailed noise Algorithm \bar{\mathcal{R}}_{1000} \|\zeta_{N}-\zeta^{*}\|_{1} Bregman-SKM (no trimming) 0.0928 0.2032 Robust Bregman-SKM (trimmed) 0.0194 0.0589 Observation: Without trimming, heavy-tailed noise causes residuals to fluctuate significantly. The trimmed robust Bregman-SKM successfully suppresses outliers and converges steadily. These experiments confirm that: • Bregman- SKM outperforms standard SKM under non-Euclidean geometries; • Adaptive geometries further enhance convergence; • Robust versions are essential under heavy-tailed or adversarial noise. 7. Conclusion and Future Directions In this work, we have introduced and analyzed a novel stochastic Krasnosel skiĭ-Mann iteration in reflexive Banach spaces driven by Bregman distances. In theis paper, we formulated the stochastic fixed-point iteration using a general Legendre function and proved almost-sure convergence under standard martingale-difference noise (Theorem 3.3 ). By exploiting the modulus of uniform convexity, we derived explicit O(A_{N}^{-p}) bounds on the averaged Bregman residual for \delta(r)\geq c\,r^{q} (Theorem 4.3 ). We extended the framework to time-varying Bregman geometries (Theorem 5.2 ) and heavy-tailed noise with trimming (Proposition 5.4 ), demonstrating the flexibility of Bregman- SKM . Experiments on entropy-regularized policy iteration and heavy-tailed noise confirm that Bregman- SKM outperforms classical SKM and remains robust under non-Gaussian perturbations. Several promising avenues remain open: Inertial and Variance-Reduced Hybrids: Incorporating momentum or SVRG-style variance reduction into Bregman- SKM could yield faster rates, but requires new analysis in non-Euclidean settings. Decentralized and Asynchronous SKM : Extending to networked or delayed environments would broaden applications in distributed optimization and multi-agent RL. Beyond Reflexivity: Addressing non-reflexive Banach spaces or quasi-Banach settings may handle more general regularizers and loss functions. Adaptive Distance Learning: Online adaptation of the generating function \vartheta_{n} based on curvature estimates could further accelerate convergence in practice. We anticipate that the Bregman- SKM framework will serve as a foundation for future advances in stochastic fixed-point algorithms, with applications ranging from reinforcement learning to large-scale inverse problems.