Geometric Milstein Scheme for Stochastic Differential Equations on SO(n) and SE(n) Xi Wang, Victor Solo Abstract In the paper, we propose a higher-order geometry-preserving numerical method for stochastic differential equations (SDEs) evolving on the Lie groups SO(n) and SE(n). Most existing Lie group integrators rely on Magnus expansion of the exponential map, which makes the construction of higher-order stochastic schemes difficult. To overcome this limitation, we develop a tangent-space parameterization corrected Milstein method (TaSP-CM), extending the tangent space parameterization (TaSP) framework from Lie-group ODEs to the stochastic setting. Although TaSP is a well-established method for Lie ODEs, the extension to SDEs is non-trivial and requires new stochastic corrections that ensure both geometric consistency and higher-order accuracy. We prove that the proposed scheme achieves strong convergence of order 1 under both commutative and non-commutative noise. Numerical experiments illustrate the theoretical results and demonstrate the efficiency and robustness of the proposed method. 1 INTRODUCTION Over the past few decades, stochastic differential equations (SDEs) on Lie groups have found increasing application. Among these, the special orthogonal group \mathrm{SO}(n) and the special Euclidean group \mathrm{SE}(n) play a critical role due to their broad applications in satellite control 1 ; 10 , robot pose estimation 13 , object tracking 30 , generative model 4 ; 25 , geoscience, and particle physics 3 ; 5 . The broad range of applications involving SDEs on Lie groups have led to an increasing need for numerical methods that respect the underlying geometric constraints. In this paper, we consider the class of nonlinear autonomous Itô SDEs evolving on Lie groups G=\mathrm{SO}(n),\mathrm{SE}(n) , given by \displaystyle d\mathbf{X}(t)=\mathbf{X}\mathcal{B}_{I}(\mathbf{X}(t))dt+{\frac{1}{2}}\mathbf{X}\mathsf{\Sigma}_{N}(\mathbf{X})dt+\mathbf{X}\sum_{j=1}^{d}\mathcal{B}_{j}(\mathbf{X}(t))dW_{j}(t), (1) where dW_{j}(t) are independent standard scalar Wiener processes, the drift \mathbf{X}\mathcal{B}_{I} and diffusion fields \mathbf{X}\mathcal{B}_{j} lie in the tangent space T_{\mathbf{X}}G , and the curvature-related pinning-drift term \mathbf{X}\Sigma_{N}(\mathbf{X}) lies in the normal space N_{\mathbf{X}}G 31 . Our goal is to develop geometry-preserving numerical schemes (GPNS) for eq. 1 with strong convergence guarantees. A GPNS with time step size \delta produces a discrete-time approximation \mathbf{\widehat{\mathbf{X}}}(t):[0,T]\to G such that, for every noise realization of dW_{j}(t) , the numerical trajectory remains on G at all times. A GPNS is said to achieve strong convergence rate (SCR) p , if the squared expected mean-square error between \mathbf{\widehat{\mathbf{X}}}(t) and the exact solution \mathbf{X}(t) is \mathcal{O}(\delta^{p}) . When it is reduced to the flat Euclidean setting, i.e., when G=\mathbb{R}^{n} and \mathsf{\Sigma}(\mathbf{X})\equiv 0 , there exists numerous literature on numerical schemes with SCR, including the Euler–Maruyama method, Milstein method, and Runge–Kutta methods 18 ; 19 ; 28 . However, these Euclidean methods are inherently designed to exploit the linear structure of Euclidean space. When applied directly to Lie groups, where a global vector space structure is absent, these methods fail to preserve the underlying geometry and tend to drift off the manifold even over short time scales. Some geometry-preserving schemes are proposed for the deterministic counterparts of Lie group SDEs, namely ordinary differential equations (ODEs) on Lie groups 24 ; 23 ; 8 . However, the SDE eq. 1 includes a pinning drift that lies in the normal space, while ODE schemes account only for tangent dynamics. As a result, ODE schemes cannot be directly extended to the stochastic setting, which makes the design of GPNS for SDEs on \mathrm{SO}(n) and \mathrm{SE}(n) a non-trivial task. Several prior works have introduced GPNS for SDEs on Lie groups based on the Magnus expansion. For instance, 20 proposed the Lie operator splitting (L-OP) scheme for autonomous nonlinear SDEs over Lie groups and established a weak convergence rate. 16 developed the Geometric Castell–Gaines (G-CG) scheme with truncated Magnus expansion, demonstrating a strong convergence rate. However, these convergence results rely on the exact solution of certain Euclidean ODEs, which is computationally intractable in practice. In addition, 17 proposed an computationally tractable Euler–Maruyama method on Lie groups based on the Magnus expansion, but without a convergence analysis. Method GP CT Diffusion Type Strong conv. rate Eu–Mil 19 ✗ ✔ N \mathcal{O}(\delta) L–SP 20 ✔ ✗ N Weak G–CG 16 ✔ ✗ N \mathcal{O}(\delta^{p}) G–EM 26 ; 2 ✔ ✔ L \mathcal{O}(\delta^{1/2}) S–RKMK 21 ; 22 ✔ ✔ C/L \mathcal{O}(\delta^{k}) G–EM, TaSP–EM 31 ; 32 ✔ ✔ N \mathcal{O}(\delta^{1/2-\epsilon}) TaSP–CM (ours) ✔ ✔ N \boldsymbol{\mathcal{O}(\delta)} Table 1 : Comparison of existing numerical schemes and our method. GP: geometry-preserving; CT: computationally tractable; Diffusion type: C = constant, L = linear, N = nonlinear; p : truncation order of the Magnus expansion; k : Runge–Kutta order. There are few computationally tractable GPNS schemes with strong convergence guarantees on \mathrm{SO}(n) or \mathrm{SE}(n) . 26 established a Geometric Euler–Maruyama (G-EM) scheme for linear SDEs, i.e., with state-independent diffusion \mathcal{B}_{j} , on \mathrm{SO}(n) and \mathrm{SE}(n) , proving a SCR of 1/2 . This result was further extended in 2 to linear SDEs on general Riemannian manifolds, also achieving 1/2 SCR. Furthermore, 31 analyzed the G-EM method for nonlinear autonomous SDEs on \mathrm{SO}(n) and established a SCR of 1/2-\epsilon for arbitrarily small \epsilon>0 . Another approach, the TaSP-EM method, based on the Tangent Space Parametrization (TaSP) strategy 32 , was also shown to attain a SCR of 1/2-\epsilon . However, all these methods are Euler–Maruyama variants and are limited to at most 1/2 SCR. To the best of our knowledge, the only existing computationally tractable GPNS with SCR exceeding 1/2 on \mathrm{SO}(n) and \mathrm{SE}(n) is proposed in 21 ; 22 . By applying p ‑th order Runge–Kutta methods to the Magnus expansion truncated at order 2p-2 , the authors in 21 proposed the stochastic Runge–Kutta–Munthe–Kaas (S-RKMK) scheme and established a SCR of order p for linear SDE on Lie groups. Furthermore, 22 extended the p SCR of S-RKMK to the nonlinear autonomous SDEs on Lie groups. However, the S-RKMK scheme in 22 is based on the Stratonovich formulation of the SDE. As shown in 31 , Stratonovich-based numerical schemes converge to the correct solution only when all the diffusion terms \mathcal{B}_{j} are constants. Therefore, constructing computationally efficient GPNS with SCR greater than 1/2 for nonlinear SDEs on \mathrm{SO}(n) and \mathrm{SE}(n) remains an open problem. Notably, a fundamental method in the Euclidean setting, the Euclidean Milstein (Eu-Mil) 19 scheme which achieves SCR 1 for nonlinear SDEs, has yet to be extended to the Lie group setting. Motivated by this research gap, we propose the Tangent Space Parametrization–Corrected Milstein (TaSP-CM) scheme, which extends the Euclidean Milstein method to the Lie groups \mathrm{SO}(n) and \mathrm{SE}(n) . Our approach builds on the Tangent Space Parametrization (TaSP) technique introduced in 27 , and achieves SCR 1 and geometry perseverance simultaneously. The main contributions of this work are as follows: • We first introduce the TaSP-CM scheme for SDEs on the special orthogonal group \mathrm{SO}(n) . By working in the Lie algebra and employing a Lie bracket correction, the scheme attains SCR 1 under both commutative and non-commutative noise, which improves the 1/2 SCR of geometry-preserving Euler–Maruyama schemes. • Leveraging the semidirect-product structure of \mathrm{SE}(n)=\mathrm{SO}(n)\ltimes\mathbb{R}^{n} , we develop the TaSP framework on \mathrm{SE}(n) and extend TaSP-CM over \mathrm{SE}(n) . A convergence analysis also provides SCR 1 convergence under the both commutative and non-commutative noise settings, as same as those on \mathrm{SO}(n) . • We conduct numerical simulations on \mathrm{SO}(n) and \mathrm{SE}(n) and compare the performance with several baselines. The results not only illustates the theoretical analysis but also demonstrate the effectiveness and advantages of the proposed TaSP-CM method. Table 1 summarizes the comparison between our method and prior works. The remainder of the paper is organized as follows. Section 2 reviews the preliminaries for \mathrm{SO}(n) and \mathrm{SE}(n) . Section 3 formulates the Itô SDEs on Lie groups and defines strong convergence for geometry-preserving schemes. Section 4 presents the TaSP–CM integrator on \mathrm{SO}(n) , and Section 5 proves that it attains SCR 1 under both commutative and non-commutative noise. Section 6 extends the framework and analysis to \mathrm{SE}(n) . Numerical results are given in Section 7 . Finally, Section 8 concludes the paper. Detailed proofs of our main results are set out in Appendices A - F . 2 Preliminaries In this section we review the geometry of \mathrm{SO}(n) and \mathrm{SE}(n) with the associated calculus. For further details, please see 6 ; 15 . 2.1 Special Orthogonal Group SO(n) In this subsection, we introduce the geometric and calculus facts on \mathrm{SO}(n) . 2.1.1 Geometry of SO(n) We define the special orthogonal group \displaystyle\mathrm{SO}(n)=\bigl\{\mathbf{R}\in\mathbb{R}^{n\times n}\bigl|\mathbf{R}^{\top}\mathbf{R}=I,\det\mathbf{R}=1\bigr\}, as the set of all real n\times n rotation matrices. The associated Lie algebra is the collection of skew‑symmetric matrices \mathfrak{so}(n)=\bigl\{\mathcal{Z}\in\mathbb{R}^{n\times n}\bigl|\mathcal{Z}^{\top}=-\mathcal{Z}\bigr\}, which stands for the infinitesimal rotation and forms a linear subspace of \mathbb{R}^{n\times n} . The orthogonal complement of \mathfrak{so}(n) in \mathbb{R}^{n\times n} is the collection of all symmetric matrices \mathfrak{so}(n)^{\perp}:=\{\mathsf{C}\in R^{n\times n}\mid\mathsf{C}^{T}=\mathsf{C}\}. For a fixed rotation \mathbf{R}\in\mathrm{SO}(n) , the tangent and normal space are obtained by left‑multiplying the Lie algebra and the orthogonal complement, i.e., \displaystyle T_{\mathbf{R}}\mathrm{SO}(n)=\{\mathbf{R}\mathcal{Z}\mid\mathcal{Z}\in\mathfrak{so}(n)\},\qquad N_{\mathbf{R}}\mathrm{SO}(n)=\{\mathbf{R}\mathsf{C}\mid\mathsf{C}\in\mathfrak{so}(n)^{\perp}\}. The orthogonal projection of a matrix A\in\mathbb{R}^{n\times n} onto the tangent space T_{\mathbf{R}}\mathrm{SO}(n) and normal space N_{\mathbf{R}}\mathrm{SO}(n) is given by \displaystyle\POtg(A)={\frac{1}{2}}\bigl(A-\mathbf{R}A^{\top}\mathbf{R}\bigr),\qquad\POnm(A)={\frac{1}{2}}\bigl(A+\mathbf{R}A^{\top}\mathbf{R}\bigr). To help readers distinguish geometrical objects, we adopt the following typographic convention throughout the paper: boldface symbols (e.g., \mathbf{R} ) represent points on the Lie groups; calligraphic symbols (e.g., \mathcal{Z} ) denote elements in tangent spaces; and sans‑serif symbols (e.g., \mathsf{C} ) indicate elements in normal spaces. 2.1.2 Calculus on SO(n) Equipped with the inner product g(\mathbf{R}\mathcal{Z}_{1},\mathbf{R}\mathcal{Z}_{2}):=\operatorname{tr}\bigl(\mathcal{Z}_{1}^{\top}\mathcal{Z}_{2}\bigr),\mathcal{Z}_{1},\mathcal{Z}_{2}\in\mathfrak{so}(n), \mathrm{SO}(n) becomes a embedding Riemannian manifold in the Euclidean space \mathbb{R}^{n\times n} . The embedding Riemannian structure allows us to define intrinsic calculus operators on \mathrm{SO}(n) 6 . The Levi–Civita connection \mathcal{\mathcal{L}^{O}} acts as the intrinsic differentiation on tangent vector fields over \mathrm{SO}(n) that is compatible with metric. Formally, let \mathbf{R}\mathcal{Z}_{1}(\mathbf{R}) and \mathbf{R}\mathcal{Z}_{2}(\mathbf{R}) be two tangent vector fields over \mathrm{SO}(n) . The Levi–Civita connection of \mathbf{R}\mathcal{Z}_{1} along \mathbf{R}\mathcal{Z}_{2} is defined as the tangent projection of the Euclidean directional derivative, \displaystyle\mathcal{L}^{O}_{\mathbf{R}\mathcal{Z}_{1}}\bigl(\mathbf{R}\mathcal{Z}_{2}(\mathbf{R})\bigr):=\POtg\bigl(\nabla_{\mathbf{R}\mathcal{Z}_{1}}\bigl(\mathbf{R}\mathcal{Z}_{2}(\mathbf{R})\bigr)\bigr)=\mathbf{R}(\nabla_{\mathbf{R}\mathcal{Z}_{1}}\mathcal{Z}_{2}+{\frac{1}{2}}[\mathcal{Z}_{1},\mathcal{Z}_{2}]), (2) where \nabla is the Euclidean directional derivative, i.e., \displaystyle\mathbf{R}\nabla_{\mathbf{R}\mathcal{Z}_{1}}\mathcal{Z}_{2}= \displaystyle\mathbf{R}\sum_{r,s=1}^{n}\frac{\partial\mathcal{Z}_{2}}{\partial\mathbf{R}_{rs}}(\mathbf{R}\mathcal{Z}_{2})_{rs}\in T_{\mathbf{R}}{\mathrm{SO}(n)}, and the Lie bracket of \mathfrak{so}(n) is defined as [\mathcal{Z}_{1},\mathcal{Z}_{2}]=\mathcal{Z}_{1}\mathcal{Z}_{2}-\mathcal{Z}_{2}\mathcal{Z}_{1} . Equation 2 illustrates that, in addition to the standard directional derivative, a correction term {\frac{1}{2}}\mathbf{R}[\mathcal{Z}_{1},\mathcal{Z}_{2}] arises due to the non-commutative Lie algebra structure. In contrast, in Euclidean space, where vector fields commute, the differentiation reduces to the usual directional derivative. This contrast highlights a fundamental distinction between differentiation on the curved manifold \mathrm{SO}(n) and in flat Euclidean space. With a slight abuse of language, we refer to \displaystyle\mathcal{D}^{O}_{\mathcal{Z}_{1}}\bigl(\mathcal{Z}_{2}(\mathbf{R})\bigr):=\nabla_{\mathbf{R}\mathcal{Z}_{1}}\mathcal{Z}_{2}+{\frac{1}{2}}[\mathcal{Z}_{1},\mathcal{Z}_{2}] as the covariant derivative (CovD) of \mathcal{Z}_{2} along the direction \mathcal{Z}_{1} . Moreover, we also focus on the normal residual of \nabla_{\mathbf{R}\mathcal{Z}_{1}}(\mathbf{R}\mathcal{Z}_{2}) , i.e., \displaystyle\POnm\Big(\nabla_{\mathbf{R}\mathcal{Z}_{1}}\bigl(\mathbf{R}\mathcal{Z}_{2}(\mathbf{R})\bigr)\Big)={\frac{1}{2}}\mathbf{R}(\mathcal{Z}_{1}\mathcal{Z}_{2}+\mathcal{Z}_{2}\mathcal{Z}_{1}), where we refer the following bilinear map \mathsf{S}^{O}(\mathcal{Z}_{1},\mathcal{Z}_{2})(\mathbf{R})={\frac{1}{2}}(\mathcal{Z}_{1}\mathcal{Z}_{2}+\mathcal{Z}_{2}\mathcal{Z}_{1}) as the second fundamental form (SFF) 15 . 2.2 Special Euclidean Group SE(n) The special Euclidean group \mathrm{SE}(n) , the associated Lie algebra \mathfrak{se}(n) , and the normal component \mathfrak{se}(n)^{\perp} are defined as \displaystyle\mathrm{SE}(n)= \displaystyle\Bigl\{\mathbf{E}=(\mathbf{R},\mathbf{p})=\begin{bmatrix}\mathbf{R}&\mathbf{p}\\ 0&1\end{bmatrix}\Bigm|\mathbf{R}\in\mathrm{SO}(n),\mathbf{p}\in\mathbb{R}^{n}\Bigr\}, \displaystyle\mathfrak{se}(n)= \displaystyle\Bigl\{\mathcal{V}\ =(\mathcal{Z},v)=\begin{bmatrix}\mathcal{Z}&v\\ 0&0\end{bmatrix}\Bigm|\mathcal{Z}\in\mathfrak{so}(n),v\in\mathbb{R}^{n}\Bigr\}, \displaystyle\mathfrak{se}(n)^{\perp}= \displaystyle\Bigl\{\mathsf{U}\ =(\mathsf{C},\mathsf{b})=\begin{bmatrix}\mathsf{C}&0\\ \mathsf{b}^{\top}&a\end{bmatrix}\Bigm|\mathsf{C}\in\mathfrak{so}(n)^{\perp},\mathsf{b}\in\mathbb{R}^{n},a\in\mathbb{R}\Bigr\}. Here \mathbf{R} is the rotational component and \mathbf{p} the translational component of a rigid-body pose \mathbf{E} , \mathcal{Z} and v give the corresponding infinitesimal rotation and translation. For a fixed pose \mathbf{E}=(\mathbf{R},\mathbf{p})\in\mathrm{SE}(n) , the tangent and normal spaces are T_{\mathbf{E}}\mathrm{SE}(n)=\{\mathbf{E}\mathcal{V}\mid\mathcal{V}\in\mathfrak{se}(n)\} and N_{\mathbf{E}}\mathrm{SE}(n)=\{\mathbf{E}\mathsf{U}\mid\mathsf{U}\in\mathfrak{se}(n)^{\perp}\} Writing a matrix A=\begin{bmatrix}A_{11}&\mathbf{a}\\ \mathbf{b}^{\top}&a_{22}\end{bmatrix}, the orthogonal projections to the tangent and normal spaces are \displaystyle\PEtg(A)=\begin{bmatrix}\POtg(A_{11})&\mathbf{a}\\ 0&0\end{bmatrix},\qquad\PEnm(A)=\begin{bmatrix}\POnm(A_{11})&0\\ b^{\top}&a_{22}\end{bmatrix}. Similarly, equipping \mathfrak{se}(n) with the Riemannian metric, \langle\mathcal{V}_{1},\mathcal{V}_{2}\rangle={\frac{1}{2}}\operatorname{tr}\bigl(\mathcal{Z}_{1}^{\top}\mathcal{Z}_{2}\bigr)+v_{1}^{\top}v_{2} , for \mathbf{E}=\begin{bmatrix}\mathbf{R}&\mathbf{p}\\ 0&1\end{bmatrix}\in\mathrm{SE}(n),\qquad\mathcal{V}_{i}(\mathbf{E})=\begin{bmatrix}\mathcal{Z}_{i}(\mathbf{E})&v_{i}(\mathbf{E})\\ 0&0\end{bmatrix},\quad i=1,2, the Levi–Civita connection on \mathrm{SE}(n) is given by \displaystyle\mathcal{L}^{E}_{\mathbf{E}\mathcal{V}_{1}}\bigl(\mathbf{E}\mathcal{V}_{2}(\mathbf{E})\bigr)=\PEtg\bigl(\nabla_{\mathbf{E}\mathcal{V}_{1}}\bigl(\mathbf{E}\mathcal{V}_{2}(\mathbf{E})\bigr)\bigr)=\mathbf{E}\mathcal{D}^{E}_{\mathcal{V}_{1}}\bigl(\mathcal{V}_{2}(\mathbf{E})\bigr) and the CovD on \mathrm{SE}(n) is given by \displaystyle\mathcal{D}^{E}_{\mathcal{V}_{1}}\bigl(\mathcal{V}_{2}(\mathbf{E})\bigr)=\begin{pmatrix}\nabla_{\mathbf{E}\mathcal{V}_{1}}\mathcal{Z}_{2}+\tfrac{1}{2}[\mathcal{Z}_{1},\mathcal{Z}_{2}]\\ \nabla_{\mathbf{E}\mathcal{V}_{1}}v_{2}+\tfrac{1}{2}\mathcal{Z}_{1}v_{2}\end{pmatrix}^{\top}. (3) Finally, the SFF reads \mathsf{S}^{E}(\mathcal{V}_{1},\mathcal{V}_{2})(\mathbf{E}):=(\mathsf{S}^{O}(\mathcal{Z}_{1},\mathcal{Z}_{2}),0) . 2.3 Notation on Time Differences To better describe the piecewise solution of SDEs on \mathrm{SO}(n) , we introduce the following time difference notation. For an integer m , a step size \delta , and time t>0 , we define the clipped time t_{{m^{*}}}=\min\{t,m\delta\} and set \displaystyle{\Delta^{*}_{m}}t=t_{{(m+1)^{*}}}-t_{{m^{*}}},\quad F_{m}=F(m\delta) \displaystyle F_{{m^{*}}}(t)=F(t_{m^{*}}),\quad{\Delta^{*}_{m}}F(t)=F_{{(m+1)^{*}}}-F_{{m^{*}}}, for any (deterministic or stochastic) process F(t) . In addition, for Wiener process W_{j} and W_{j^{\prime}} , we denote the double Itô integral within the clipped time as \displaystyle{I_{j,j^{\prime}}^{{m^{*}}}}(t)=\int_{t_{m^{*}}}^{t_{(m+1)^{*}}}\int_{t_{m^{*}}}^{s_{1}}dW_{j}(s_{1})dW_{j^{\prime}}(s_{2}). When j=j^{\prime} , the double Itô integral can be simplified as {\frac{1}{2}}\big(({\Delta^{*}_{m}}W_{j})^{2}-{\Delta^{*}_{m}}t\big) . 3 Problem Statement In this section, we formalize the Itô SDEs on \mathrm{SO}(n) and \mathrm{SE}(n) . We then define the notion of strong convergence for GPNS and identify key difficulties in designing GPNS schemes on \mathrm{SO}(n) and \mathrm{SE}(n) . 3.1 Stochastic Differential Equations on Lie Groups Let G\subseteq\mathbb{R}^{n\times n} be a matrix Lie group with Lie algebra \mathfrak{g} . An Itô SDE on G can be written in the following Itô form \displaystyle d\mathbf{X}(t)=\mathbf{X}\mathcal{B}_{s}(\mathbf{X}(t))dt+\frac{1}{2}\sum_{j=1}^{d}\Big(\nabla_{\mathbf{X}\mathcal{B}_{j}}\bigl(\mathbf{X}\mathcal{B}_{j}(\mathbf{X})\bigr)\Big)dt+\mathbf{X}\sum_{j=1}^{d}\mathcal{B}_{j}(\mathbf{X})dW_{j}(t), (4) where the coefficients \mathcal{B}_{s},\mathcal{B}_{j}\colon G\to\mathfrak{g} are smooth \mathfrak{g} -valued vector fields and \{W_{j}(t)\}_{j=1}^{d} are independent standard Wiener processes. The middle term is the usual Itô correction, expressed as a Euclidean directional derivative 14 . Following the decomposition in section 2 , we split the Itô correction into its tangent component (in \mathfrak{g} ) and its normal component (in \mathfrak{g}^{\perp} ) via the CovD \mathcal{D}^{G} and the SFF \mathcal{S}^{G} , i.e., \displaystyle\mathcal{B}_{I}(\mathbf{X}):=\mathcal{B}_{0}(\mathbf{X})+{\frac{1}{2}}\sum_{j}\mathcal{D}^{G}_{\mathcal{B}_{j}}\bigl(\mathcal{B}_{j}(\mathbf{X})\bigr)\in\mathfrak{g},\quad\mathsf{\Sigma}_{N}(\mathbf{X}):=\sum_{j=1}^{d}\mathsf{S}^{G}(\mathcal{B}_{j},\mathcal{B}_{j})(\mathbf{X})\in\mathfrak{g}^{\perp}. Equation ( 4 ) then becomes \displaystyle d\mathbf{X}(t)=\mathbf{X}\mathcal{B}_{I}(\mathbf{X}(t))dt+{\frac{1}{2}}\mathbf{X}\mathsf{\Sigma}_{N}(\mathbf{X})dt+\mathbf{X}\sum_{j=1}^{d}\mathcal{B}_{j}(\mathbf{X}(t))dW_{j}(t). (5) For \mathbf{X}=\mathbf{R}\in\mathrm{SO}(n) with coefficients \mathcal{B}_{j}(\mathbf{R})\in\mathfrak{so}(n) , we have \mathsf{\Sigma}_{N}(\mathbf{X})=\sum_{j=1}^{d}\mathcal{B}_{j}^{2} . Hence, eq. 5 becomes \displaystyle d\mathbf{R}(t)=\mathbf{R}\mathcal{B}_{I}(\mathbf{R})dt+{\frac{1}{2}}\mathbf{R}(t)\sum_{j=1}^{d}\mathcal{B}_{j}^{2}(\mathbf{R})dt+\mathbf{R}\sum_{j=1}^{d}\mathcal{B}_{j}(\mathbf{R})dW_{j}(t). (6) Furthermore, for \mathbf{X}=\mathbf{E}=(\mathbf{R},\mathbf{p})\in\mathrm{SE}(n) with each coefficient splitting as \mathcal{B}_{j}=(\mathcal{B}^{\mathbf{R}}_{j},\mathcal{B}^{\mathbf{p}}_{j}) , we have \mathsf{\Sigma}_{N}(\mathbf{E})=(\sum_{j=1}^{d}\mathcal{B}_{j}^{2},0) . Consequently, eq. 5 becomes the coupled system \displaystyle\begin{cases}d\mathbf{R}(t)=\mathbf{R}(t)\mathcal{B}^{\mathbf{R}}_{I}(\mathbf{E})dt+{\frac{1}{2}}\mathbf{R}(t)\sum_{j=1}^{d}\bigl(\mathcal{B}^{\mathbf{R}}_{j}(\mathbf{E})\bigr)^{2}dt+\mathbf{R}(t)\sum_{j=1}^{d}\mathcal{B}^{\mathbf{R}}_{j}(\mathbf{E})dW_{j}(t),\\ d\mathbf{p}(t)=\mathbf{R}(t)\mathcal{B}^{\mathbf{p}}_{I}(\mathbf{E})dt+\mathbf{R}(t)\sum_{j=1}^{d}\mathcal{B}^{\mathbf{p}}_{j}(\mathbf{E})dW_{j}(t).\end{cases} (7) The Itô formulations in eqs. 4 , 6 and 7 highlight a fundamental distinction between Euclidean SDEs and Lie ODEs. In addition to the tangential drift and diffusion terms, a SDE on \mathrm{SO}(n) or \mathrm{SE}(n) contains a normal component {\frac{1}{2}}\mathbf{X}\mathsf{\Sigma}_{N}(\mathbf{X}) . The normal drifting term, known as pinning drift 31 , tends to pull the SDE away from G and introduces a fundamental difficulty for GPNS on \mathrm{SO}(n) and \mathrm{SE}(n) . 3.2 Geometry‑Preserving Numerical Scheme In this paper, we aim to develop a geometry‑preserving numerical scheme (GPNS) that solve eq. 5 on G=\mathrm{SO}(n),\mathrm{SE}(n) with strong convergence rate 1 . In a GPNS, the interval [0,T] is partitioned into M equal sub‑intervals of length \delta=T/M . Starting from the initial condition \widehat{\mathbf{X}}_{0}=\mathbf{X}(0)\in\mathrm{SO}(n) , a GPNS evaluates the drift and diffusion terms at time t=m\delta and constructs a local approximation on the interval [m\delta,(m+1)\delta] . To preserve the geometry, the local approximation is required to remain on G for every realization of the diffustion noise. A GPNS is said to achieve strong convergence rate (SCR) of p , if there exists a constant C>0 , independent of \delta , such that the strong error \displaystyle\mathbb{E}\Bigl[\sup_{0\leq t\leq T}\|\widehat{\mathbf{X}}(t)-\mathbf{X}(t)\|_{F}^{2}\Bigr]^{1/2}\leq\mathcal{O}(\delta^{p}), where \|\mathbf{X}\|_{F}=\sqrt{\operatorname{tr}(\mathbf{X}^{\top}\mathbf{X})} denotes the Frobenius norm. 3.3 Main Difficulties A central challenge in the design of high-order geometry-preserving numerical schemes is to simultaneously enforce the nonlinear manifold constraints and achieve a strong convergence order comparable to that of the corresponding Euclidean methods. The following two representative examples are presented to illustrate this tension. 3.3.1 Euclidean Milstein: Strong Order without Geometry In Euclidean spaces \mathbb{R}^{d} , the Euclidean Milstein method achieves 1 SCR for nonlinear SDEs by adding the 3/2 -order Itô-Taylor term to the Euler-Maruyama increment 19 . With step size \delta and Wiener increments {\Delta^{*}_{m}}W_{j}(t)=W_{j}(t)-W_{j}(m\delta) , the update rule of the Euclidean Milstein scheme for eq. 5 reads \displaystyle\widehat{\mathbf{X}}(t)=\widehat{\mathbf{X}}_{m}+\mathcal{B}_{I}(\widehat{\mathbf{X}}_{m}){\Delta^{*}_{m}}t+{\frac{1}{2}}\mathsf{\Sigma}_{N}(\widehat{\mathbf{X}}_{m}) \displaystyle+\sum_{j=1}^{d}\mathcal{B}_{j}(\widehat{\mathbf{X}}_{m}){\Delta^{*}_{m}}W_{j}(t)+\sum_{j,j^{\prime}=1}^{d}\Bigl(\nabla_{\mathcal{B}_{j}}\bigl(\mathcal{B}_{j^{\prime}}(\widehat{\mathbf{X}}_{m})\bigr)\Bigr){\tilde{I}_{j,j^{\prime}}^{{m^{*}}}}(t),\quad m\delta\leq t\leq(m+1)\delta, where \tilde{I}_{jj^{\prime}}^{m}(t) is a proper approximate of the the double Itô integrals {\tilde{I}_{j,j^{\prime}}^{{m^{*}}}}(t) . Although the Euclidean Milstein scheme preserves the SCR 1 when applied to Lie SDEs, two ingredients make the algorithm violate the geometric constraint. First, the pinning drift \mathsf{\Sigma}_{N}(\widehat{\mathbf{X}}_{m}) acts in the normal space. Second, the Milstein increment \nabla_{\mathcal{B}_{j}}\bigl(\mathcal{B}_{j^{\prime}}(\widehat{\mathbf{X}}_{m})\bigr) contains a second-fundamental-form component S^{G}(\mathcal{B}_{j},\mathcal{B}_{j^{\prime}}) that is also normal. Consequently, the normal contributions push the numerical solution away from the manifold, making the iterates leave the Lie group on short time scales. 3.3.2 Magnus-based Integrators: Geometric without Strong Order A widely used strategy for preserving group structure is to use the Magnus expansion that pulls the SDE back to the Lie algebra. Writing the state as X(t)=X_{0}\exp\bigl(\Omega(t)\bigr) with \Omega(t)\in\mathfrak{g} and \exp is the matrix exponential, the SDE eq. 5 is equivalent to the \mathfrak{g} -valued SDE \mathrm{d}\Omega=A(\Omega)\mathrm{d}t+\sum_{j=1}^{d}\Gamma_{j}(\Omega)\mathrm{d}W_{j},\qquad\Gamma_{j}=\operatorname{dexp}^{-1}_{-\Omega}(\mathcal{B}_{j}). Here, A(\Omega) is a drifting matrix that depends on the drift directions \mathcal{B}_{I} and \mathcal{B}_{j} . The operator \operatorname{dexp}_{-\Omega}^{-1} denotes the inverse differential of the exponential map \displaystyle\operatorname{dexp}_{-\Omega}^{-1}(\mathcal{B}_{j})=\sum_{k=0}^{\infty}\frac{\beta_{k}}{k!}\bigl(\operatorname{ad}_{\Omega}\bigr)^{k}(\mathcal{B}_{j})\qquad\operatorname{ad}_{\Omega}(\mathcal{B}_{j}):=[\Omega,\mathcal{B}_{j}], (8) with \beta_{k} the Bernoulli numbers. In practice one often approximates the \mathfrak{g} -valued SDE by truncating the infinite series of \Gamma_{j} . Such a truncation, however, is incompatible with the 3/2 -order Itô-Taylor expansion, as the full infinite series \nabla_{\Gamma_{j}}\bigl(\Gamma_{j^{\prime}}(\Omega)\bigr) appears simultaneously inside the differentiation operator and in the term being differentiated, so finite truncation may undermines the accuracy of the scheme. Consequently, one must keep the entire series when implementing the Milstein method, which is generally intractable. Taken together, these two examples reveal the core challenge in constructing a geometry-preserving Milstein scheme over Lie groups. To achieve SCR 1 , one must retain all 3/2 -order Itô–Taylor contributions, yet to remain on the Lie group these contributions must be decomposed into tangent and normal components and the latter must be treated properly. The challenge makes the design of a geometry-preserving Milstein-type method on \mathrm{SO}(n) a nontrivial problem. 4 TaSP-CM Scheme on SO(n) To overcome the challenge, we propose a geometric-preserving Milstein method on \mathrm{SO}(n) through the tangent‑space parametrization (TaSP) framework. In this section, we first introduce the TaSP methodology and then propose our TaSP-CM scheme. 4.1 Tangent Space Parametrization on SO(n) For \mathbf{R}_{0}\in\mathrm{SO}(n) , the TaSP framework represents any local solution of eq. 6 as \displaystyle\mathbf{R}(t)=\mathbf{R}_{0}+\mathbf{R}_{0}\mathcal{Z}(t)+\mathbf{R}_{0}\mathsf{C}\bigl(\mathcal{Z}(t)\bigr). (9) In this parametrization, \mathcal{Z}(t)\in\mathfrak{so}(n) is a stochastic tangent displacement to be determined that evolves in the Lie algebra. The sum \mathbf{R}_{0}+\mathbf{R}_{0}\mathcal{Z}(t) therefore gives a first‑order approximation to the true trajectory \mathbf{R}(t) . However, this linear term generally drifts off the manifold. To maintain the geometric constraint \mathbf{R}(t)^{\top}\mathbf{R}(t)=I , a normal adjustment \mathbf{R}_{0}\mathsf{C}\bigl(\mathcal{Z}(t)\bigr)\in N_{\mathbf{R}}\mathrm{SO}(n) that completely determined by \mathcal{Z}(t) is introduced to pull \mathbf{R}(t) back onto \mathrm{SO}(n) . Consequently, once the dependence \mathsf{C}(\mathcal{Z}) is known and \mathcal{Z}(t) is approximated with sufficient accuracy, we obtain a reliable approximation \mathbf{R}(t) whose trajectory preserves the geometry. Fortunately, the results in 32 give both an explicit formula for the adjustment term \mathsf{C}(\mathcal{Z}) and a stochastic dynamic of the tangent displacement \mathcal{Z}(t) . We summarize these facts in the following lemmas. Lemma 1 ( 32 ) . Let \mathbf{R}_{0}\in\mathrm{SO}(n) and \mathcal{Z}\in\mathfrak{so}(n) . If the matrix I-\mathcal{Z}^{\top}\mathcal{Z} is positive definite, then the symmetric adjustment \mathsf{C}\in\mathfrak{so}(n)^{\perp} that guarantees eq. 9 is given by \mathsf{C}(\mathcal{Z})=\sqrt{I-\mathcal{Z}^{\top}\mathcal{Z}}-I . Thw term \sqrt{A} denotes the unique positive‑definite square root of the positive‑definite matrix A . Based on the adjustment \mathsf{C}(\mathcal{Z}) , the stochastic tangent displacement \mathcal{Z}(t) associated with the local solution \mathbf{R}(t) of the SDE eq. 6 satisfies the following Euclidean Itô SDE \displaystyle d\mathcal{Z}=\mathcal{B}_{I}\bigl(\mathbf{R}\bigr)dt+\sum_{j=1}^{d}\mathcal{B}_{j}\bigl(\mathbf{R}\bigr)dW_{j}, (10) on the linear space \mathfrak{so}(n) . 4.2 Algorithm Design Building on lemma 1 , we propose our TaSP-CM scheme as follows. Let the step size \delta and Wiener increment {\Delta^{*}_{m}}W_{j}(t)=W_{j}\bigl(t\bigr)-W_{j}(m\delta) . The TaSP-CM scheme first computes a corrected Milstein increment in the lie algebra \mathfrak{so}(n) for m\delta\leq t\leq(m+1)\delta , \displaystyle\widehat{\mathcal{Z}}(t)=\mathcal{B}_{I}(\widehat{\mathbf{R}}_{m}){\Delta^{*}_{m}}t+\sum_{j=1}^{d}\mathcal{B}_{j}(\widehat{\mathbf{R}}_{m}){\Delta^{*}_{m}}W_{j}(t)+\sum_{j,j^{\prime}=1}^{d}\mathcal{D}^{O}_{\mathcal{B}_{j}}\bigl(\mathcal{B}_{j^{\prime}}(\widehat{\mathbf{R}}_{m})\bigr){I_{j,j^{\prime}}^{{m^{*}}}}(t). Here, we replace the classical Euclidean derivative in Milstein term, \nabla_{\mathcal{B}_{j}}\bigl(\mathcal{B}_{j^{\prime}}(\widehat{\mathbf{R}}_{m})\bigr) , by the intrinsic CovD \mathcal{D}^{O}_{\mathcal{B}_{j}}\bigl(\mathcal{B}_{j^{\prime}}(\widehat{\mathbf{R}}_{m})\bigr) for two reasons. First, the Euclidean derivative \nabla_{\mathcal{B}_{j}}\bigl(\mathcal{B}_{j^{\prime}}(\widehat{\mathbf{R}}_{m})\bigr) introduces a normal component in \mathfrak{so}(n)^{\perp} that pushes the update out of the Lie algebra \mathfrak{so}(n) . Second, the CovD includes the Lie-bracket correction [\mathcal{B}_{j},\mathcal{B}_{j^{\prime}}] , which captures the non-commutativity of the group and therefore improves the accuracy of the scheme. Next we update the trajectory \mathbf{R}(t):[m\delta,(m+1)\delta]\to\mathrm{SO}(n) with the correction term \mathsf{C}(\mathcal{Z}) , i.e., \displaystyle\widehat{\mathbf{R}}(t)=\widehat{\mathbf{R}}_{m}+\mathbf{R}_{m}\widehat{\mathcal{Z}}(t)+\widehat{\mathbf{R}}_{m}\mathsf{C}(\widehat{\mathcal{Z}}(t))=\widehat{\mathbf{R}}_{m}(\widehat{\mathcal{Z}}(t)+\sqrt{I-\widehat{\mathcal{Z}}^{\top}(t)\widehat{\mathcal{Z}}(t)}). Finally, connecting the piecewise trajectories yields a geometry‑preserving path of the SDE eq. 6 . We summarize the TaSP-CM scheme as in algorithm 1 . Algorithm 1 TaSP-CM Scheme on \mathrm{SO}(n) 1: Input: Time step size \delta , final time T , initial state \mathbf{R}_{0}\in\mathrm{SO}(n) . 2: Divide the interval [0,T] into M sub-intervals with length \delta . 3: for m=0,\dots,M do 4: Compute {\widehat{\mathcal{B}}_{I,m}}=\mathcal{B}_{I}(\widehat{\mathbf{R}}_{m}),{\widehat{\mathcal{B}}_{j,m}}=\mathcal{B}_{j}(\widehat{\mathbf{R}}_{m}) for all j\in[d] ; 5: Compute {\widehat{\mathcal{D}}_{j,j^{\prime}}^{m}}=\mathcal{D}^{O}_{\mathcal{B}_{j}}\bigl(\mathcal{B}_{j^{\prime}}(\widehat{\mathbf{R}}_{m})\bigr) for all j,j^{\prime}\in[d] ; 6: Sample the path {\Delta^{*}_{m}}W_{j}(t)\sim\mathcal{N}(0,{\Delta^{*}_{m}}t) for all j\in[d] ; 7: Approximate the double Itô integral {\tilde{I}_{j,j^{\prime}}^{{m^{*}}}}(t)\approx{I_{j,j^{\prime}}^{{m^{*}}}}(t) for all j,j\in[d] ; 8: Generate \mathcal{Z}(t) for m\delta0 such that \|\mathcal{B}_{I}(\mathbf{R})\|_{F}\leq C_{0},\quad\|\nabla\mathcal{B}_{I}(\mathbf{R})\|_{F}\leq C_{1}\quad\text{for all }\mathbf{R}\in\mathrm{SO}(n). Assumption 2 . For each diffusion vector field \mathcal{B}_{j}(\mathbf{R}),j\in[d] , we assume twice‐continuous differentiability with uniformly bounded zeroth-, first-, and second-order derivatives, i.e., there exist constants C_{0},C_{1},C_{2}>0 such that \|\mathcal{B}_{j}(\mathbf{R})\|_{F}\leq C^{\prime}_{0},\quad\|\nabla\mathcal{B}_{j}(\mathbf{R})\|_{F}\leq C^{\prime}_{1},\quad\|\nabla^{2}\mathcal{B}_{j}(\mathbf{R})\|_{F}\leq C^{\prime}_{2}\quad\text{for all }\mathbf{R}\in\mathrm{SO}(n). 2 implies that the Euclidean derivative \nabla_{\mathbf{R}\mathcal{B}_{j}}\bigl(\mathbf{R}\mathcal{B}_{j^{\prime}}(\mathbf{R})\bigr) and the CovD \mathcal{D}^{O}_{\mathcal{B}_{j}}\bigl(\mathcal{B}_{j^{\prime}}(\mathbf{R})\bigr) has uniformly bounded zeroth- and first-order derivative, by the bounds C^{\prime}_{1} and C^{\prime}_{2} , respectively. 5.1 Convergence Analysis with Commutative Noise We extend the classical commutative-noise assumption on the diffusion fields \mathcal{B}_{j} from the Euclidean setting to \mathrm{SO}(n) . Assumption 3 . The SDE eq. 6 has commutative noise, i.e., \displaystyle\mathcal{D}^{O}_{\mathcal{B}_{j}}\bigl(\mathcal{B}_{j^{\prime}}(\mathbf{R})\bigr)=\mathcal{D}^{O}_{\mathcal{B}_{j^{\prime}}}\bigl(\mathcal{B}_{j}(\mathbf{R})\bigr),\quad\mathbf{R}\in\mathrm{SO}(n),\quad\forall j,j\in[d]. Under 3 , the double Itô integral satisfies 9 , \displaystyle{I_{j,j^{\prime}}^{{m^{*}}}}(t)+{I_{j^{\prime},j}^{{m^{*}}}}(t)={\Delta^{*}_{m}}W_{j}(t){\Delta^{*}_{m}}W_{j^{\prime}}(t)-\eta_{j,j^{\prime}}{\Delta^{*}_{m}}t, where the \eta_{j,j^{\prime}} is the Kronecker symbol \displaystyle\eta_{j,j^{\prime}}=\begin{cases}1,\quad j=j^{\prime},\\ 0,\quad j\neq j^{\prime}.\end{cases} Therefore, the TaSP–CM scheme can be simplified without the need for explicitly estimating the double Itô integral, i.e., \displaystyle\widehat{\mathcal{Z}}(t)= \displaystyle\mathcal{B}_{I}(\widehat{\mathbf{R}}_{m}){\Delta^{*}_{m}}t+\sum_{j=1}^{d}\mathcal{B}_{j}(\widehat{\mathbf{R}}_{m}){\Delta^{*}_{m}}W_{j}(t) \displaystyle\quad+{\frac{1}{2}}\sum_{j\neq j^{\prime}}{\widehat{\mathcal{D}}_{j,j^{\prime}}^{m}}{\Delta^{*}_{m}}W_{j}(t){\Delta^{*}_{m}}W_{j^{\prime}}(t)+{\frac{1}{2}}\sum_{j=1}^{n}{\widehat{\mathcal{D}}_{j,j}^{m}}\left({\Delta^{*}_{m}}W_{j}^{2}(t)-{\Delta^{*}_{m}}t\right), We now handle the convergence analysis of the TaSP-CM scheme in the commutative noise setting. First, we introduce an frozen‑field Milstein series \displaystyle\mathbf{R}_{\delta}(t)= \displaystyle\mathbf{R}_{0}+\sum_{m=1}^{{\lfloor\frac{t}{\delta}\rfloor}}{\widehat{\mathbf{R}}_{m}}{\widehat{\mathcal{B}}_{I,m}}{\Delta^{*}_{m}}t+\sum_{m=1}^{{\lfloor\frac{t}{\delta}\rfloor}}{\widehat{\mathbf{R}}_{m}}\sum_{j=1}^{d}\mathsf{S}({\widehat{\mathcal{B}}_{j,m}},{\widehat{\mathcal{B}}_{j,m}}){\Delta^{*}_{m}}t (11) \displaystyle+\sum_{m=1}^{{\lfloor\frac{t}{\delta}\rfloor}}{\widehat{\mathbf{R}}_{m}}\sum_{j=1}^{d}{\widehat{\mathcal{B}}_{j,m}}{\Delta^{*}_{m}}W_{j}(t)+\sum_{m=1}^{{\lfloor\frac{t}{\delta}\rfloor}}{\widehat{\mathbf{R}}_{m}}\sum_{j,j^{\prime}=1}^{d}{\widehat{\nabla}_{j,j^{\prime}}^{m}}{I_{j,j^{\prime}}^{{m^{*}}}} \displaystyle{\widehat{\nabla}_{j,j^{\prime}}^{m}}= \displaystyle\nabla_{{\widehat{\mathbf{R}}_{m}}\mathcal{B}_{j}}\bigl({\widehat{\mathbf{R}}_{m}}\mathcal{B}_{j^{\prime}}(\widehat{\mathbf{R}}_{m})\bigr). The frozen‑field Milstein series \widehat{\mathbf{R}}_{\delta}(t) is actually the Euclidean Milstein recursion, where at each time step m the drift \widehat{\mathcal{B}}_{I} and the diffusion fields \widehat{\mathcal{B}}_{j} are evaluated at the TaSP-CM state \widehat{\mathbf{R}}(m\delta) . In this cases, the error of the TaSP-CM scheme is decomposed as \displaystyle\mathbb{E}\big[\sup_{0\leq t\leq T}\|\mathbf{R}(t)-\widehat{\mathbf{R}}(t)\|^{2}_{F}\big] \displaystyle\leq \displaystyle 2\mathbb{E}\big[\sup_{0\leq t\leq T}\|\widehat{\mathbf{R}}(t)-\mathbf{R}_{\delta}(t)\|_{F}^{2}\big]+2\mathbb{E}\big[\sup_{0\leq t\leq T}\|\mathbf{R}_{\delta}(t)-\mathbf{R}(t)\|^{2}_{F}\big] Second, We analyze the two terms on the right‑hand side separately. Because the drift and diffusion fields are evaluated at the same state in both the TaSP and the frozen‑field Milstein series \mathbf{R}_{\delta} , and we notice that \POtg({\widehat{\nabla}_{j,j^{\prime}}^{m}}(t))={\widehat{\mathcal{D}}_{j,j^{\prime}}^{m}}(t) , the trajectories \widehat{\mathbf{R}}(t) and \widehat{\mathbf{R}}_{\delta}(t) have identical tangent increment. Consequently, the error between \widehat{\mathbf{R}}(t) and \widehat{\mathbf{R}}_{\delta}(t) solely depends on their normal increment. The normal increment of \widehat{\mathbf{R}}(t) is \sum_{m=1}^{{\lfloor\frac{t}{\delta}\rfloor}}\widehat{\mathbf{R}}_{m}\mathsf{C}_{m} , whereas that of \widehat{\mathbf{R}}_{\delta}(t) comprises sum of second‑order terms S({\widehat{\mathcal{B}}_{j,m}},{\widehat{\mathcal{B}}_{j^{\prime},m}}) . Concretely, we have \displaystyle\widehat{\mathbf{R}}(t)-\mathbf{R}_{\delta}(t)= \displaystyle\sum_{m=1}^{{\lfloor\frac{t}{\delta}\rfloor}}\widehat{\mathbf{R}}_{m}\Bigl(\mathsf{C}_{m}-{\frac{1}{2}}\sum_{j=1}^{d}\mathsf{S}(\mathcal{Z}_{j},\mathcal{Z}_{j})\Bigr)+\text{higher-order terms} From 32 we have the estimate \displaystyle\|\mathsf{C}(\mathcal{Z})-{\frac{1}{2}}\mathsf{S}(\mathcal{Z},\mathcal{Z})\bigr\|_{F}\leq{\frac{1}{2}}\|\mathcal{Z}\|_{F}^{4}, which implies that there is an \|\tilde{Z}\|_{F}^{8}=\mathcal{O}(\delta^{4}) squared error between \widehat{\mathbf{R}}(t) and \widehat{\mathbf{R}}_{\delta}(t) in local time step [m\delta,(m+1)\delta] . Summing the error over m yields an \mathcal{O}(\delta^{2}) mean‑square error, as stated in the following lemma. Lemma 2 . Under 1 , 2 and 3 , there holds \displaystyle\mathbf{E}\big[\sup_{0\leq t\leq T}\|\widehat{\mathbf{R}}(t)-\mathbf{R}_{\delta}(t)\|_{F}^{2}\big]\leq\mathcal{O}(\delta^{2}). The proof of lemma 2 is left in the appendix B . Lemma 2 reveals that each iterate of the TaSP–CM scheme can be viewed as a classical Euclidean Milstein step plus a fourth‑order normal‑space adjustment. This “Euclidean Milstein+geometric patch” perspective is the key mechanism that allows us to extend the geometric-preserving Milstein method over \mathrm{SO}(n) . Then we turn to the term \mathbf{E}\big[\sup_{0\leq t\leq T}\|\mathbf{R}_{\delta}(t)-\mathbf{R}(t)\|^{2}_{F}\big] . By truncating the Itô-Taylor expansion of the real solution \mathbf{R}(t) at order 3/2 and applying the Grönwall inequality, we obtain the following lemma. Lemma 3 . Under 1 , 2 and 3 , there holds \displaystyle\mathbb{E}\big[\sup_{0\leq t\leq T}\|\widehat{\mathbf{R}}_{\delta}(t)-\mathbf{R}(t)\|^{2}_{F}\big]=\mathcal{O}(\delta^{2}). The proof of lemma 2 is left in the appendix C . Finally, we combine lemmas 2 and 3 and obtain the following SCR. Theorem 1 . Suppose 1 , 2 and 3 hold, and the double Itô integral estimator is given as \displaystyle{\tilde{I}_{j,j^{\prime}}^{{m^{*}}}}(t)={\frac{1}{2}}{\Delta^{*}_{m}}W_{j}(t)\cdot{\Delta^{*}_{m}}W_{j^{\prime}}(t)-\eta_{j,j^{\prime}}{\Delta^{*}_{m}}t. The TaSP-CM scheme applied to ( 6 ) attains SCR 1 , i.e., with time step \delta , the strong error satisfies \displaystyle\mathbb{E}\big[\sup_{0\leq t\leq T}\|\mathbf{R}(t)-\widehat{\mathbf{R}}(t)\|^{2}_{F}\big]^{{\frac{1}{2}}}=\mathcal{O}(\delta). Proof. It follows directly by lemmas 2 and 3 . ∎ Theorem 1 introduces a Milstein scheme that attains a SCR of 1 while exactly preserving orthogonality on \mathrm{SO}(n) in the commutative-noise setting. The result bridges the gap between the classical Euclidean Milstein method and previous computationally tractable GPNS, whose SCR were 1/2 . The TaSP-CM scheme therefore offers a practical tool for problems where both geometric exactness and high numerical accuracy are essential. 5.2 Convergence Analysis with Non-Commutative Noise Unlike SDEs in Euclidean spaces, where typical noise structures (e.g., constant or diagonal noise) are commutative 9 , most SDEs on \mathrm{SO}(n) involve non-commutative noise, due to the non-commutative structure of the Lie algebra. In particular, the canonical Brownian motion on \mathrm{SO}(n) is non-commutative. Example 1 (Brownian motion on \mathrm{SO}(n) ) . Let \{\mathcal{E}_{jk}\}_{1\leq j0 , truncation level h\in\mathbb{N} , indices j,j^{\prime}\in\{1,\dots,d\} , Wiener increment {\Delta^{*}_{m}}W_{j}(t),{\Delta^{*}_{m}}W_{j^{\prime}}(t) 2: For each r=1,\dots,h , draw a_{j,r},\ b_{j,r},a_{j^{\prime},r},\ b_{j^{\prime},r}\sim\mathcal{N}(0,1) i.i.d.; 3: Draw i.i.d. \gamma_{j,h},\gamma_{j^{\prime},h}\sim\mathcal{N}(0,1) ; 4: Compute \rho_{h}=\frac{1}{2\pi^{2}}\left(\frac{\pi^{2}}{6}-\sum_{r=1}^{h}\frac{1}{r^{2}}\right) ; 5: Compute \displaystyle R_{j,j^{\prime}}^{h} \displaystyle=\sqrt{\frac{\rho_{h}}{2\pi^{2}}}\Big({\Delta^{*}_{m}}W_{j}\gamma_{j^{\prime},h}-\gamma_{j,h}{\Delta^{*}_{m}}W_{j^{\prime}}\Big), \displaystyle\tilde{b}_{j,r} \displaystyle=b_{j,r}-\sqrt{\tfrac{2}{{\Delta^{*}_{m}}t}}{\Delta^{*}_{m}}W_{j},\qquad\tilde{b}_{j^{\prime},r}=b_{j^{\prime},r}-\sqrt{\tfrac{2}{{\Delta^{*}_{m}}t}}{\Delta^{*}_{m}}W_{j^{\prime}}, \displaystyle A^{p,h}_{j,j^{\prime}} \displaystyle=\frac{1}{2\pi}\sum_{r=1}^{h}\frac{1}{r}\Big(a_{j,r}\tilde{b}_{j^{\prime},r}-a_{j^{\prime},r}\tilde{b}_{j,r}\Big); 6: Return: K_{j,j^{\prime}}^{h}=\dfrac{1}{2}{\Delta^{*}_{m}}W_{j}(t)\cdot{\Delta^{*}_{m}}W_{j^{\prime}}(t)-\dfrac{1}{2}\eta_{j,j^{\prime}}{\Delta^{*}_{m}}t+R_{j,j^{\prime}}^{h}\sqrt{{\Delta^{*}_{m}}t}+A^{p}_{j_{1},j_{2}}{\Delta^{*}_{m}}t . Lemma 4 ( 11 ) . Let h\in\mathbb{N} , {\tilde{I}_{j,j^{\prime}}^{{m^{*}}}}=K_{j,j^{\prime}}^{h} as implemented by algorithm 2 . The approximation error satisfies, \displaystyle\Delta{I_{j,j^{\prime}}^{{m^{*}}}}:={I_{j,j^{\prime}}^{{m^{*}}}}-{\tilde{I}_{j,j^{\prime}}^{{m^{*}}}}=\frac{1}{2\pi}\sum_{r=h+1}^{\infty}\frac{1}{r}\Big(a_{j,r}b_{j^{\prime},r}-a_{j,r}b_{j^{\prime},r}\Big){\Delta^{*}_{m}}t,\quad j\neq j^{\prime}\in[d], with \displaystyle\mathbb{E}[\Delta{I_{j,j^{\prime}}^{{m^{*}}}}]=0 and \displaystyle\mathbb{E}[(\Delta{I_{j,j^{\prime}}^{{m^{*}}}})^{2}]=\frac{\delta^{2}}{2\pi^{2}h^{2}} . With the approximation in hand, we again establish the SCR 1 result on non-commutative noise setting for the TaSP-CM schemes. Theorem 2 (Strong convergence under non-commutative noise) . Assume that 1 and 2 hold and let \delta denote the time-step size. Choose the double Itô integral approximation {\tilde{I}_{j,j^{\prime}}^{{m^{*}}}}=K_{j,j^{\prime}}^{h} with h\geq\delta^{-{\frac{1}{2}}} as implemented in algorithm 2 . Then the TaSP-CM scheme applied to ( 6 ) achieves strong order 1 , i.e., \displaystyle\mathbb{E}\bigl[\sup_{0\leq t\leq T}\|\mathbf{R}(t)-\widehat{\mathbf{R}}(t)\|_{F}^{2}\bigr]^{{\frac{1}{2}}}=\mathcal{O}(\delta). The proof of theorem 2 is left in appendix D . Theorem 2 shows that the TaSP–CM scheme achieves SCR 1 under the non-commutative noise. The requirement h\geq\delta^{-{\frac{1}{2}}} , which is exactly the same condition used in the Euclidean Milstein method 19 , guarantees that the mean-square error of the double Itô integral approximation remains \mathcal{O}(\delta^{2}) . Consequently, the scheme raises the available SCR for GPNS scheme on \mathrm{SO}(n) from 1/2 to 1 in the non-commutative setting. In the commutative case, the double Itô integral reduces to a simple product of Wiener increments and can be computed exactly without any additional sampling. In contrast, the non-commutative setting requires a sampling cost of \mathcal{O}(Mhd(d-1)) independent Gaussian variables, where M=T/\delta is the number of time steps. Since M=\mathcal{O}(\delta^{-1}) and h=\mathcal{O}(\delta^{-1/2}) , the overall computational cost scales as \mathcal{O}(\delta^{-3/2}) Gaussian calls. Therefore, the TaSP–CM scheme attains a Gaussian-call complexity of \mathcal{O}(\delta^{-3/2}) , matching the Euclidean Milstein method, while improving over the geometric Euler–Maruyama method, which requires \mathcal{O}(\delta^{-2}) Gaussian calls to achieve the same accuracy. 6 TaSP-CM over SE(n) In this section, we extend the TaSP–CM scheme from the special orthogonal group \mathrm{SO}(n) to the special Euclidean group \mathrm{SE}(n)=\mathrm{SO}(n)\ltimes\mathbb{R}^{n} . Leveraging the semidirect-product structure, theorem 3 establishes the TaSP framework for \mathrm{SE}(n) . Algorithm 3 TaSP-CM Scheme on \mathrm{SE}(n) 1: Time step size \delta , final time T , initial state \mathbf{E}_{0}\in\mathrm{SO}(n) . 2: Divide the interval [0,T] into M sub-intervals with length \delta . 3: for m=0,\dots,M do 4: Compute ({\widehat{\mathcal{B}}^{\mathbf{R}}_{I,m}},{\widehat{\mathcal{B}}^{\mathbf{p}}_{I,m}})=\mathcal{B}_{I}(\widehat{\mathbf{E}}_{m}) for all j\in[d] ; 5: Compute ({\widehat{\mathcal{B}}^{\mathbf{R}}_{j,m}},{\widehat{\mathcal{B}}^{\mathbf{p}}_{j,m}})=\mathcal{B}_{j}(\widehat{\mathbf{E}}_{m}) for all j\in[d] ; 6: Compute {\widehat{\mathcal{D}}_{j,j^{\prime}}^{\mathbf{R},m}}=\nabla_{\mathbf{E}\mathcal{V}_{j}}{{\widehat{\mathcal{B}}^{\mathbf{R}}_{j^{\prime},m}}}+{\tfrac{1}{2}}[{\widehat{\mathcal{B}}^{\mathbf{R}}_{j,m}},{\widehat{\mathcal{B}}^{\mathbf{R}}_{j^{\prime},m}}] for all j,j^{\prime}\in[d] ; 7: Compute {\widehat{\mathcal{D}}_{j,j^{\prime}}^{\mathbf{p},m}}=\nabla_{\mathbf{E}\mathcal{V}_{j}}{{\widehat{\mathcal{B}}^{\mathbf{p}}_{j^{\prime},m}}}+{\tfrac{1}{2}}{\widehat{\mathcal{B}}^{\mathbf{R}}_{j,m}}{\widehat{\mathcal{B}}^{\mathbf{p}}_{j^{\prime},m}} for all j,j^{\prime}\in[d] ; 8: Sample the path {\Delta^{*}_{m}}W_{j}(t)\sim\mathcal{N}(0,{\Delta^{*}_{m}}t) for all j\in[d] ; 9: Approximate the double Itô integral {\tilde{I}_{j,j^{\prime}}^{{m^{*}}}}(t)\approx{I_{j,j^{\prime}}^{{m^{*}}}}(t) for all j,j\in[d] ; 10: Generate \big(\widehat{\mathcal{Z}}(t),\widehat{v}(t)\big) for m\delta0 , \mathbb{E}\left[\sup_{0\leq t\leq T}\|M_{t}\|^{2}\right]\leq 4\mathbb{E}\bigl[\|M_{T}\|^{2}\bigr]. Lemma 7 (Grönwall inequality 7 ) . Let T>0 and let u:[0,T]\to[0,\infty) be an absolutely continuous function satisfying u(t)\leq\alpha(t)+\beta\int_{0}^{t}u(s)ds,\qquad 0\leq t\leq T, where \alpha:[0,T]\to[0,\infty) is non-decreasing and \beta\geq 0 is a constant. Then u(t)\leq\alpha(t)e^{\beta t},\qquad 0\leq t\leq T. Lemma 8 (Moment identities for centered Gaussians) . Let \Phi\sim\mathcal{N}(0,\sigma) be a one–dimensional centered Gaussian random variable with variance \sigma , then following identities hold. 1. For every integer n\geq 1 , \mathbb{E}[\Phi^{2n}]=(2n-1)!!\sigma^{n}, where (2n-1)!!=(2n-1)(2n-3)\cdots 3\cdot 1 . 2. For every integer n\geq 1 , there exists a constant C_{n} depending only on n such that \bigl\|\mathbb{E}[(\Phi^{2}-\sigma)^{n}]\bigr\|=\sum_{k}\begin{pmatrix}n\\ k\end{pmatrix}\mathbb{E}[\Phi^{2k}]\sigma^{n-k}\leq C_{n}\sigma^{n}. Lemma 9 (High-order sum inequality) . Let \{u_{k}\}_{k=1}^{d}\subset\mathbb{R}^{n} . Then for any even integer p\geq 2 , there holds that \Big\|\sum_{k=1}^{d}u_{k}\Big\|^{p}\leq d^{p-1}\sum_{k=1}^{d}\|u_{k}\|^{p}. Lemma 10 (Normal Residual Approximation 32 ) . Let \mathcal{Z}\in\mathfrak{so}(n) be such that I-\mathcal{Z}^{\top}\mathcal{Z} is positive definite, and let \mathsf{C}(\mathcal{Z}) denote the normal adjustment defined in Lemma 1 . If M=\mathcal{O}(\delta^{-1}) , then \|\mathsf{C}(\mathcal{Z})-\mathsf{S}^{O}(\mathcal{Z},\mathcal{Z})\|\leq{\frac{1}{2}}\|\mathcal{Z}\|^{4}. Lemma 11 (Moment bound for a martingale) . Let \{E_{k}\}_{k=1}^{M}\subset\mathbb{R}^{d} be random vectors and define the partial sums H_{m}:=\sum_{k=1}^{m}E_{k},0\leq m\leq M, where M=\mathcal{O}(\delta^{-1}) for some time–step parameter \delta>0 . If the process \{H_{m}\} is a martingale w.r.t the filtration \{\mathcal{F}_{t_{m}}\} and \mathbb{E}[\|E_{m}\|^{2}]=\mathcal{O}(\delta^{3}) for every m\leq M , then \mathbb{E}\Bigl[\sup_{0\leq m\leq M}\|S_{m}\|^{2}\Bigr]=\mathcal{O}(\delta^{2}). Proof. If \{H_{m}\} is a martingale with respect to \{\mathcal{F}_{t_{m}}\} and \mathbb{E}[\|E_{m}\|^{2}]=\mathcal{O}(\delta^{3}) , then Doob’s maximal inequality ( lemma 6 ) gives \mathbb{E}\Bigl[\sup_{0\leq m\leq M}\|H_{m}\|^{2}\Bigr]\leq 4\mathbb{E}\bigl[\|H_{M}\|^{2}\bigr]. Martingale orthogonality implies \mathbb{E}\bigl[\|H_{M}\|^{2}\bigr]=\sum_{k=1}^{M}\mathbb{E}[\|E_{k}\|^{2}]=M\mathcal{O}(\delta^{3}), because M=\mathcal{O}(\delta^{-1}) . Hence \mathbb{E}[\sup_{m}\|H_{m}\|^{2}]=\mathcal{O}(\delta^{2}) . ∎ Lemma 12 (Moment bound for partial‐sum) . Let \{E_{k}\}_{k=1}^{M}\subset\mathbb{R}^{d} be random vectors where M=\mathcal{O}(\delta^{-1}) for some time–step parameter \delta>0 . If \mathbb{E}[\|E_{m}\|^{2}]=\mathcal{O}(\delta^{4}) for every m\leq M , then \mathbb{E}\Bigl[\sup_{0\leq m\leq M}\|S_{m}\|^{2}\Bigr]=\mathcal{O}(\delta^{2}). Proof. Assume that \mathbb{E}[\|E_{k}\|^{2}]=\mathcal{O}(\delta^{4}) for all k . By Cauchy–Schwarz, \|S_{m}\|^{2}=\Bigl\|\sum_{k=1}^{m}E_{k}\Bigr\|^{2}\leq m\sum_{k=1}^{m}\|E_{k}\|^{2}\leq M\sum_{k=1}^{M}\|E_{k}\|^{2}, and therefore \mathbb{E}\Bigl[\sup_{0\leq m\leq M}\|S_{m}\|^{2}\Bigr]\leq M\sum_{k=1}^{M}\mathbb{E}[\|E_{k}\|^{2}]=M^{2}\mathcal{O}(\delta^{4})=\mathcal{O}(\delta^{2}). In either case we obtain \mathbb{E}[\sup_{0\leq m\leq M}\|S_{m}\|^{2}]=\mathcal{O}(\delta^{2}) , which completes the proof. ∎ Appendix B Proof of Lemma 2 Proof. We put the whole proof into four steps. Step 1: Local expansion of the TaSP-CM series. We represent TaSP-CM solution \widehat{\mathbf{R}}(t) as an accumulated second-order Taylor expansion along the TaSP–CM iterates \{{\widehat{\mathbf{R}}_{m}}\} . For any t\leq T , denote m^{\prime}={\lfloor\frac{t}{\delta}\rfloor} , algorithm 1 allows us to write the second-order Taylor expansion of TaSP-CM solution \widehat{\mathbf{R}}(t) as \displaystyle\widehat{\mathbf{R}}(t)= \displaystyle{\widehat{\mathbf{R}}_{(m^{\prime})}}\sqrt{I-\widehat{\mathcal{Z}}_{(m^{\prime}+1)^{*}}^{\top}\widehat{\mathcal{Z}}_{(m^{\prime}+1)^{*}}}={\widehat{\mathbf{R}}_{(m^{\prime})}}+{\widehat{\mathbf{R}}_{(m^{\prime})}}\widehat{\mathcal{Z}}_{(m^{\prime}+1)^{*}}+{\frac{1}{2}}{\widehat{\mathbf{R}}_{(m^{\prime})}}\widehat{\mathcal{Z}}_{(m^{\prime}+1)^{*}}^{2}+\varepsilon_{m}^{(0)} \displaystyle= \displaystyle\widehat{\mathbf{R}}_{0}+\sum_{m=0}^{m^{\prime}}{\widehat{\mathbf{R}}_{m}}\widehat{\mathcal{Z}}_{{(m+1)^{*}}}+{\frac{1}{2}}\sum_{m=0}^{m^{\prime}}{\widehat{\mathbf{R}}_{m}}\widehat{\mathcal{Z}}_{{(m+1)^{*}}}^{2}+\sum_{m=0}^{m^{\prime}}\varepsilon_{m}^{(0)}, where \varepsilon_{m}^{(\mathsf{N})}={\widehat{\mathbf{R}}_{m}}\Big(\sqrt{I-\widehat{\mathcal{Z}}_{(m^{\prime}+1)^{*}}^{\top}\widehat{\mathcal{Z}}_{(m^{\prime}+1)^{*}}}-I-\widehat{\mathcal{Z}}_{{(m+1)^{*}}}-{\frac{1}{2}}\widehat{\mathcal{Z}}_{{(m+1)^{*}}}^{2}\Big) is the local remainder in the normal direction. Recalling the definition of \widehat{\mathcal{Z}}_{{m^{*}}} , we have \displaystyle\sum_{m=0}^{{\lfloor\frac{t}{\delta}\rfloor}}{\widehat{\mathbf{R}}_{m}}\widehat{\mathcal{Z}}_{{(m+1)^{*}}}=\sum_{m=0}^{{\lfloor\frac{t}{\delta}\rfloor}}{\widehat{\mathbf{R}}_{m}}{\widehat{\mathcal{B}}_{I,m}}{\Delta^{*}_{m}}t+\sum_{m=0}^{{\lfloor\frac{t}{\delta}\rfloor}}{\widehat{\mathbf{R}}_{m}}\sum_{j=1}^{d}{\widehat{\mathcal{B}}_{j,m}}({\Delta^{*}_{m}}W_{j}) \displaystyle+{\frac{1}{2}}\sum_{m=0}^{{\lfloor\frac{t}{\delta}\rfloor}}{\widehat{\mathbf{R}}_{m}}\sum_{j\neq j^{\prime}}{\widehat{\mathcal{D}}_{j,j^{\prime}}^{m}}({\Delta^{*}_{m}}W_{j}\cdot{\Delta^{*}_{m}}W_{j^{\prime}})+{\frac{1}{2}}\sum_{m=0}^{{\lfloor\frac{t}{\delta}\rfloor}}{\widehat{\mathbf{R}}_{m}}\sum_{j=1}^{d}{\widehat{\mathcal{D}}_{j,j}^{m}}\left(({\Delta^{*}_{m}}W_{j})^{2}-{\Delta^{*}_{m}}t\right). Under the commutative noise we have {\widehat{\mathcal{D}}_{j,j^{\prime}}^{m}}={\widehat{\mathcal{D}}_{j^{\prime},j}^{m}} and {\Delta^{*}_{m}}W_{j}\cdot{\Delta^{*}_{m}}W_{j^{\prime}}={I_{j,j^{\prime}}^{{m^{*}}}}+{I_{j^{\prime},j}^{{m^{*}}}} for j\neq j . Grouping terms gives \displaystyle\sum_{m=0}^{{\lfloor\frac{t}{\delta}\rfloor}} \displaystyle{\widehat{\mathbf{R}}_{m}}\widehat{\mathcal{Z}}_{{(m+1)^{*}}}=\sum_{m=0}^{{\lfloor\frac{t}{\delta}\rfloor}}{\widehat{\mathbf{R}}_{m}}{\widehat{\mathcal{B}}_{I,m}}{\Delta^{*}_{m}}t+\sum_{m=0}^{{\lfloor\frac{t}{\delta}\rfloor}}{\widehat{\mathbf{R}}_{m}}\sum_{j=1}^{d}{\widehat{\mathcal{B}}_{j,m}}({\Delta^{*}_{m}}W_{j}) \displaystyle+\sum_{m=0}^{{\lfloor\frac{t}{\delta}\rfloor}}{\widehat{\mathbf{R}}_{m}}\sum_{j\neq j^{\prime}}{\widehat{\mathcal{D}}_{j,j^{\prime}}^{m}}{I_{j,j^{\prime}}^{{m^{*}}}}+{\frac{1}{2}}\sum_{m=0}^{{\lfloor\frac{t}{\delta}\rfloor}}{\widehat{\mathbf{R}}_{m}}\sum_{j=1}^{d}{\widehat{\mathcal{D}}_{j,j}^{m}}\left(({\Delta^{*}_{m}}W_{j})^{2}-{\Delta^{*}_{m}}t\right). \displaystyle=\sum_{m=0}^{{\lfloor\frac{t}{\delta}\rfloor}}{\widehat{\mathbf{R}}_{m}}{\widehat{\mathcal{B}}_{I,m}}{\Delta^{*}_{m}}t+\sum_{m=0}^{{\lfloor\frac{t}{\delta}\rfloor}}{\widehat{\mathbf{R}}_{m}}\sum_{j=1}^{d}{\widehat{\mathcal{B}}_{j,m}}({\Delta^{*}_{m}}W_{j})+\sum_{m=0}^{{\lfloor\frac{t}{\delta}\rfloor}}{\widehat{\mathbf{R}}_{m}}\sum_{j,j^{\prime}=1}^{d}{\widehat{\mathcal{D}}_{j,j^{\prime}}^{m}}{I_{j,j^{\prime}}^{{m^{*}}}}. (17) Similarly, with the SFF \mathsf{S}_{j,j^{\prime}}^{m}=\mathsf{S}^{O}({\widehat{\mathcal{B}}_{j,m}},{\widehat{\mathcal{B}}_{j^{\prime},m}})={\frac{1}{2}}({\widehat{\mathcal{B}}_{j,m}}{\widehat{\mathcal{B}}_{j^{\prime},m}}+{\widehat{\mathcal{B}}_{j^{\prime},m}}{\widehat{\mathcal{B}}_{j,m}}) , we obtain \displaystyle\sum{\widehat{\mathbf{R}}_{m}}\widehat{\mathcal{Z}}_{{(m+1)^{*}}}^{2}= \displaystyle\sum_{m=0}^{{\lfloor\frac{t}{\delta}\rfloor}}{\widehat{\mathbf{R}}_{m}}\sum_{j\neq j^{\prime}}{\widehat{\mathcal{B}}_{j,m}}{\widehat{\mathcal{B}}_{j^{\prime},m}}({\Delta^{*}_{m}}W_{j}\cdot{\Delta^{*}_{m}}W_{j^{\prime}}) \displaystyle+\sum_{m=0}^{{\lfloor\frac{t}{\delta}\rfloor}}{\widehat{\mathbf{R}}_{m}}\sum_{j=1}^{d}({\widehat{\mathcal{B}}_{j,m}})^{2}({\Delta^{*}_{m}}W_{j})^{2}+\sum_{m=0}^{{\lfloor\frac{t}{\delta}\rfloor}}\varepsilon_{m} \displaystyle= \displaystyle\sum_{m=0}^{{\lfloor\frac{t}{\delta}\rfloor}}{\widehat{\mathbf{R}}_{m}}\sum_{j,j^{\prime}=1}^{d}\mathsf{S}_{j,j^{\prime}}^{m}{I_{j,j^{\prime}}^{{m^{*}}}}+\sum_{m=0}^{{\lfloor\frac{t}{\delta}\rfloor}}{\widehat{\mathbf{R}}_{m}}\sum_{j=1}^{d}\mathsf{S}_{j,j}^{m}({\Delta^{*}_{m}}t)^{2}+\sum_{m=0}^{{\lfloor\frac{t}{\delta}\rfloor}}\varepsilon_{m}, (18) where \varepsilon_{m}={\widehat{\mathbf{R}}_{m}}\Big(\widehat{\mathcal{Z}}_{{(m+1)^{*}}}^{2}-\sum_{j,j^{\prime}=1}^{d}\mathsf{S}_{j,j^{\prime}}^{m}{I_{j,j^{\prime}}^{{m^{*}}}}-\sum_{j=1}^{d}\mathsf{S}_{j,j}^{m}({\Delta^{*}_{m}}t)^{2}\Big) is the higher-order remainder. Combining appendix B and appendix B yields \displaystyle\widehat{\mathbf{R}}(t)=\sum_{m=0}^{{\lfloor\frac{t}{\delta}\rfloor}}{\widehat{\mathbf{R}}_{m}}{\widehat{\mathcal{B}}_{I,m}}{\Delta^{*}_{m}}t+\sum_{m=0}^{{\lfloor\frac{t}{\delta}\rfloor}}{\widehat{\mathbf{R}}_{m}}\sum_{j=1}^{d}{\widehat{\mathcal{B}}_{j,m}}({\Delta^{*}_{m}}W_{j}) \displaystyle+\sum_{m=0}^{{\lfloor\frac{t}{\delta}\rfloor}}{\widehat{\mathbf{R}}_{m}}\sum_{j,j^{\prime}=1}^{d}\left({\widehat{\mathcal{D}}_{j,j^{\prime}}^{m}}+\mathsf{S}_{j,j^{\prime}}^{m}\right){I_{j,j^{\prime}}^{{m^{*}}}}+\sum_{m=0}^{{\lfloor\frac{t}{\delta}\rfloor}}{\widehat{\mathbf{R}}_{m}}\sum_{j=1}^{d}({\widehat{\mathcal{B}}_{j,m}})^{2}{\Delta^{*}_{m}}t+\sum_{m=0}^{{\lfloor\frac{t}{\delta}\rfloor}}\varepsilon_{m}+\sum_{m=0}^{{\lfloor\frac{t}{\delta}\rfloor}}\varepsilon_{m}^{(\mathsf{N})}. Step 2: Comparing \widehat{\mathbf{R}}(t) with the Frozen Milstein series \mathbf{R}_{\delta}(t) . For any 00 such that \displaystyle\|{\mathbf{R}_{m}}{\mathcal{B}_{I,m}}-{\widehat{\mathbf{R}}_{m}}{\widehat{\mathcal{B}}_{I,m}}\|^{2}\leq C\|\mathbf{R}_{m}-\widehat{\mathbf{R}}_{m}\|^{2}\leq C\|\bar{\alpha}(t_{m})\|^{2}+C\|\bar{\zeta}(t_{m})\|^{2} Furthermore, we have \displaystyle\mathbb{E}\Bigl[\sup_{0\leq t\leq T}\big\|\sum_{m=0}^{{\lfloor\frac{t}{\delta}\rfloor}}A^{(1)}_{m}\big\|^{2}\Bigr]\leq C\sum_{m=0}^{{\lfloor\frac{t}{\delta}\rfloor}}(\mathbb{E}\big[\|\bar{\alpha}(t_{m})\|^{2}\big]{\Delta^{*}_{m}}t)+C\sum_{m=0}^{{\lfloor\frac{t}{\delta}\rfloor}}(\mathbb{E}\big[\|\bar{\zeta}(t_{m})\|^{2}\big]{\Delta^{*}_{m}}t) Since \bar{\alpha}(t) and \bar{\zeta}(t) are non-decreasing, we have \displaystyle\sum_{m=0}^{{\lfloor\frac{t}{\delta}\rfloor}}(\mathbb{E}\big[\|\bar{\alpha}(t_{m})\|^{2}\big]{\Delta^{*}_{m}}t)\leq T\mathbb{E}[\bar{\alpha}^{2}(T)],\quad\sum_{m=0}^{{\lfloor\frac{t}{\delta}\rfloor}}(\mathbb{E}\big[\|\bar{\zeta}(t_{m})\|^{2}\big]{\Delta^{*}_{m}}t)\leq\int_{0}^{t}\mathbb{E}[\bar{\zeta}^{2}(t^{\prime})]dt^{\prime}. Therefore, we have \displaystyle\mathbb{E}\Bigl[\sup_{0\leq t\leq T}\big\|\sum_{m=0}^{{\lfloor\frac{t}{\delta}\rfloor}}A^{(1)}_{m}\big\|^{2}\Bigr]\leq C\int_{0}^{t}\mathbb{E}[\bar{\zeta}^{2}(t^{\prime})]dt^{\prime}+CT\mathbb{E}[\bar{\alpha}^{2}(T)]. (25) Follow the similar procedure, we can also obtain that \displaystyle\mathbb{E}\Bigl[\sup_{0\leq t\leq T}\big\|\sum_{m=0}^{{\lfloor\frac{t}{\delta}\rfloor}}A^{(i)}_{m}\big\|^{2}\Bigr]\leq C\int_{0}^{t}\mathbb{E}[\bar{\zeta}^{2}(t^{\prime})]dt^{\prime}+CT\mathbb{E}[\bar{\alpha}^{2}(T)],\quad i=2,3,4,5. (26) Substituting eqs. 25 and 26 into eq. 24 yields \displaystyle\mathbb{E}[\bar{\zeta}^{2}(t)]\leq C\int_{0}^{t}\mathbb{E}[\bar{\zeta}^{2}(t^{\prime})]dt^{\prime}+C\mathbb{E}[\bar{\alpha}^{2}(T)]+\mathbb{E}\big[\sup_{0\leq t^{\prime}\leq t}\|\varepsilon_{m}^{\prime}\|^{2}\big]. Applying Grönwall’s inequality ( 7 ) gives \displaystyle\mathbb{E}[\bar{\zeta^{2}}(t)]\leq e^{CT}\mathbb{E}[\bar{\alpha}^{2}(T)]+e^{CT}\mathbb{E}\big[\sup_{0\leq t^{\prime}\leq T}\|\varepsilon_{m}^{\prime}\|^{2}\big]. (27) Step 3: Estimating \varepsilon_{m}^{\prime} . From lemma 2 , we have \mathbb{E}[\bar{\alpha}^{2}(T)]=\mathcal{O}(\delta^{2}) . It is sufficient to show \displaystyle\mathbb{E}\Bigl[\sup_{0\leq t\leq T}\big\|\sum_{m=0}^{{\lfloor\frac{t}{\delta}\rfloor}}\varepsilon_{m}^{\prime}\big\|^{2}\Bigr]=\mathcal{O}(\delta^{2}) We prove the above claim in the following proof. For j\in[d] , we define the differential operators \displaystyle\mathfrak{L}_{0}f=\nabla_{\mathbf{R}B_{I}(\mathbf{R})}f+{\tfrac{1}{2}}\nabla_{\mathbf{R}\mathsf{\Sigma}(\mathbf{R})}f+{\tfrac{1}{2}}\sum_{j=1}^{d}\nabla^{2}f(\mathbf{R})[\mathbf{R}\mathcal{B}_{j},\mathbf{R}\mathcal{B}_{j}],\quad \displaystyle\mathfrak{L}_{j}f=\nabla_{\mathbf{R}\mathcal{B}_{j}}f. and integral differential operators \displaystyle I_{\alpha,\beta}^{m}(f)=\int_{t_{m^{*}}}^{t_{(m+1)^{*}}}\int_{t_{m^{*}}}^{s_{1}}fd\chi_{\beta}(s_{1})d\chi_{\alpha}(s_{2}), \displaystyle I_{\alpha,\beta,\gamma}^{m}(f)=\int_{t_{m^{*}}}^{t_{(m+1)^{*}}}\int_{t_{m^{*}}}^{s_{1}}\int_{t_{m^{*}}}^{s_{2}}fd\chi_{\gamma}(s_{1})d\chi_{\beta}(s_{2})d\chi_{\alpha}(s_{3}), where d\chi_{0}=ds and d\chi_{j}=dW_{j} . Accoriding to 12 , the residual of the Itô-Taylor expansion \varepsilon_{m}^{\prime} is written as \displaystyle\varepsilon_{m}^{\prime}=\varepsilon_{m}^{(1)^{\prime}}+\varepsilon_{m}^{(2)^{\prime}},\quad\varepsilon_{m}^{(1)^{\prime}}=I_{0,0}\big(\mathfrak{L}_{0}\mathfrak{L}_{0}(\mathbf{R})\big) \displaystyle\varepsilon_{m}^{(2)^{\prime}}=\sum_{j=1}^{d}I_{j,0}\big(\mathfrak{L}_{j}\mathfrak{L}_{0}(\mathbf{R})\big)+\sum_{j=1}^{d}I_{0,j}\big(\mathfrak{L}_{0}\mathfrak{L}_{j}(\mathbf{R})\big)+\sum_{j=0}^{d}\sum_{j^{\prime},j^{\prime\prime}=1}^{d}I_{j,j^{\prime},j^{\prime\prime}}\big(\mathfrak{L}_{j}\mathfrak{L}_{j^{\prime}}\mathfrak{L}_{j^{\prime\prime}}(\mathbf{R})\big). Under 1 and 2 and the standard moment estimates for multiple Itô integrals 12 , we obtain \displaystyle\mathbb{E}\bigl[\|\varepsilon_{m}^{(1)^{\prime}}\|\bigr]=\mathcal{O}(\delta^{4}), and the partial sum \sum_{m}\varepsilon_{m}^{(2)^{\prime}} is a martingale with \displaystyle\mathbb{E}\bigl[\|\varepsilon_{m}^{(2)^{\prime}}\|\bigr]=\mathcal{O}(\delta^{3}). Applying lemmas 11 and 12 gives \displaystyle\mathbb{E}\Bigl[\sup_{0\leq t\leq T}\Bigl\|\sum_{m=0}^{{\lfloor\frac{t}{\delta}\rfloor}}\varepsilon_{m}^{\prime}\Bigr\|^{2}\Bigr]=\mathcal{O}(\delta^{2}). (28) Substituting eq. 28 into eq. 27 , we obtain \displaystyle\mathbb{E}[\bar{\zeta^{2}}(t)]=\mathcal{O}(\delta^{2}), which completes the proof. ∎ Appendix D Proof of Theorem 2 Before carrying out the proof of Theorem 2 , we state a number of lemmas that describe the moments of the double Itô integral {I_{j,j^{\prime}}^{{m^{*}}}}(t) and approximation error \Delta{I_{j,j^{\prime}}^{{m^{*}}}} . D.1 Moment Estimate of Double Itô integral Lemma 13 ( 12 ) . For 0\leq t\leq T and all j\neq j^{\prime}\in[d] \displaystyle\mathbb{E}[{I_{j,j^{\prime}}^{{m^{*}}}}(t)]=0,\qquad\mathbb{E}\bigl[({I_{j,j^{\prime}}^{{m^{*}}}}(t))^{2n}\bigr]=\bigl(2(2n-1)e^{T}\bigr)^{2n}(\Delta_{m^{*}}t)^{2n}. Lemma 14 . For every index j\neq j\in[d] , and l\in[d] , we have \displaystyle\mathbb{E}[{I_{j,j^{\prime}}^{{m^{*}}}}(t){\Delta^{*}_{m}}W_{l}(t)]=0,\qquad 0\leq t\leq T. Proof. If l\notin\{j,j^{\prime}\} the claim follows immediately from independence. So, it remains to treat l=j or l=j^{\prime} . Recall the identity {I_{j,j^{\prime}}^{{m^{*}}}}+{I_{j^{\prime},j}^{{m^{*}}}}=\tfrac{1}{2}{\Delta^{*}_{m}}W_{j}\cdot{\Delta^{*}_{m}}W_{j^{\prime}}. Taking expectations gives \mathbb{E}[{\Delta^{*}_{m}}W_{j}\cdot{\Delta^{*}_{m}}W_{j^{\prime}}\cdot{\Delta^{*}_{m}}W_{l^{\prime}}]=0. so \mathbb{E}[{I_{j^{\prime},j}^{{m^{*}}}}\Delta_{m^{*}}W_{j^{\prime}}]=0 implies \mathbb{E}[{I_{j^{\prime},j}^{{m^{*}}}}\Delta_{m^{*}}W_{j^{\prime}}]=0 . W.l.o.g, we assume l=j^{\prime} . When l=j^{\prime} , we define the process \Phi_{j,m}(s):=\int_{t_{m}}^{s}dW_{j}=dW_{j}(s)-dW_{j}(t_{m^{*}}) . Conditioning on W_{j} , we get \displaystyle\mathbb{E}[{\Delta^{*}_{m}}W_{j^{\prime}}\cdot{I_{j,j^{\prime}}^{{m^{*}}}}\mid W_{j}]=\mathbb{E}\left[\int_{t_{m^{*}}}^{t_{(m+1)^{*}}}dW_{j^{\prime}}(s_{2})\int_{t_{m^{*}}}^{t_{(m+1)^{*}}}\Phi_{j,m}(s_{2})dW_{j^{\prime}}(s_{2})\right]. Applying the Itô isometry ( lemma 5 ) yields \displaystyle\mathbb{E}[{\Delta^{*}_{m}}W_{j^{\prime}}\cdot{I_{j,j^{\prime}}^{{m^{*}}}}\mid W_{j}]=\int_{t_{m^{*}}}^{t_{(m+1)^{*}}}\Phi_{j,m}(s)ds. Finally taking the total expectation yields \displaystyle\mathbb{E}[{\Delta^{*}_{m}}W_{j^{\prime}}\cdot{I_{j,j^{\prime}}^{{m^{*}}}}]=\int_{t_{m^{*}}}^{t_{(m+1)^{*}}}\mathbb{E}[\Phi_{j,m}(s)]ds=0, which completes the proof. ∎ Lemma 15 . For every index j\neq j\in[d] , l\in[d] , and time 0\leq t\leq T , we have 1. \mathbb{E}[{I_{j,j^{\prime}}^{{m^{*}}}}^{2}(t){\Delta^{*}_{m}}W_{l}^{2}(t)]=\mathcal{O}(\delta^{3}) ; 2. \mathbb{E}[{I_{j,j^{\prime}}^{{m^{*}}}}^{2}(t){\Delta^{*}_{m}}W_{l}^{4}(t)]=\mathcal{O}(\delta^{4}) . Proof. Adopting the notation \Phi_{j,m}(s) from lemma 14 , we also assume l=j , w.l.o.g.. Case (a): Conditioning on W_{j} , we have \displaystyle\mathbb{E}[{I_{j,j^{\prime}}^{{m^{*}}}}^{2}{\Delta^{*}_{m}}W_{j}^{2}|W_{j}]=\mathbb{E}\Bigl[\Bigl(\int_{t_{m^{*}}}^{t_{(m+1)^{*}}}(\Phi_{j,m}(s_{2}))({\Delta^{*}_{m}}W_{j})dW_{j^{\prime}}(s_{2})\Bigr)^{2}\Big]. Using lemma 5 again, we have \displaystyle\mathbb{E}[{I_{j,j^{\prime}}^{{m^{*}}}}^{2}{\Delta^{*}_{m}}W_{j}^{2}|W_{j}]= \displaystyle\int_{t_{m^{*}}}^{t_{(m+1)^{*}}}(\Phi_{j,m}^{2}(t))({\Delta^{*}_{m}}W_{j})^{2}ds. Taking the total expectation yields \displaystyle\mathbb{E}[{I_{j,j^{\prime}}^{{m^{*}}}}^{2}{\Delta^{*}_{m}}W_{j}^{2}]= \displaystyle\int_{t_{m^{*}}}^{t_{(m+1)^{*}}}\mathbb{E}\big[(\Phi_{j,m}^{2}(t))({\Delta^{*}_{m}}W_{j})^{2}\big]ds. Since \displaystyle\mathbb{E}\big[(\Phi_{j,m}^{2}(s))({\Delta^{*}_{m}}W_{j}(s))^{2}\big]= \displaystyle\mathbb{E}\big[(\Phi_{j,m}^{2}(s))(\Phi_{j,m}(s)+W_{j}(t)-W_{j}(s))^{2}\big] \displaystyle\leq \displaystyle 3(s-t_{{m^{*}}})^{2}+(s-t_{{m^{*}}})(t-s)\leq 4\delta^{2}, we have \displaystyle\mathbb{E}[{I_{j,j^{\prime}}^{{m^{*}}}}^{2}{\Delta^{*}_{m}}W_{j}^{2}]\leq\int_{t_{m^{*}}}^{t_{(m+1)^{*}}}4\delta^{2}ds\leq 4\delta^{3}. Case (b): Similarly, conditioning on W_{j} , we have \displaystyle\mathbb{E}[{I_{j,j^{\prime}}^{{m^{*}}}}^{2}{\Delta^{*}_{m}}W_{j}^{4}|W_{j}]= \displaystyle\mathbb{E}\Bigl[\Bigl(\int_{t_{m^{*}}}^{t_{(m+1)^{*}}}(\Phi_{j,m}(s_{2}))({\Delta^{*}_{m}}W_{j})^{2}dW_{j^{\prime}}(s_{2})\Bigr)^{2}\Big], Taking the total expectation yields \displaystyle\mathbb{E}[{I_{j,j^{\prime}}^{{m^{*}}}}^{2}{\Delta^{*}_{m}}W_{j}^{4}]= \displaystyle\int_{t_{m^{*}}}^{t_{(m+1)^{*}}}\mathbb{E}\big[(\Phi_{j,m}(s))^{2}({\Delta^{*}_{m}}W_{j}(s))^{4}\big]ds. Since \displaystyle\mathbb{E}\big[(\Phi_{j,m}^{2}(s))({\Delta^{*}_{m}}W_{j}(s))^{4}\big]\leq \displaystyle 120(s-t_{{m^{*}}})^{2}+24(s-t_{{m^{*}}})(t-s)^{2}\leq 144\delta^{3}, we have \displaystyle\mathbb{E}[{I_{j,j^{\prime}}^{{m^{*}}}}^{2}{\Delta^{*}_{m}}W_{j}^{4}]\leq\int_{t_{m^{*}}}^{t_{(m+1)^{*}}}144\delta^{3}ds\leq 144\delta^{4}. Combining cases (a) and (b), we complete our proof. ∎ D.2 Moment Estimate of Approximation Error Lemma 16 . For any h>1 , \mathbb{E}\bigl[(\Delta{I_{j,j^{\prime}}^{{m^{*}}}})^{4}\bigr]=\mathcal{O}(\delta^{4}) . Proof. From lemma 4 , we know that \mathbb{E}[(\Delta{I_{j,j^{\prime}}^{{m^{*}}}})^{4}]=\frac{1}{2\pi}({\Delta^{*}_{m}}t)^{4}\mathbb{E}\Bigl[\sum_{r=h+1}^{\infty}\frac{1}{r}\Big(a_{j,r}b_{j^{\prime},r}-a_{j,r}b_{j^{\prime},r}\Big)\Bigr]. Denote X_{r}=\frac{1}{r}\Big(a_{j,r}b_{j^{\prime},r}-a_{j,r}b_{j^{\prime},r}\Big) . Since \{a_{j,r},b_{j,r}\} are independent normal Gaussian variables, we have \displaystyle\mathbb{E}[X_{r}]=0,\qquad\mathbb{E}[X_{r}^{2}]=\frac{1}{r^{2}}\big(\mathbb{E}[a_{j,r}^{2}]\mathbb{E}[b_{j^{\prime},r}^{2}]+\mathbb{E}[a_{j^{\prime},r}^{2}]\mathbb{E}[b_{j,r}^{2}]\bigr)=\frac{2}{r^{2}}, \displaystyle\mathbb{E}[X_{r}^{4}]=\frac{1}{r^{4}}\left(\mathbb{E}[a_{j,r}^{4}b_{j^{\prime},r}^{4}]+\mathbb{E}[a_{j^{\prime},r}^{4}b_{j,r}^{4}]+6\mathbb{E}[a_{j,r}^{2}a_{j^{\prime},r}^{2}b_{j,r}^{2}b_{j^{\prime},r}^{2}]\right)=\frac{24}{r^{4}}. We define S_{h}:=\sum_{r>h}X_{r} . Since X_{r} are independent, it satisfies \displaystyle\mathbb{E}[S_{h}^{4}] \displaystyle=\sum_{r=h+1}^{\infty}\mathbb{E}[(X_{r})^{4}]+6\sum_{r1 . Then for every index j\neq j^{\prime}\in[d] , and l\in[d] , we have 1. \mathbb{E}[\Delta{I_{j,j^{\prime}}^{{m^{*}}}}{\Delta^{*}_{m}}W_{l}]=0 , 2. \mathbb{E}[(\Delta{I_{j,j^{\prime}}^{{m^{*}}}}{\Delta^{*}_{m}}W_{l})^{2}]=\mathcal{O}(\delta^{3}) , 3. \mathbb{E}[(\Delta{I_{j,j^{\prime}}^{{m^{*}}}})^{2}({\Delta^{*}_{m}}W_{l})^{4}]=\mathcal{O}(\delta^{4}) . Proof. Case (a): Because every a_{j,r} and b_{j,r} is independent of \Delta_{m^{*}}W_{l} , the random variables \Delta{I_{j,j^{\prime}}^{{m^{*}}}} and \Delta_{m^{*}}W_{l} are independent, therefore \mathbb{E}[\Delta{I_{j,j^{\prime}}^{{m^{*}}}}{\Delta^{*}_{m}}W_{l}]=\mathbb{E}[\Delta{I_{j,j^{\prime}}^{{m^{*}}}}]\mathbb{E}[{\Delta^{*}_{m}}W_{l}]=0. Case (b): From the independence, we have \displaystyle\mathbb{E}[(\Delta{I_{j,j^{\prime}}^{{m^{*}}}}{\Delta^{*}_{m}}W_{l})^{2}]=\mathbb{E}[(\Delta{I_{j,j^{\prime}}^{{m^{*}}}})^{2}]\mathbb{E}[({\Delta^{*}_{m}}W_{l})^{2}]. Lemma 4 gives \mathbb{E}[(\Delta{I_{j,j^{\prime}}^{{m^{*}}}})^{2}]=\mathcal{O}(\delta^{2}) for h>1 , which implies \displaystyle\mathbb{E}[(\Delta{I_{j,j^{\prime}}^{{m^{*}}}}{\Delta^{*}_{m}}W_{l})^{2}]=\mathcal{O}(\delta^{2}){\Delta^{*}_{m}}t=\mathcal{O}(\delta^{3}). Case (c): Using the same independence, we have \displaystyle\mathbb{E}[(\Delta{I_{j,j^{\prime}}^{{m^{*}}}})^{2}({\Delta^{*}_{m}}W_{l})^{4}]=\mathbb{E}[(\Delta{I_{j,j^{\prime}}^{{m^{*}}}})^{2}]\mathbb{E}[({\Delta^{*}_{m}}W_{l})^{4}]=\mathcal{O}(\delta^{2})({\Delta^{*}_{m}}t)^{2}=\mathcal{O}(\delta^{4}). Combining cases (a)-(c), we complete the proof. ∎ Then we begin to prove Theorem 2 . Proof. We put the whole proof into four steps. Step 1: Local expansion of the TaSP-CM series. Using the frozen-field Milstein series \mathbf{R}_{\delta}(t) as defined in eq. 11 , we write the error as \displaystyle\mathbb{E}\big[\sup_{0\leq t\leq T}\|\mathbf{R}(t)-\widehat{\mathbf{R}}(t)\|^{2}_{F}\big]\leq 2\mathbb{E}\big[\sup_{0\leq t\leq T}\|\widehat{\mathbf{R}}(t)-\mathbf{R}_{\delta}(t)\|_{F}^{2}\big]+2\mathbb{E}\big[\sup_{0\leq t\leq T}\|\mathbf{R}_{\delta}(t)-\mathbf{R}(t)\|^{2}_{F}\big]. Similar to the proof of lemma 2 , we write \widehat{\mathbf{R}}(t) as \displaystyle\widehat{\mathbf{R}}(t)=\mathbf{R}_{\delta}(t)+\sum_{m=0}^{{\lfloor\frac{t}{\delta}\rfloor}}\varepsilon^{\Delta}_{m}+\sum_{m=0}^{{\lfloor\frac{t}{\delta}\rfloor}}\tilde{\varepsilon}_{m}^{(\mathsf{N})}+\sum_{m=0}^{{\lfloor\frac{t}{\delta}\rfloor}}\tilde{\varepsilon}_{m}. Here, \displaystyle\varepsilon^{\Delta}_{m}={\widehat{\mathbf{R}}_{m}}\sum_{j\neq j^{\prime}}{\widehat{\nabla}_{j,j^{\prime}}^{m}}\Delta{I_{j,j^{\prime}}^{{m^{*}}}} is the local approximation error arising from the non-commutativity noise, \displaystyle\tilde{\varepsilon}_{m}^{(\mathsf{N})}={\widehat{\mathbf{R}}_{m}}\big(\sqrt{I+\widehat{\mathcal{Z}}_{{(m+1)^{*}}}^{2}}-I-\widehat{\mathcal{Z}}_{{(m+1)^{*}}}-\tfrac{1}{2}\widehat{\mathcal{Z}}_{{(m+1)^{*}}}^{2}\big) is the local truncation remainder of the second-order Taylor expansion, and \displaystyle\tilde{\varepsilon}_{m}={\widehat{\mathbf{R}}_{m}}\widehat{\mathcal{Z}}_{{(m+1)^{*}}}^{2}-{\widehat{\mathbf{R}}_{m}}\sum_{j,j^{\prime}=1}^{d}\mathsf{S}_{j,j^{\prime}}^{m}{\tilde{I}_{j,j^{\prime}}^{{m^{*}}}}-{\widehat{\mathbf{R}}_{m}}\sum_{j=1}^{d}\mathsf{S}_{j,j^{\prime}}^{m}({\Delta^{*}_{m}}t)^{2} collects higher-order terms. Therefore, we have \displaystyle\mathbb{E}\big[\sup_{0\leq t\leq T}\|\widehat{\mathbf{R}}(t)-\mathbf{R}_{\delta}(t)\|^{2}\big] \displaystyle\leq \displaystyle 3\mathbb{E}\Bigl[\sup_{0\leq t\leq T}\big\|\sum_{m=0}^{{\lfloor\frac{t}{\delta}\rfloor}}\varepsilon^{\Delta}_{m}\big\|^{2}\Bigr]+3\mathbb{E}\Bigl[\sup_{0\leq t\leq T}\big\|\sum_{m=0}^{{\lfloor\frac{t}{\delta}\rfloor}}\tilde{\varepsilon}_{m}\big\|^{2}\Bigr]+3\mathbb{E}\Bigl[\sup_{0\leq t\leq T}\big\|\sum_{m=0}^{{\lfloor\frac{t}{\delta}\rfloor}}\tilde{\varepsilon}_{m}^{(\mathsf{N})}\big\|^{2}\Bigr]. (29) Since \mathbb{E}\Bigl[\sup_{0\leq t\leq T}\big\|\sum_{m=0}^{{\lfloor\frac{t}{\delta}\rfloor}}\tilde{\varepsilon}_{m}^{(\mathsf{N})}\big\|^{2}\Bigr] has been shown to contribute at most \mathcal{O}(\delta^{2}) accumulated error in Appendix B . It is sufficient to show \displaystyle\mathbb{E}\Bigl[\sup_{0\leq t\leq T}\big\|\sum_{m=0}^{{\lfloor\frac{t}{\delta}\rfloor}}\varepsilon^{\Delta}_{m}\big\|^{2}\Bigr]=\mathbb{E}\Bigl[\sup_{0\leq t\leq T}\big\|\sum_{m=0}^{{\lfloor\frac{t}{\delta}\rfloor}}\tilde{\varepsilon}_{m}\big\|^{2}\Bigr]=\mathcal{O}(\delta^{2}). Step 2: Estimating \varepsilon^{\Delta}_{m} . By lemma 4 we know the partial sum \sum_{m=0}^{{\lfloor\frac{t}{\delta}\rfloor}}\varepsilon^{\Delta}_{m} is a martingale. Moreover, since {\widehat{\mathbf{R}}_{m}}\in\mathrm{SO}(n) and each {\widehat{\nabla}_{j,j^{\prime}}^{m}} is uniformly bounded by a constant C under 1 and 2 , we obtain \displaystyle\mathbb{E}\Bigl[\sup_{0\leq t\leq T}\big\|\sum_{m=0}^{{\lfloor\frac{t}{\delta}\rfloor}}\varepsilon^{\Delta}_{m}\big\|^{2}\Bigr]=\mathbb{E}[\|{\widehat{\mathbf{R}}_{m}}\sum_{j\neq j^{\prime}}{\widehat{\nabla}_{j,j^{\prime}}^{m}}\Delta{I_{j,j^{\prime}}^{{m^{*}}}}\|^{2}]\leq d^{2}C^{2}\sum_{j\neq j^{\prime}}\mathbb{E}[\Delta{I_{j,j^{\prime}}^{{m^{*}}}}^{2}] Since h\geq\delta^{-{\tfrac{1}{2}}} , lemma 4 implies \mathbb{E}[(\Delta{I_{j,j^{\prime}}^{{m^{*}}}})^{2}]=\mathcal{O}(\delta^{3}) . Applying Lemma 11 , we have \displaystyle\mathbb{E}\Bigl[\sup_{0\leq t\leq T}\big\|\sum_{m=0}^{{\lfloor\frac{t}{\delta}\rfloor}}\varepsilon^{\Delta}_{m}\big\|^{2}\Bigr]=\mathbb{E}\Bigl[\sup_{0\leq t\leq T}\big\|\sum_{m=0}^{{\lfloor\frac{t}{\delta}\rfloor}}{\widehat{\mathbf{R}}_{m}}\sum_{j\neq j^{\prime}}{\widehat{\nabla}_{j,j^{\prime}}^{m}}\Delta{I_{j,j^{\prime}}^{{m^{*}}}}\big\|^{2}\Bigr]=\mathcal{O}(\delta^{2}), (30) Step 3: Estimating \tilde{\varepsilon}_{m} . We write \tilde{\varepsilon}_{m} as follows. \displaystyle\qquad\qquad\qquad\qquad\qquad\qquad\tilde{\varepsilon}_{m}=\sum_{i=1}^{9}\tilde{\varepsilon}_{m}^{(i)}, \displaystyle\begin{cases}\tilde{\varepsilon}_{m}^{(1)}=\widehat{\mathbf{R}}_{m}\sum_{j=1}^{d}\mathsf{S}^{O}({\widehat{\mathcal{B}}_{I,m}},{\widehat{\mathcal{B}}_{j,m}})({\Delta^{*}_{m}}t\cdot{\Delta^{*}_{m}}W_{j})\\ \tilde{\varepsilon}_{m}^{(2)}=\widehat{\mathbf{R}}_{m}\sum_{j=1}^{d}\sum_{l\neq l^{\prime}}\mathsf{S}^{O}({\widehat{\mathcal{B}}_{j,m}},{\widehat{\mathcal{D}}_{l,l^{\prime}}^{m}})({\Delta^{*}_{m}}W_{j}\cdot{\tilde{I}_{l,l^{\prime}}^{{m^{*}}}})\\ \tilde{\varepsilon}_{m}^{(3)}=\widehat{\mathbf{R}}_{m}\sum_{j=1}^{d}\sum_{l=1}^{d}\mathsf{S}^{O}({\widehat{\mathcal{B}}_{j,m}},{\widehat{\mathcal{D}}_{l,l}^{m}})({\Delta^{*}_{m}}W_{j})(({\Delta^{*}_{m}}W_{l})^{2}-{\Delta^{*}_{m}}t)),\\ \tilde{\varepsilon}_{m}^{(4)}=\widehat{\mathbf{R}}_{m}\mathsf{S}^{O}({\widehat{\mathcal{B}}_{I,m}},{\widehat{\mathcal{B}}_{I,m}})({\Delta^{*}_{m}}t)^{2}\\ \tilde{\varepsilon}_{m}^{(5)}=\Big(\widehat{\mathbf{R}}_{m}\sum_{j\neq j^{\prime}}{\widehat{\mathcal{D}}_{j,j^{\prime}}^{m}}({\tilde{I}_{j,j^{\prime}}^{{m^{*}}}})\Big)^{2}\\ \tilde{\varepsilon}_{m}^{(6)}=\Big(\widehat{\mathbf{R}}_{m}\sum_{j=1}^{d}{\widehat{\mathcal{D}}_{j,j}^{m}}\big(({\Delta^{*}_{m}}W_{j})^{2}-{\Delta^{*}_{m}}t\big)\Big)^{2}\\ \tilde{\varepsilon}_{m}^{(7)}=\widehat{\mathbf{R}}_{m}\sum_{j\neq j^{\prime}}\mathsf{S}^{O}({\widehat{\mathcal{B}}_{I,m}},{\widehat{\mathcal{D}}_{j,j^{\prime}}^{m}})({\Delta^{*}_{m}}t\cdot{\tilde{I}_{j,j^{\prime}}^{{m^{*}}}})\\ \tilde{\varepsilon}_{m}^{(8)}={\widehat{\mathbf{R}}_{m}}\sum_{j}\mathsf{S}^{O}({\widehat{\mathcal{B}}_{I,m}},{\widehat{\mathcal{D}}_{j,j}^{m}})\Big({\Delta^{*}_{m}}t\cdot\big(({\Delta^{*}_{m}}W_{j})^{2}-{\Delta^{*}_{m}}t\big)\Big)\\ \tilde{\varepsilon}_{m}^{(9)}=\widehat{\mathbf{R}}_{m}\sum_{j\neq j^{\prime}}\sum_{l}\mathsf{S}^{O}({\widehat{\mathcal{D}}_{j,j^{\prime}}^{m}},{\widehat{\mathcal{D}}_{l,l}^{m}}){\tilde{I}_{j,j^{\prime}}^{{m^{*}}}}(({\Delta^{*}_{m}}W_{l})^{2}-{\Delta^{*}_{m}}t)).\end{cases} (31) In section D.2 , all terms were bounded in appendix B except the terms related to {\tilde{I}_{j,j^{\prime}}^{{m^{*}}}} , i.e., \displaystyle\tilde{\varepsilon}_{m}^{(2)},\tilde{\varepsilon}_{m}^{(5)},\tilde{\varepsilon}_{m}^{(7)},\tilde{\varepsilon}_{m}^{(9)}, now we analyze the above terms. We first estimate \tilde{\varepsilon}_{m}^{(2)} . The partial sum \displaystyle\tilde{H}^{(2)}_{t}=\sum_{m=1}^{{\lfloor\frac{t}{\delta}\rfloor}}\tilde{\varepsilon}_{m}^{(2)} is an \mathcal{F}_{t} -martingale. In addition, since {\widehat{\mathbf{R}}_{m}}\in\mathrm{SO}(n) and each \mathsf{S}^{O}({\widehat{\mathcal{B}}_{j,m}},{\widehat{\mathcal{D}}_{l,l^{\prime}}^{m}}) is uniformly bounded under Assumptions 1 and 2 , we obtain \displaystyle\mathbb{E}[\|(\tilde{\varepsilon}_{m}^{(2)})^{2}\|]\leq \displaystyle C\sum_{j=1}^{d}\sum_{l=1}^{d}\mathbb{E}[\|{\Delta^{*}_{m}}W_{j}{\tilde{I}_{l,l^{\prime}}^{{m^{*}}}}\|^{2}] \displaystyle\leq \displaystyle C\sum_{j=1}^{d}\sum_{l=1}^{d}\mathbb{E}[\|{\Delta^{*}_{m}}W_{j}{I_{l,l^{\prime}}^{{m^{*}}}}\|^{2}]+C\sum_{j=1}^{d}\sum_{l=1}^{d}\mathbb{E}[\|{\Delta^{*}_{m}}W_{j}\Delta{I_{l,l^{\prime}}^{{m^{*}}}}\|^{2}]=\mathcal{O}(\delta^{3}). where the last equality follows from lemmas 15 and 17 . Hence, applying lemma 11 , we have \displaystyle\mathbb{E}\Bigl[\sup_{0\leq t\leq T}\big\|\sum_{m=0}^{{\lfloor\frac{t}{\delta}\rfloor}}\tilde{\varepsilon}_{m}^{(2)}\big\|^{2}\Bigr]=\mathcal{O}(\delta^{2}) Second, we estimate \varepsilon_{m}^{(5)} . Under the same boundedness assumptions, we have \displaystyle\mathbb{E}[(\tilde{\varepsilon}_{m}^{(5)})^{2}]\leq \displaystyle C\sum_{j\neq j}\mathbb{E}[({\tilde{I}_{j,j^{\prime}}^{{m^{*}}}})^{4}]\leq C\sum_{j\neq j}\mathbb{E}[({I_{j,j^{\prime}}^{{m^{*}}}})^{4}]+C\sum_{j\neq j}\mathbb{E}[(\Delta{I_{j,j^{\prime}}^{{m^{*}}}})^{4}]=\mathcal{O}(\delta^{4}), where the last equality follows from lemmas 13 and 16 , which immediately implies \displaystyle\mathbb{E}\Bigl[\sup_{0\leq t\leq T}\Bigl\|\sum_{m=0}^{{\lfloor\frac{t}{\delta}\rfloor}}\varepsilon_{m}^{(5)}\Bigr\|^{2}\Bigr]=\mathcal{O}(\delta^{2}). Furthermore, by lemmas 13 and 4 , we know that \mathbb{E}[({\tilde{I}_{j,j^{\prime}}^{{m^{*}}}})^{2}]\leq 2\mathbb{E}[({I_{j,j^{\prime}}^{{m^{*}}}})^{2}]+2\mathbb{E}[(\Delta{I_{j,j^{\prime}}^{{m^{*}}}})^{2}]=\mathcal{O}(\delta^{2}). Consequently, \displaystyle\mathbb{E}[({\tilde{I}_{j,j^{\prime}}^{{m^{*}}}})^{2}({\Delta^{*}_{m}}t)^{2}]=\mathcal{O}(\delta^{4}), which leads to \displaystyle\mathbb{E}\Bigl[\sup_{0\leq t\leq T}\Bigl\|\sum_{m=0}^{{\lfloor\frac{t}{\delta}\rfloor}}\varepsilon_{m}^{(7)}\Bigr\|^{2}\Bigr]=\mathcal{O}(\delta^{2}). Finally, using the same argument, we obtain \displaystyle\mathbb{E}[({\tilde{I}_{j,j^{\prime}}^{{m^{*}}}})^{2}({\Delta^{*}_{m}}W_{j})^{4}]=\mathbb{E}[({\tilde{I}_{j,j^{\prime}}^{{m^{*}}}})^{2}({\Delta^{*}_{m}}t)^{2}]=\mathcal{O}(\delta^{4}), which yields \displaystyle\mathbb{E}\Bigl[\sup_{0\leq t\leq T}\Bigl\|\sum_{m=0}^{{\lfloor\frac{t}{\delta}\rfloor}}\varepsilon_{m}^{(9)}\Bigr\|^{2}\Bigr]=\mathcal{O}(\delta^{2}), Finally, we have \displaystyle\mathbb{E}\Bigl[\sup_{0\leq t\leq T}\big\|\sum_{m=0}^{{\lfloor\frac{t}{\delta}\rfloor}}\tilde{\varepsilon}_{m}\big\|^{2}\Bigr]\leq 9\sum_{i=1}^{9}\mathbb{E}\Bigl[\sup_{0\leq t\leq T}\big\|\sum_{m=0}^{{\lfloor\frac{t}{\delta}\rfloor}}\tilde{\varepsilon}_{m}^{(i)}\big\|^{2}\Bigr]. (32) Step 4: Putting Together. Putting eqs. 32 and 30 into section D.2 , we have \displaystyle\mathbb{E}\big[\sup_{0\leq t\leq T}\|\widehat{\mathbf{R}}(t)-\mathbf{R}_{\delta}(t)\|^{2}\big]=\mathcal{O}(\delta^{2}). (33) Given the error in eq. 33 and following the same proof as in lemma 3 , we have \displaystyle\mathbb{E}\big[\sup_{0\leq t\leq T}\|\mathbf{R}_{\delta}(t)-\mathbf{R}(t)\|^{2}_{F}\big]=\mathcal{O}(\delta^{2}), and, finally, we conclude that \displaystyle\mathbb{E}\big[\sup_{0\leq t\leq T}\|\widehat{\mathbf{R}}(t)-\mathbf{R}(t)\|^{2}\big]^{{\frac{1}{2}}}=\mathcal{O}(\delta), which completes our proof. ∎ Appendix E Proof of Theorem 3 Proof. To find the normal adjustment, we seek a normal element \mathsf{U}=(\mathsf{C},\mathsf{b})\in\mathfrak{se}(n)^{\perp} such that I+\mathcal{V}+\mathsf{U}=\begin{bmatrix}I+\mathcal{Z}+\mathsf{C}&v\\ \mathsf{b}^{\top}&1\end{bmatrix}\in\mathrm{SE}(n). The group constraint imposes conditions that I+\mathcal{Z}+\mathsf{C}\in\mathrm{SO}(n),\qquad\mathsf{b}^{\top}=0. Therefore, from lemma 1 , we have \displaystyle\mathsf{C}=\sqrt{I-\mathcal{Z}^{\top}\mathcal{Z}}-I, (34) Hence, \mathsf{U}=(\sqrt{I-\mathcal{Z}^{\top}\mathcal{Z}}-I,0) is the normal adjustment for TaSP over \mathrm{SE}(n) . Now we parametrize the solution of ( 7 ) as \mathbf{E}(t)=\mathbf{E}_{0}\bigl(I+\mathcal{V}(t)+\mathsf{U}(\mathcal{V}(t))\bigr). Differentiating on both sides gives d\mathbf{E}(t)=\mathbf{E}_{0}\bigl(d\mathcal{V}(t)+d\mathsf{U}(t)\bigr). Because \mathsf{U}(t)\in\mathfrak{se}(n)^{\perp} , projection onto the tangent space T_{\mathbf{E}_{0}}\mathrm{SE}(n)=\mathbf{E}_{0}\mathfrak{se}(n) eliminates the normal component \PEtg(d\mathbf{E}(t))=\mathbf{E}_{0}d\mathcal{V}(t). Applying the projection operator to the SDE ( 7 ) yields \PEtg(d\mathbf{E}(t)\bigr)=\Bigl(\mathcal{B}_{I}(\mathbf{E}(t))dt+\sum_{j=1}^{d}\mathcal{B}_{j}(\mathbf{E}(t))dW_{j}(t)\Bigr). Left‐multiplying by \mathbf{E}_{0}^{-1} gives the dynamics for the tangent motion \mathcal{V}(t) , i.e., d\mathcal{V}(t)=\mathcal{B}_{I}(\mathbf{E}(t))dt+\sum_{j=1}^{d}\mathcal{B}_{j}(\mathbf{E}(t))dW_{j}(t). Writing \mathcal{B}_{I}(\mathbf{E})=(\mathcal{B}_{I}^{\mathbf{R}}(\mathbf{E}),\mathcal{B}_{I}^{\mathbf{p}}(\mathbf{E})) , \mathcal{B}_{j}(\mathbf{E})=(\mathcal{B}_{j}^{\mathbf{R}}(\mathbf{E}),\mathcal{B}_{j}^{\mathbf{p}}(\mathbf{E})) for j\in[d], we finally obtain the coupled SDEs \displaystyle\begin{cases}d\mathcal{Z}(t)&=\mathcal{B}_{I}^{\mathbf{R}}(\mathbf{E}(t))dt+\sum_{j=1}^{d}\mathcal{B}_{j}^{\mathbf{R}}(\mathbf{E}(t))dW_{j}(t),\\ dv(t)&=\mathcal{B}_{I}^{\mathbf{p}}(\mathbf{E}(t))dt+\sum_{j=1}^{d}\mathcal{B}_{j}^{\mathbf{p}}(\mathbf{E}(t))dW_{j}(t).\end{cases} which completes the proof. ∎ Appendix F Proof of Theorem 4 Proof. We define the frozen-field Milstein series \mathbf{E}_{\delta}(t) over \mathrm{SE}(n) with ({\widehat{\nabla}_{j,j}^{\mathbf{R},m}},{\widehat{\nabla}_{j,j^{\prime}}^{\mathbf{p},m}})=\nabla_{\mathbf{E}\mathcal{B}_{j}}\bigl(\mathbf{E}\mathcal{B}_{j^{\prime}}(\widehat{\mathbf{E}}_{m})\bigr) as follows, \displaystyle\begin{cases}\mathbf{R}^{E}_{\delta}(t)=&\mathbf{R}_{0}+\sum_{m=1}^{{\lfloor\frac{t}{\delta}\rfloor}}{\widehat{\mathbf{R}}_{m}}{\widehat{\mathcal{B}}^{\mathbf{R}}_{I,m}}{\Delta^{*}_{m}}t+{\frac{1}{2}}\sum_{m=1}^{{\lfloor\frac{t}{\delta}\rfloor}}{\widehat{\mathbf{R}}_{m}}\sum_{j=1}^{d}({\widehat{\mathcal{B}}^{\mathbf{R}}_{j,m}})^{2}{\Delta^{*}_{m}}t\\ &+\sum_{m=1}^{{\lfloor\frac{t}{\delta}\rfloor}}{\widehat{\mathbf{R}}_{m}}\sum_{j=1}^{d}{\widehat{\mathcal{B}}^{\mathbf{R}}_{j,m}}{\Delta^{*}_{m}}W_{j}(t)+{\frac{1}{2}}\sum_{m=1}^{{\lfloor\frac{t}{\delta}\rfloor}}{\widehat{\mathbf{R}}_{m}}\sum_{j,j^{\prime}=1}^{d}{\widehat{\nabla}_{j,j^{\prime}}^{\mathbf{R},m}}{I_{j,j^{\prime}}^{{m^{*}}}},\\ {\mathbf{p}}^{E}_{\delta}(t)=&\mathbf{p}_{0}+\sum_{m=1}^{{\lfloor\frac{t}{\delta}\rfloor}}{\widehat{\mathbf{R}}_{m}}{\widehat{\mathcal{B}}^{\mathbf{p}}_{I,m}}{\Delta^{*}_{m}}t\\ &+\sum_{m=1}^{{\lfloor\frac{t}{\delta}\rfloor}}{\widehat{\mathbf{R}}_{m}}\sum_{j=1}^{d}{\widehat{\mathcal{B}}^{\mathbf{p}}_{j,m}}{\Delta^{*}_{m}}W_{j}(t)+{\frac{1}{2}}\sum_{m=1}^{{\lfloor\frac{t}{\delta}\rfloor}}{\widehat{\mathbf{R}}_{m}}\sum_{j,j^{\prime}=1}^{d}{\widehat{\nabla}_{j,j^{\prime}}^{\mathbf{p},m}}{I_{j,j^{\prime}}^{{m^{*}}}}.\\ \end{cases} Therefore, the error splits as \displaystyle\mathbb{E}\bigl[\sup_{0\leq t\leq T}\|\widehat{\mathbf{E}}(t)-\mathbf{E}(t)\|^{2}\bigr]\leq 2\mathbb{E}\bigl[\sup_{0\leq t\leq T}\|\widehat{\mathbf{E}}(t)-\mathbf{E}_{\delta}(t)\|^{2}\bigr]+2\mathbb{E}\bigl[\sup_{0\leq t\leq T}\|\mathbf{E}_{\delta}(t)-\mathbf{E}(t)\|^{2}\bigr]. (35) Write the first term in ( 35 ) component-wise, we have \displaystyle\mathbb{E}\bigl[\sup_{0\leq t\leq T}\|\widehat{\mathbf{E}}(t)-\mathbf{E}_{\delta}(t)\|^{2}\bigr]\leq\mathbb{E}\bigl[\sup_{0\leq t\leq T}\|\widehat{\mathbf{R}}^{E}(t)-\mathbf{R}^{E}_{\delta}(t)\|^{2}+\sup_{0\leq t\leq T}\|\widehat{\mathbf{p}}^{E}(t)-\mathbf{p}^{E}_{\delta}(t)\|^{2}\bigr]. The rotational component of the TaSP–CM iterate \widehat{\mathbf{R}}^{E}(t) and the frozen-field Milstein series \mathbf{R}^{E}_{\delta}(t) on the \mathrm{SE}(n) block are identical to those on \mathrm{SO}(n) that analyzed in lemma 2 , hence \mathbb{E}\bigl[\sup_{0\leq t\leq T}\|\widehat{\mathbf{R}}^{E}(t)-\mathbf{R}^{E}_{\delta}(t)\|^{2}\bigr]=\mathcal{O}(\delta^{2}). For the translational part, as the sequence \widehat{\mathbf{p}}^{E}(t) runs in the flat space, we have that {\widehat{\nabla}_{j,j}^{\mathbf{R},m}}={\widehat{\mathcal{D}}_{j,j}^{\mathbf{R},m}} . Therefore \widehat{\mathbf{p}}(t)=\mathbf{p}_{\delta}(t) for every t . Therefore, we have \displaystyle\mathbb{E}\bigl[\sup_{0\leq t\leq T}\|\widehat{\mathbf{E}}(t)-\mathbf{E}_{\delta}(t)\|^{2}\bigr]=\mathbb{E}\bigl[\sup_{0\leq t\leq T}\|\widehat{\mathbf{R}}^{E}(t)-\mathbf{R}^{E}_{\delta}(t)\|^{2}\bigr]=\mathcal{O}(\delta^{2}). (36) Given eq. 36 , we follow the same argument in lemma 3 to get \displaystyle\mathbb{E}\bigl[\sup_{0\leq t\leq T}\|\mathbf{E}_{\delta}(t)-\mathbf{E}(t)\|^{2}\bigr]=\mathcal{O}(\delta^{2}). (37) Substituting ( 36 ) and ( 37 ) into ( 35 ) yields \mathbb{E}\bigl[\sup_{0\leq t\leq T}\|\widehat{\mathbf{E}}(t)-\mathbf{E}(t)\|^{2}\bigr]^{{\frac{1}{2}}}=\mathcal{O}(\delta), which completes our proof. \hfill\qed ∎