Bismut Formula for Intrinsic Derivative of DDSDEs with Singular Interactions The author is supported by NNSFC(12301180), RGC (21301925), NSFC/RGC JRS N-CityU165/25 and Research Centre for Nonlinear Analysis at Hong Kong PolyU. Panpan Ren Abstract In recent years, remarkable progress has been made for Distribution dependent stochastic equations (DDSDEs) with singular interactions, existing results include well-posedness, propagation of chaos, entropy-cost inequality and ergodicity. As a continuation to the existing study, in this paper we establish Bismut type formulas for the intrinsic derivative of DDSDEs with singular interactions, which extends the existing formula established for the case with Lions differentiable drifts. AMS subject Classification: 60B05, 60B10. Keywords: Intrinsic formula, Bismut formula, Distribution dependent SDEs, singular interaction. 1 Introduction Since 1996 when McKean [ 15 ] proposed a class of stochastic differential equations (SDEs) with distribution dependent drifts to characterize nonlinear Fokker-Planck equations, distribution dependent SDEs (also called McKean-Vlasov SDEs) have been intensively investigated. In recent years, some remarkable progress has been made for SDEs with singular interactions, where the drift contains convolutions of distribution with a singular kernel, which describes singular interaction in the corresponding mean-field particle system, see [ 5 , 7 , 8 , 9 , 10 , 13 , 14 ] and reference therein for the study on well-posedness, propagation of chaos, regularity estimates, and ergodicity. On the other hand, as a powerful tool characterizing the regularity of stochastic systems, the derivative formula initiated by Bismut [ 4 ] for the heat semigroup on manifolds has been extensively studied and applied to various models. In recent years, Bismut type derivative formulas with respect to the initial distribution have been established for distribution dependent SDEs, see [ 2 , 11 , 12 , 17 , 18 ] for the intrinsic/Lions derivative formulas, and see [ 16 ] for the extrinsic derivative formula. However, the existing Bismut formula for the intrinsic derivative requires that the drift is either Lions differentiable in the distribution variable [ 18 ] , or has half-Dini continuous extrinsic derivative [ 12 ] . These conditions excludes McKen-Vlasov SDEs with singular interactions, where the drift contains a term like (1.1) B_{t}(x,\mu)=(h_{t}*\mu)(x):=\int_{\mathbb{R}^{d}}h_{t}(x-y)\mu(\text{\rm{d}}y),\ \ \ t\geq 0,\ x\in\mathbb{R}^{d},\ \mu\in\hat{\mathscr{P}}, where h:[0,\infty)\times\mathbb{R}^{d}\rightarrow\mathbb{R}^{d} is measurable and singular in the spatial variable x\in\mathbb{R}^{d} , and \hat{\mathscr{P}} the set of probability measures on \mathbb{R}^{d} such that the convolution with h_{t} is well-defined. Typical examples of h_{t} include vector fields satisfying |h_{t}(x)|\leq\frac{ct^{\tau}}{|x|^{\beta}},\ \ \ x\neq 0,\ t\geq 0, for some constants \tau\geq 0,\beta\geq 0. It is the case when h_{t}(x)=\frac{ct^{\tau}x}{|x|^{\beta+1}},\ \ \ x\in\mathbb{R}^{d}\setminus\{0\},\ t\geq 0, for which b_{t}(x,\mu) is not intrinsically differentiable in \mu , and the extrinsic derivative is singular even if exists, so that existing Bismut formula for the intrinsic derivative of distribution dependent SDEs do not work. In this paper, we intend to establish the Bismut type derivative formula for the following McKean-VlSDE on \mathbb{R}^{d} with singular interaction given by ( 1.1 ): (1.2) \text{\rm{d}}X_{t}=\big(b_{t}(X_{t})+B_{t}(X_{t},\mathscr{L}_{X_{t}})\big)\text{\rm{d}}t+\sigma_{t}(X_{t})\text{\rm{d}}W_{t},\ \ t\in[0,T], where T>0 is a fixed time, W_{t} is the d -dimensional Brownian motion on a probability base (\Omega,\{\mathscr{F}_{t}\}_{t\in[0,T]},\mathscr{F},\mathbb{P}) , \mathscr{L}_{X_{t}} is the distribution of X_{t} , and b:[0,T]\times\mathbb{R}^{d}\rightarrow\mathbb{R}^{d},\ \ B:[0,T]\times\mathbb{R}^{d}\times\hat{\mathscr{P}}\rightarrow\mathbb{R}^{d},\ \ \sigma:[0,T]\times\mathbb{R}^{d}\rightarrow\mathbb{R}^{d}\otimes\mathbb{R}^{d} are measurable, where \hat{\mathscr{P}} is equipped with the weak topology. When different probability space are concerned, we use \mathscr{L}_{X_{t}|\mathbb{P}} to denote the distribution of X_{t} under probability \mathbb{P} , and let \mathscr{L}_{X_{[0,T]}|\mathbb{P}} be the distribution of the process (X_{t})_{t\in[0,T]} under \mathbb{P} . Definition 1.1 . A continuous adapted process (X_{t})_{t\in[0,T]} on \mathbb{R}^{d} is called a solution of ( 1.2 ), if \mathbb{P} -a.s. X_{t}=X_{0}+\int_{0}^{t}\big(b_{s}(X_{t})+B_{s}(X_{s},\mathscr{L}_{X_{s}})\big)\text{\rm{d}}s+\int_{0}^{t}\sigma_{s}(X_{s})\text{\rm{d}}W_{s},\ \ \ t\in[0,T], which means that the (stochastic) integrals in the right hand side are well-defined such that the equation holds. A couple (X_{t},W_{t})_{t\in[0,T]} is called a weak solution of ( 1.2 ), if there exists a probability base such that W_{t} is a d -dimensional Brownian motion and X_{t} solves ( 1.2 ). We call ( 1.2 ) has a unique weak solution with initial distribution \mu\in\mathscr{P} , if the weak solution exists, and for any two weak solutions (X_{t}^{i},W_{t}^{i})_{t\in[0,T]} with respect to probabilities \mathbb{P}^{i},i=1,2 we have \mathscr{L}_{X_{[0,T]}^{1}|\mathbb{P}^{2}}=\mathscr{L}_{X_{[0,T]}^{2}|\mathbb{P}^{2}} . Let \mathscr{P} be the set of all probability measures on \mathbb{R}^{d} equipped with the weak topology. For any p\in[1,\infty) , let \mathscr{P}_{p}:=\big\{\mu\in\mathscr{P}:\ \mu(|\cdot|^{p})<\infty\big\}. If for any \mathscr{F}_{0} -measurable initial value X_{0} with \mu=\mathscr{L}_{X_{0}}\in\mathscr{P}_{p} , the SDE ( 1.2 ) has a unique solution, we denote P_{t}^{*}\mu=\mathscr{L}_{X_{t}},\ \ \ t\in[0,T]. We study the intrinsic derivative of \mu\mapsto P_{t}f(\mu):=\int_{\mathbb{R}^{d}}f\text{\rm{d}}(P_{t}^{*}\mu) for t\in(0,T] and f\in\mathscr{B}_{b}(\mathbb{R}^{d}), where \mathscr{B}_{b}(\mathbb{R}^{d}) is the set of all bounded measurable functions on \mathbb{R}^{d} . The intrinsic derivative for measures was introduced in [ 1 ] to construct diffusion processes on the configuration space over Riemannian manifolds, and had been extended in [ 2 ] for functions on the L^{p} -Wasserstein space over a Banach space. For any \mu\in\mathscr{P}_{p} , the tangent space at \mu is T_{\mu,p}:=L^{k}(\mathbb{R}^{d}\rightarrow\mathbb{R}^{d};\mu). Then \mu\circ(id+\phi)^{-1}\in\mathscr{P}_{p} for \phi\in T_{\mu,p} , where id is the identity map on \mathbb{R}^{d} . Definition 1.2 . Let p\in(1,\infty) and f be a continuous function on \mathscr{P}_{p} . It is called intrinsically differentiable at a point \mu\in\mathscr{P}_{p} , if T_{\mu,p}\ni\phi\mapsto D_{\phi}f(\mu):=\lim_{\varepsilon\downarrow 0}\frac{f(\mu\circ(id+\varepsilon\phi)^{-1})-f(\mu)}{\varepsilon}\in\mathbb{R} is a well defined bounded linear functional. In this case, the intrinsic derivative is the unique element Df(\mu)\in T_{\mu,p}^{*}:=L^{\frac{p}{p-1}}(\mathbb{R}^{d}\rightarrow\mathbb{R}^{d};\mu) such that \int_{\mathbb{R}^{d}}\langle Df(\mu)(x),\phi(x)\rangle\mu(\text{\rm{d}}x)=D_{\phi}f(\mu),\ \ \phi\in T_{\mu,p}. In Section 2, we state the main result of the paper (Theorem 2.1), which provides a Bismut-type formula for the intrinsic derivative of McKean–Vlasov SDEs with singular interactions under assumption (H). In Section 3, we prove the first part of Theorem 2.1 (existence and moment estimate) by establishing well-posedness of the linearized derivative SDE (Lemma 3.1) and showing convergence of the solution process (Lemma 3.2). The estimates and techniques developed in Section 3 are then used in Section 4 to prove the second part of Theorem 2.1, namely the intrinsic Bismut formula (2.10) and its application to the semigroup (4.2). 2 Main result To characterize the singularity of coefficients b and \sigma in time-space variables, we recall some functional spaces introduced in [ 20 ] . For any p,q\geq 1 , let \tilde{L}_{q}^{p} denote the set of measurable functions f on [0,T]\times\mathbb{R}^{d} such that \|f\|_{\tilde{L}_{q}^{p}}:=\sup_{z\in\mathbb{R}^{d}}\bigg(\int_{0}^{T}\|1_{B(z,1)}f_{t}\|_{L^{p}(\mathbb{R}^{d})}^{q}\text{\rm{d}}t\bigg)^{\frac{1}{q}}<\infty, where B(z,1):=\{x\in\mathbb{R}^{d}:|x-z|\leq 1\} , and \|\cdot\|_{L^{p}(\mathbb{R}^{d})} is the L^{p} -norm with respect to the Lebesgue measure on \mathbb{R}^{d} . We will take (p,q) from the class \mathscr{K}:=\Big\{(p,q):p,q\in(2,\infty),\ \frac{d}{p}+\frac{2}{q}<1\Big\}. According to [ 9 ] , for any p\in[1,\infty] , \mathscr{P}_{p*}:=\bigg\{\mu\in\mathscr{P}:\ \|\mu\|_{p*}:=\sup_{f\in\mathscr{B}_{b}(\mathbb{R}^{d}),\|f\|_{\tilde{L}^{p}}\leq 1}|\mu(f)|<\infty\bigg\}, is a complete metric space under the p* -distance \|\mu-\nu\|_{p*}. It is clear that when p=\infty we have \mathscr{P}_{\infty*}=\mathscr{P} and \|\mu-\nu\|_{\infty*}=\|\mu-\nu\|_{var} is the variation distance. We make the following assumption on the coefficients of ( 1.2 ). (H) Let a_{t}(x):=(\sigma_{t}\sigma_{t}^{*})(x) and B_{t}(x,\mu) be given in ( 1.1 ) , where \sigma^{*} is the transposition of \sigma . (1) a_{t}(x) is invertible with \|a\|_{\infty}+\|a^{-1}\|_{\infty}<\infty , and \|\nabla\sigma\|\leq\sum_{i=1}^{l}f_{i} for some 0\leq f_{i}\in\tilde{L}_{q_{i}}^{p_{i}} and (p_{i},q_{i})\in\mathscr{K},\ 1\leq i\leq l. (2) b_{t}(x) satisfies \sup_{t\in[0,T],\ x\neq y}\bigg(|b_{t}(0)|+\frac{|b_{t}(x)-b_{t}(y)|}{|x-y|}\bigg)<\infty. (3) For any t\in[0,T] , \nabla h_{t}\in\tilde{L}^{k^{\prime}} and is a.e. continuous. There exist constants \kappa\geq 0,K>0,k\in(d,\infty] and k^{\prime}\in(1,\infty] such that \|h_{t}\|_{\tilde{L}^{k}}\leq K,\ \ \ \big\|\nabla h_{t}\big\|_{\tilde{L}^{k^{\prime}}}\leq Kt^{\kappa},\ \ t\in(0,T]. Since (H) implies (A_{1}) and (A_{2}) in [ 9 ] for p=\infty , according to [ 9 , Theorem 2.1(2)-(3)] , for any initial value (respectively, initial distribution), (H) implies that ( 1.2 ) has a unique solution satisfying (2.1) \sup_{t\in(0,T]}t^{\frac{d}{2k}}\|\mathscr{L}_{X_{t}}\|_{k*}<\infty,\ \ \ \mathbb{E}^{\mathscr{F}_{0}}\bigg[\sup_{t\in[0,T]}|X_{t}|^{n}\bigg]\leq C_{n}(1+|X_{0}|^{n}),\ \ n\in[1,\infty) for some C_{n}\in(0,\infty), where \mathbb{E}^{\mathscr{F}_{0}} is the conditional expectation given \mathscr{F}_{0} . For any \mu\in\mathscr{P} , let X_{t}^{\mu} be the unique solution with initial distribution \mu , and denote P_{t}^{*}\mu:=\mathscr{L}_{X_{t}^{\mu}},\ \ \ \ t\in[0,T],\ \mu\in\mathscr{P}. Since \|\mu\|_{p*}=1 for p=\infty , [ 9 , (2.2)] implies (2.2) \sup_{t\in(0,T],\mu\in\mathscr{P}}t^{\frac{d}{2k}}\|P_{t}^{*}\mu\|_{k*}<\infty. We intend to establish the Bismut type formula for the intrinsic derivative of \mu\mapsto P_{t}f(\mu):=\int_{\mathbb{R}^{d}}f\text{\rm{d}}(P_{t}^{*}\mu),\ \ \ \ t\in(0,T],\ f\in\mathscr{B}_{b}(\mathbb{R}^{d}). To this end, given \mu\in\mathscr{P} we recall the Bismut formula for the decoupled SDE (2.3) \text{\rm{d}}X_{t}^{\mu,x}=\big\{b_{t}(X_{t}^{\mu,x})+B_{t}(X_{t}^{\mu,x},P_{t}^{*}\mu)\big\}\text{\rm{d}}t+\sigma_{t}(X_{t}^{\mu,x})\text{\rm{d}}W_{t},\ \ \ (t,x)\in[0,T]\times\mathbb{R}^{d},\ X_{0}^{\mu,x}=x. By (H) (3) and ( 2.2 ), b_{t}^{\mu}(x):=B_{t}(x,P_{t}^{*}\mu) satisfies |b_{t}^{\mu}(x)|\leq K\|P_{t}^{*}\mu\|_{k*}\leq ct^{-\frac{d}{2k}},\ \ \ t\in(0,T], which together with k>d due to (H) (3) yields (2.4) \sup_{\mu\in\mathscr{P}}\|b^{\mu}\|_{\tilde{L}_{q_{0}}^{p_{0}}}<\infty\ \text{ for \ some\ }(p_{0},q_{0})\in\mathscr{K}. Combining this with (H) (1)-(2), we see that conditions (A^{1.1}),(A^{1.2}) and (A^{1.3}) in [ 19 ] hold, so that by [ 19 , Theorem 1.3.1 and Theorem 1.4.2] , see also [ 18 , Theorem 2.1] , \nabla_{v}X_{t}^{\mu,x}:=\lim_{\varepsilon\downarrow 0}\frac{X_{t}^{\mu,x+\varepsilon v}-X_{t}^{\mu,x}}{\varepsilon},\ \ \ t\in[0,T],\ x,v\in\mathbb{R}^{d} exists in L^{n}(\Omega\mapsto\mathbb{R}^{d},\mathbb{P}) for any n\in[1,\infty) , and there exists C:[1,\infty)\rightarrow(0,\infty) such that (2.5) \mathbb{E}\bigg[\sup_{t\in[0,T]}|X_{t}^{\mu,x}|^{n}\bigg]\leq C(n)(1+|x|^{n}),\ \ \ \mathbb{E}\bigg[\sup_{t\in[0,T]}|\nabla_{v}X_{t}^{\mu,x}|^{n}\bigg]\leq C(n)|v|^{n} holds for all \mu\in\mathscr{P},\ x,v\in\mathbb{R}^{d}, and n\in[1,\infty). Moreover, P_{t}^{\mu}f(x):=\mathbb{E}\big[f(X_{t}^{\mu,x})\big],\ \ \ t\in[0,T],\ x\in\mathbb{R}^{d},\ f\in\mathscr{B}_{b}(\mathbb{R}^{d}) satisfies the Bismut formula: for any t\in(0,T] and \beta\in C^{1}([0,1]) with \beta_{0}=0 and \beta_{t}=0 , (2.6) \nabla_{v}P_{t}^{\mu}f(x)=\mathbb{E}\bigg[f(X_{t}^{\mu,x})\int_{0}^{t}\beta_{s}^{\prime}\big\langle(\sigma_{s}a_{s}^{-1})(X_{s}^{\mu,x})\nabla_{v}X_{s}^{\mu,x},\text{\rm{d}}W_{s}\big\rangle\bigg],\ \ \ f\in\mathscr{B}_{b}(\mathbb{R}^{d}),\ x,v\in\mathbb{R}^{d}. Finally, by (H) (1)-(2) and ( 2.4 ), the conditions (C) and (A_{2}) in [ 9 ] hold, so by [ 9 , Proposition 5.4] , for any 1-1 , and let p\in[\frac{2k^{\prime}(\kappa+1)}{2k^{\prime}(\kappa+1)-d},\infty)\cap(\frac{k^{\prime}}{k^{\prime}-1},\infty) . Then the following assertions hold. (1) There exists a constant c\in(0,\infty) such that (2.8) \bigg(\mathbb{E}\Big[\big\|\nabla h_{t}(z-X_{t}^{\mu})\big\|^{\frac{p}{p-1}}\Big]\bigg)^{\frac{p-1}{p}}\leq ct^{\kappa-\frac{dp}{2k^{\prime}(p-1)}},\ \ \ t\in(0,T],\ z\in\mathbb{R}^{d},\ \mu\in\mathscr{P}. Moreover, for any \eta\in L^{p}(\Omega\rightarrow\mathbb{R}^{d},\mathscr{F}_{0},\mathbb{P}) , \nabla_{\eta}X_{t}^{\mu} exists in L^{p}(\Omega\rightarrow\mathbb{R}^{d},\mathbb{P}) and there exists a constant c\in(0,\infty) independent of \mu and \eta , such that (2.9) \sup_{t\in[0,T]}\mathbb{E}\Big[\big|\nabla_{\eta}X_{t}^{\mu}\big|^{p}\Big]\leq c\mathbb{E}[|\eta|^{p}]. (2) Denote \zeta=\sigma(\sigma\sigma^{*})^{-1} . For any \phi\in T_{\mu,p},f\in\mathscr{B}_{b}(\mathbb{R}^{d}) , t\in(0,T] and and \beta\in C^{1}([0,1]) with \beta_{0}=0 and \beta_{t}=0 , D_{\phi}P_{t}f(\mu) exists and (2.10) \begin{split}&D_{\phi}P_{t}f(\mu)=\int_{\mathbb{R}^{d}}\mathbb{E}\bigg[f(X_{t}^{\mu,x})\int_{0}^{t}\beta_{s}^{\prime}\big\langle\zeta_{s}(X_{s}^{\mu,x})\nabla_{\phi(x)}X_{s}^{\mu,x},\text{\rm{d}}W_{s}\big\rangle\bigg]\mu(\text{\rm{d}}x)\\ &+\mathbb{E}\bigg[f(X_{t}^{\mu})\int_{0}^{t}\Big\langle\zeta_{s}(X_{s}^{\mu})\mathbb{E}\big[\langle\nabla h_{s}(z-X_{s}^{\mu}),\nabla_{\phi(X_{0}^{\mu})}X_{s}^{\mu}\rangle\big]|_{z=X_{s}^{\mu}},\text{\rm{d}}W_{s}\Big\rangle\bigg].\end{split} Consequently, there exists a constant c>0 such that \|DP_{t}f(\mu)\|_{L^{\frac{p}{p-1}}(\mu)}\leq\frac{c}{\sqrt{t}}\big\|f(X_{t}^{\mu})\big\|_{L^{\frac{p}{p-1}}(\mathbb{P})},\ \ t\in(0,T],f\in\mathscr{B}_{b}(\mathbb{R}^{d}),\mu\in\mathscr{P}_{p}. By Zvonkin’s transform, one may allow the drift also contains local integrable terms in time-spatial, but the integrable indexes of these terms will lead restriction to the index p . Since our main concern is about the interaction kernel h_{t} , in this paper we do not consider this situation. Below we present an example to show that our result applies to irregular kernel h_{t} such that the convolution is not differentiable in distribution. Example 2.1 Let d\geq 2 . Consider the SDE ( 1.2 ) with singular interaction where B_{t}(x,\mu) is in ( 1.1 ) with h_{t} satisfying |h_{t}(z)|\leq Ct^{\kappa}|z|^{-\beta},\ \ \ \ t\in[0,T],\ 0\neq z\in\mathbb{R}^{d} for some constants \beta\in(0,1) and \kappa\in(\frac{\beta}{2},\infty) . Then (H) (3) holds for k\in(d,\frac{d}{\beta}) and k^{\prime}\in(1\lor\frac{d}{2\kappa+1},\frac{d}{\beta+1}). Therefore, if \sigma and b satisfy (H) (1)-(2), and \kappa>\frac{\beta}{2} , assertions in Theorem 2.1 hold for any p\in[\frac{2k^{\prime}(\kappa+1)}{2k^{\prime}(\kappa+1)-d},\infty)\cap(\frac{k^{\prime}}{k^{\prime}-1},\infty) . 3 Proof of Theorem 2.1 (1) By (H) (3) and ( 2.7 ) for i=0 , we find a constant c\in(0,\infty) independent of z and \mu such that \displaystyle\big(\mathbb{E}\|\nabla h_{t}\|(z-X_{t}^{\mu})\|^{\frac{p}{p-1}}\big)^{\frac{p-1}{p}}=\Big[\mu\Big(P_{t}^{\mu}\|\nabla h_{t}\|(z-\cdot)\|^{\frac{p}{p-1}}\Big)\Big]^{\frac{p-1}{p}} \displaystyle\leq\|P_{t}^{\mu}\|_{\tilde{L}^{\frac{k^{\prime}(p-1)}{p}}\rightarrow\tilde{L}^{\infty}}\big\|\nabla h_{t}(z-\cdot)\big\|_{\tilde{L}^{k^{\prime}}}\leq ct^{\kappa-\frac{dp}{2k^{\prime}(p-1)}},\ \ \ t\in(0,T]. So, ( 2.8 ) holds. It remains to prove the existence of \nabla_{\eta}X_{t}^{\mu} and to verify the estimate ( 2.9 ). This follows from the following two lemma. In the following, let \mu\in\mathscr{P} and \eta\in L^{p}(\Omega\rightarrow\mathbb{R}^{d},\mathscr{F}_{0},\mathbb{P}) be fixed, we simply denote X_{t}=X_{t}^{\mu},\ \ \ \mu_{t}=P_{t}^{*}\mu,\ \ \ t\in[0,T]. By formal calculations, if \nabla_{\eta}X_{t}^{\mu} exists then it satisfies the following SDE: (3.1) \begin{split}&\text{\rm{d}}v_{t}=\Big\{\nabla_{v_{t}}b_{t}(X_{t})+\nabla_{v_{t}}(h_{t}*\mu_{t})(X_{t})+\mathbb{E}\big[\nabla_{v_{t}}h_{t}(z-X_{t})\big]\big|_{z=X_{t}}\Big\}\text{\rm{d}}t\\ &\qquad\qquad\qquad+\nabla_{v_{t}}\sigma_{t}(X_{t})\text{\rm{d}}W_{t},\ \ t\in[0,T],\ v_{0}=\eta.\end{split} So, we first solve this SDE and estimate the moments of the solution. Lemma 3.1 . Assume (H) with 2\kappa-\frac{d}{k^{\prime}}>-1 and let p\in[\frac{2k^{\prime}(\kappa+1)}{2k^{\prime}(\kappa+1)-d},\infty) . Then for any \mu\in\mathscr{P} and \eta\in L^{p}(\Omega\rightarrow\mathbb{R}^{d},\mathscr{F}_{0},\mathbb{P}) , the SDE ( 3.1 ) has a unique solution satisfying (3.2) \rho_{T}(v):=\bigg(\mathbb{E}\Big[\sup_{t\in[0,T]}|v_{t}|^{p}\Big]\bigg)^{\frac{1}{p}}<\infty. Moreover, for any n\geq 1 there exists a constant c\in(0,\infty) independent of \mu and \eta , such that (3.3) \sup_{t\in[0,T]}\mathbb{E}\big[|v_{t}|^{n}\big|\mathscr{F}_{0}\big]\leq c|\eta|^{n}. Proof. We first verify ( 3.3 ), then prove the well-posedness for bounded \|\nabla\sigma\| , and finally make extension by mollifier approximation. (a) Proof of ( 3.3 ). Let v=(v_{t})_{t\in[0,T]} solve ( 3.1 ) satisfying ( 3.2 ). Since p\in[\frac{2k^{\prime}(\kappa+1)}{2k^{\prime}(\kappa+1)-d},\infty) , we have (3.4) \kappa-\frac{dp}{2k^{\prime}(p-1)}>-1. By ( 2.8 ) and Hölder’s inequality, we obtain (3.5) \begin{split}&\big|\nabla_{v_{s}}(h_{s}*\mu_{s})(z)\big|+\Big|\mathbb{E}\big[\nabla_{v_{s}}h_{s}(z-X_{s})\big]\Big|\\ &\leq\Big(|v_{s}|+\big(\mathbb{E}|v_{s}|^{p}\big)^{\frac{1}{p}}\Big)\Big(\mathbb{E}\big[|\nabla h_{s}(z-X_{s})|^{\frac{p}{p-1}}\big]\Big)^{\frac{p-1}{p}}\\ &\leq c\Big(|v_{s}|+\big(\mathbb{E}|v_{s}|^{p}\big)^{\frac{1}{p}}\Big)s^{\kappa-\frac{dp}{2k^{\prime}(p-1)}},\ \ \ s\in(0,T],\ z\in\mathbb{R}^{d}.\end{split} Combining this with (H) (1)-(2) and Itô’s formula, for any n\geq p , we find a constant c_{1}(n)\in(0,\infty) such that \text{\rm{d}}|v_{t}|^{2n}\leq c_{1}(n)\Big[|v_{t}|^{2n}\big(t^{\kappa-\frac{dp}{2k^{\prime}(p-1)}}+\|\nabla\sigma_{t}(X_{t})\|^{2}\big)+t^{\kappa-\frac{dp}{2k^{\prime}(p-1)}}\big(\mathbb{E}|v_{t}|^{p}\big)^{\frac{2n}{p}}\Big]\text{\rm{d}}t+\text{\rm{d}}M_{t} for some martingale M_{t} . By the stochastic Gronwall inequality for the conditional expectation \mathbb{E}^{\mathscr{F}_{0}}:=\mathbb{E}(\cdot|\mathscr{F}_{0}) , see for instance [ 19 , Lemma 1.3.3] for q=\frac{1}{2} and p=\frac{3}{4} , we find a constant c_{2}\in(0,\infty) such that \mathbb{E}^{\mathscr{F}_{0}}\bigg[\sup_{s\in[0,t]}|v_{s}|^{n}\bigg]\leq c_{2}\mathbb{E}^{\mathscr{F}_{0}}\Big[\text{\rm{e}}^{c_{2}\int_{0}^{t}\|\nabla\sigma_{s}(X_{s})\|^{2}\text{\rm{d}}s}\Big]\bigg(|\eta|^{2n}+\int_{0}^{t}s^{\kappa-\frac{dp}{2k^{\prime}(p-1)}}\big(\mathbb{E}|v_{s}|^{p}\big)^{\frac{2n}{p}}\text{\rm{d}}s\bigg)^{\frac{1}{2}}. Combining this with the Krylov and Khasminskii estimates, see for instance [ 19 , Theorem 1.2.3(2) and Theorem 1.2.4] , we find a constant c_{3}\in(0,\infty) such that (3.6) \mathbb{E}^{\mathscr{F}_{0}}\bigg[\sup_{s\in[0,t]}|v_{s}|^{n}\bigg]\leq c_{3}|\eta|^{n}+c_{3}\bigg(\int_{0}^{t}s^{\kappa-\frac{dp}{2k^{\prime}(p-1)}}\big(\mathbb{E}|v_{s}|^{p}\big)^{\frac{2n}{p}}\text{\rm{d}}s\bigg)^{\frac{1}{2}}. Taking n=p this implies \mathbb{E}\big[|v_{t}|^{p}\big]\leq\mathbb{E}\bigg[\mathbb{E}^{\mathscr{F}_{0}}\bigg(\sup_{s\in[0,t]}|v_{s}|^{p}\bigg)\bigg]\leq c_{3}\mathbb{E}\big[|\eta|^{p}\big]+c_{3}\bigg(\int_{0}^{t}s^{\kappa-\frac{dp}{2k^{\prime}(p-1)}}\big(\mathbb{E}|v_{s}|^{p}\big)^{2}\text{\rm{d}}s\bigg)^{\frac{1}{2}}. By ( 3.4 ), this together with ( 3.2 ) implies \mathbb{E}\big[|v_{s}|^{p}\big]\leq c(p)(1+\mathbb{E}[|\eta|^{p}]),\ \ \ s\in[0,T] for some constant c(p)\in[0,\infty]. Substituting into ( 3.6 ) we prove ( 3.3 ). (b) The well-posedness of ( 3.1 ) for bounded \|\nabla\sigma\| . Let \mathscr{V}_{T} be the space of all adapted continuous process v=(v_{t})_{t\in[0,T]} on \mathbb{R}^{d} satisfying ( 3.2 ). For any \lambda\in[0,\infty) , \mathscr{V}_{T} is a complete space under the metric \rho_{T,\lambda}(v,w):=\sup_{t\in[0,T]}\text{\rm{e}}^{-\lambda t}\bigg(\mathbb{E}\Big[\sup_{s\in[0,t]}|v_{s}-w_{s}|^{p}\Big]\bigg)^{\frac{1}{p}},\ \ \ v,w\in\mathscr{V}_{T}. For any v\in\mathscr{V}_{T}, define \psi(v)=(\psi_{t}(v))_{t\in[0,T]} by (3.7) \begin{split}\psi_{t}(v):=\eta+&\int_{0}^{t}\Big\{\nabla_{v_{s}}b_{s}(X_{s})+\nabla_{v_{s}}(h_{s}*\mu_{s})(X_{s})+\mathbb{E}\big[\nabla_{v_{s}}h_{s}(z-X_{s})\big]\big|_{z=X_{s}}\Big\}\text{\rm{d}}s\\ &+\int_{0}^{t}\nabla_{v_{s}}\sigma_{s}(X_{s})\text{\rm{d}}W_{s},\ \ \ t\in[0,T].\end{split} By (H) (2) and ( 3.2 ) for w in place of , there exists a constant c_{1}\in(0,\infty) such that (3.8) \mathbb{E}\int_{0}^{T}|\nabla_{v_{s}}b_{s}(X_{s})|^{p}\text{\rm{d}}s\leq c_{1}\int_{0}^{T}\mathbb{E}\big[|v_{s}|^{p}\big]\text{\rm{d}}s\leq c_{1}\rho_{T}(v)^{p}<\infty. Noting that for any z\in\mathbb{R}^{d} , \displaystyle\big|\nabla_{v_{s}}(h_{s}*\mu_{s})(z)\big|\leq|v_{s}|\mathbb{E}\big[|\nabla h_{s}(z-X_{s})|\big]\leq|v_{s}|\Big(\mathbb{E}\big[|\nabla h_{s}(z-X_{s})|^{\frac{p}{p-1}}\big]\Big)^{\frac{p-1}{p}}, \displaystyle\big|\mathbb{E}\big[\nabla_{v_{s}}h_{s}(z-X_{s})]\big|\leq\Big(\mathbb{E}\big[|v_{s}|^{p}\big]\Big)^{\frac{1}{p}}\Big(\mathbb{E}\big[|\nabla h_{s}(z-X_{s})|^{\frac{p}{p-1}}\big]\Big)^{\frac{p-1}{p}}, by ( 2.8 ) and ( 3.4 ), we find a constant c_{2}\in(0,\infty) such that (3.9) \begin{split}&\mathbb{E}\bigg(\int_{0}^{T}\Big(\big|\nabla_{v_{s}}(h_{s}*\mu_{s})(X_{s})\big|+\Big|\mathbb{E}\big[\nabla_{v_{s}}h_{s}(z-X_{s})\big]\big|_{z=X_{s}}\Big|\Big)\text{\rm{d}}s\bigg)^{p}\\ &\leq\sup_{z\in\mathbb{R}^{d}}\mathbb{E}\bigg(\int_{0}^{T}\Big(|v_{s}|+\big(\mathbb{E}|v_{s}|^{p}\big)^{\frac{1}{p}}\Big)\Big(\mathbb{E}\big[|\nabla h_{s}(z-X_{s})|^{\frac{p}{p-1}}\big]\Big)^{\frac{p-1}{p}}\text{\rm{d}}s\bigg)^{p}\\ &\leq c_{2}\mathbb{E}\bigg[\sup_{t\in[0,T]}|v_{s}|^{p}\bigg]\bigg(\int_{0}^{T}s^{\kappa-\frac{dp}{2k^{\prime}(p-1)}}\text{\rm{d}}s\bigg)^{p}<\infty.\end{split} Moreover, by the Burkholder-Davis-Gundy inequality, \|\nabla\sigma\|_{\infty}<\infty as assumed in the moment, and ( 3.2 ), we find a constant c_{3}\in(0,\infty) such that \displaystyle\mathbb{E}\bigg[\sup_{t\in[0,T]}\bigg|\int_{0}^{t}\nabla_{v_{s}}\sigma_{s}(X_{s})\text{\rm{d}}W_{s}\bigg|^{p}\bigg]\leq c_{3}\mathbb{E}\bigg(\int_{0}^{T}|v_{s}|^{2}\text{\rm{d}}s\bigg)^{\frac{p}{2}}<\infty. Combining this with ( 3.7 )-( 3.9 ), we obtain \psi(v)\in\mathscr{V}_{T} , so that \psi:\mathscr{V}_{T}\rightarrow\mathscr{V}_{T}. Similarly, by (H) , ( 2.8 ) and Jensen’s inequality, we find constants c_{4},c_{5},c_{6}\in(0,\infty) such that for any v,w\in\mathscr{V}_{T}, \displaystyle\mathbb{E}\bigg[\sup_{s\in[0,t]}|\psi_{s}(v)-\psi_{s}(w)|^{p}\bigg] \displaystyle\leq c_{4}\mathbb{E}\bigg(\int_{0}^{t}\Big[|v_{s}-w_{s}|+\big(\mathbb{E}|v_{s}-w_{s}|^{p}\big)^{\frac{1}{p}}\Big]s^{\kappa-\frac{dp}{2k^{\prime}(p-1)}}\text{\rm{d}}s\bigg)^{p}+c_{5}\mathbb{E}\bigg(\int_{0}^{t}|v_{s}-w_{s}|^{2}\text{\rm{d}}s\bigg)^{\frac{p}{2}} \displaystyle\leq c_{6}\int_{0}^{t}\mathbb{E}\big[|v_{s}-w_{s}|^{p}\big]s^{\kappa-\frac{dp}{2k^{\prime}(p-1)}}\text{\rm{d}}s+c_{5}\mathbb{E}\bigg(\int_{0}^{t}|v_{s}-w_{s}|^{2}\text{\rm{d}}s\bigg)^{\frac{p}{2}}. Combining this with ( 3.4 ), we conclude that for \lambda\in(0,\infty) large enough, (3.10) \begin{split}&\rho_{T,\lambda}\big(\psi(v),\psi(w)\big)^{p}=\sup_{t\in[0,T]}\text{\rm{e}}^{-\lambda t}\mathbb{E}\bigg[\sup_{s\in[0,t]}|\psi_{s}(v)-\psi_{s}(w)|^{p}\bigg]\\ &\leq\rho_{T,\lambda}(v,w)^{p}\sup_{t\in[0,T]}\bigg[\int_{0}^{t}\text{\rm{e}}^{-\lambda p(t-s)}s^{\kappa-\frac{dp}{2k^{\prime}(p-1)}}\text{\rm{d}}s+\bigg(\int_{0}^{t}\text{\rm{e}}^{-2\lambda(t-s)}\text{\rm{d}}s\bigg)^{\frac{p}{2}}\bigg]\\ &\leq\frac{1}{2}\rho_{T,\lambda}(w,\tilde{w})^{p},\ \ \ v,w\in\mathscr{V}_{T}.\end{split} By the Banach fixed point theorem, this implies that \psi has a unique fixed point v\in\mathscr{V}_{T} , which is the unique solution to ( 3.1 ) satisfying ( 3.2 ). (c) Well-posedness of ( 3.1 ) under (H) . We will make approximations of \nabla\sigma_{t} as follows. For any m\in\mathbb{N} , define the linear operator Q_{m}(t):\mathbb{R}^{d}\rightarrow\mathbb{R}^{d}\otimes\mathbb{R}^{d} satisfying \big(Q_{m}(t)e_{k}\big)_{ij}=\max\Big(-m,m\land\big(\partial_{k}(\nabla\Theta_{t})\sigma_{t}\big)_{ij}(X_{t})\Big),\ \ \ 1\leq i,j,k\leq d, where \{e_{k}\}_{1\leq k\leq d} is the standard ONB of \mathbb{R}^{d} . Then \lim_{m\rightarrow\infty}Q_{m}(t)=\big(\nabla\sigma_{t}\big)(X_{t}) and by (H) , there exists a constant c>0 such that (3.11) \sup_{m\geq 1}\|Q_{m}(t)\|^{2}\leq\leq c+c\sum_{i=0}^{l}f_{i}(t,X_{t})^{2}=:f(t,X_{t})^{2}. So, by Krylov’s estimate and dominated convergence theorem, (3.12) \lim_{m\rightarrow\infty}\mathbb{E}\bigg(\int_{0}^{T}\Big\|Q_{m}(t)-\nabla\big\{\partial_{k}\sigma_{t}\big\}(X_{t})\Big\|^{2}\text{\rm{d}}s\bigg)^{p}=0,\ \ \ p\in[1,\infty). By (a) and (b), the SDE ( 3.1 ) with Q_{n}(t) in place of \nabla\sigma_{t}(X_{t}) has a unique solution v_{t}^{n} satisfying ( 3.3 ). For any m,m^{\prime}\geq 1 , we have \displaystyle\text{\rm{d}}\big(v_{t}^{m}-v_{t}^{m^{\prime}}\big)=\Big(\nabla_{v_{t}^{m}-v_{t}^{m^{\prime}}}b_{t}(X_{t}^{\mu})+\nabla_{v_{t}^{m}-v_{t}^{m^{\prime}}}(h_{t}*\mu_{t})(X_{t})+\mathbb{E}\big[\nabla_{v_{t}^{m}-v_{t}^{m^{\prime}}}h_{t}(z-X_{t})\big]\big|_{z=X_{t}}\Big)\text{\rm{d}}t \displaystyle\qquad+\Big[\nabla_{v_{t}^{m}-v_{t}^{m^{\prime}}}Q_{m}(t)+\nabla_{v_{t}^{m^{\prime}}}\big(Q_{m}(t)-Q_{m^{\prime}}(t)\big)\Big]\text{\rm{d}}W_{t},\ \ t\in[0,T],\ v_{0}^{m}-v_{0}^{n}=0. So, by (H) (1)-(2), ( 3.5 ) for v_{t} in place of v_{t}^{m}-v_{t}^{m^{\prime}} and ( 3.11 ), for any n\geq p we find a constant C_{1}\in(0,\infty) such that \displaystyle\text{\rm{d}}\big|v_{t}^{m}-v_{t}^{m^{\prime}}\big|^{2n}\leq C_{1}\Big(1+t^{\kappa-\frac{dp}{2k^{\prime}(p-1)}}+f(t,X_{t})^{2}\|^{2}\Big)(X_{t})\big|v_{t}^{m}-v_{t}^{m^{\prime}}\big|^{2n}\text{\rm{d}}t \displaystyle\qquad+\Big[\big(\mathbb{E}\big|v_{t}^{m}-v_{t}^{m^{\prime}}\big|^{p}\big)^{\frac{2n}{p}}t^{\kappa-\frac{dp}{2k^{\prime}(p-1)}}+\|v_{t}^{n}\|^{2n}\|Q_{m}(t)-Q_{m^{\prime}}(t)\|^{2}\Big]\text{\rm{d}}t+\text{\rm{d}}M_{t},\ \ t\in[0,T]. By the stochastic Gronwall inequality and Khasminskii inequality as in step (a), we find constants C_{2},C_{3}\in(0,\infty) such that \displaystyle\bigg(\mathbb{E}^{\mathscr{F}_{0}}\bigg[\sup_{s\in[0,t]}\big|v_{s}^{m}-v_{s}^{m^{\prime}}\big|^{n}\bigg]\bigg)^{2} \displaystyle\leq C_{2}\int_{0}^{t}\Big(\big(\mathbb{E}\big|v_{s}^{m}-v_{s}^{m^{\prime}}\big|^{p}\big)^{\frac{2n}{p}}s^{\kappa-\frac{dp}{2k^{\prime}(p-1)}}+\mathbb{E}^{\mathscr{F}_{0}}\big[\|v_{s}^{m^{\prime}}\|^{2n}\|Q_{m}(t)-Q_{m^{\prime}}(t)\|^{2}\big]\Big)\text{\rm{d}}s. Moreover, by ( 3.3 ) for v_{t}^{m^{\prime}} in place of v_{t} , and by Krylov’s estimate, see for instance [ 19 , Theorem 1.3.3(2)] , we find a constant C_{3}\in(0,\infty) and some positive constants \varepsilon_{m,m^{\prime}}\rightarrow 0 as m,m^{\prime}\rightarrow\infty due to ( 3.11 ) and ( 3.12 ), such that \displaystyle\mathbb{E}^{\mathscr{F}_{0}}\int_{0}^{t}\|v_{s}^{m^{\prime}}\|^{2n}\|\nabla(\sigma_{s}^{m}-\sigma_{s}^{m^{\prime}})\|^{2}\text{\rm{d}}s \displaystyle\leq C_{2}\bigg(\mathbb{E}^{\mathscr{F}_{0}}\Big[\sup_{s\in[0,t]}\|v_{s}^{m^{\prime}}\|^{4n}\bigg)^{\frac{1}{2}}\bigg(\mathbb{E}\bigg|\int_{0}^{t}\|Q_{m}(t)-Q_{m^{\prime}}(t))\|^{2}\text{\rm{d}}s\bigg|^{2}\bigg)^{\frac{1}{2}} \displaystyle\leq C_{3}|\eta|^{2n}\varepsilon_{m,m^{\prime}},\ \ \ t\in[0,T],\ m,m^{\prime}\geq 1. By choosing n=p and taking expectation, we find a constant C\in(0,\infty) such that \displaystyle\mathbb{E}\bigg[\sup_{s\in[0,t]}\big|v_{s}^{m}-v_{s}^{m^{\prime}}\big|^{p}\bigg] \displaystyle\leq C\bigg(\int_{0}^{t}\Big(\big(\mathbb{E}\big|v_{s}^{m}-v_{s}^{m^{\prime}}\big|^{p}\big)^{2}s^{\kappa-\frac{dp}{2k^{\prime}(p-1)}}\text{\rm{d}}s\bigg)^{\frac{1}{2}}+C\varepsilon_{m,m^{\prime}},\ \ \ t\in[0,T],\ m,m^{\prime}\geq 1. By combining this with \kappa-\frac{dp}{2k^{\prime}(p-1)}>-1 , v_{t}^{m},v_{t}^{m^{\prime}}\in\mathscr{V}_{T} so that \rho_{T}(w^{m}-v^{m^{\prime}})<\infty, and \varepsilon_{m}+\varepsilon_{m^{\prime}}\rightarrow 0 as m,m^{\prime}\rightarrow\infty , we conclude that \{v^{m}\}_{m\geq 1} is a Cauchy sequence in \mathscr{V}_{T} and the limit v=\lim_{m\rightarrow\infty}v^{m} is a solution of ( 3.1 ). The uniqueness follows by applying Itô’s formula and stochastic Gronwall’s inequality to |v_{t}-\tilde{v}_{t}|^{2p} as above for two solutions v_{t} and \tilde{v}_{t} . ∎ Lemma 3.2 . Assume (H) with 2\kappa-\frac{d}{k^{\prime}}>-1 and let p\in[\frac{2k^{\prime}(\kappa+1)}{2k^{\prime}(\kappa+1)-d},\infty) . Let v_{t} solve ( 3.1 ) satisfying \eqref{NB}, and let v_{t}^{\varepsilon}:=\frac{X_{t}^{\varepsilon\eta,\mu}-X_{t}^{\mu}}{\varepsilon} for \varepsilon>0,\ t\in[0,T]. Then \lim_{\varepsilon\downarrow 0}\mathbb{E}\bigg[\sup_{t\in[0,T]}\big|v_{t}^{\varepsilon}-v_{t}\big|^{p}\bigg]=0. Proof. We complete the proof by three steps. (a) We claim that for any n\in[1,\infty) there exists a constant K_{n}\in(0,\infty) such that (3.13) \mathbb{E}^{\mathscr{F}_{0}}\bigg[\sup_{t\in[0,T]}|v_{t}^{\varepsilon}|^{n}\bigg]\leq K_{n}|\eta|^{n},\ \ \ \varepsilon\in(0,1]. To this end, denote X_{t}^{\varepsilon}:=X_{t}^{\varepsilon\eta,\mu},\ \ \ \mu_{t}^{\varepsilon}:=\mathscr{L}_{X_{t}^{\varepsilon}}=P_{t}^{*}\mathscr{L}_{X_{0}^{\mu}+\varepsilon\eta}, and let (Y_{t}^{\varepsilon})_{t\in[0,T]} solve the SDE \text{\rm{d}}Y_{t}^{\varepsilon}=\big\{b_{t}(Y_{t}^{\varepsilon})+B_{t}(Y_{t}^{\varepsilon},\mu_{t})\big\}\text{\rm{d}}t+\sigma_{t}(Y_{t}^{\varepsilon})\text{\rm{d}}W_{t},\ \ \ Y_{0}^{\varepsilon}=X_{0}^{\varepsilon}=X_{0}^{\mu}+\varepsilon\eta,\ \ \ t\in[0,T]. By \|\nabla b\|_{\infty}<\infty due to (A) , we find a martingale M_{t} and a constant D_{n}\in(0,\infty) such that (3.14) \begin{split}&\text{\rm{d}}|Y_{t}^{\varepsilon}-X_{t}^{\varepsilon}|^{2n}\leq\text{\rm{d}}M_{t}+2n(2n-1)|X_{t}^{\varepsilon}-Y_{t}^{\varepsilon}|^{2n-2}\|\sigma_{t}(Y_{t}^{\varepsilon})-\sigma_{t}(X_{t}^{\varepsilon})\|_{HS}^{2}\text{\rm{d}}t\\ &+D_{n}|X_{t}^{\varepsilon}-Y_{t}^{\varepsilon}|^{2n-1}\big(1+|(h_{t}*\mu_{t}^{\varepsilon})(Y_{t}^{\varepsilon})-(h_{t}*\mu_{t}^{\varepsilon})(X_{t}^{\varepsilon})+(h_{t}*(\mu_{t}-\mu_{t}^{\varepsilon}))(Y_{t}^{\varepsilon})\big|\big)\text{\rm{d}}t.\end{split} By ( 3.5 ), we obtain (3.15) \begin{split}&\big|(h_{t}*\mu_{t}^{\varepsilon})(Y_{t}^{\varepsilon})-(h_{t}*\mu_{t}^{\varepsilon})(X_{t}^{\varepsilon})\big|\leq\int_{0}^{1}\Big|\nabla_{Y_{t}^{\varepsilon}-X_{t}^{\varepsilon}}h_{t}\big(rX_{t}^{\varepsilon}+(1-r)Y_{t}^{\varepsilon}\big)\Big|\text{\rm{d}}r\\ &\leq c\Big(|X_{t}^{\varepsilon}-Y_{t}^{\varepsilon}|+\big(\mathbb{E}[|X_{t}^{\varepsilon}-Y_{t}^{\varepsilon}|^{p}]\big)^{\frac{1}{p}}\Big)t^{\kappa-\frac{dp}{2k^{\prime}(p-1)}},\ \ \ t\in(0,T].\end{split} Next, noting that \mathbb{W}_{1}(\mu_{0},\mu_{0}^{\varepsilon})\leq\mathbb{E}[|\varepsilon\eta|]\leq\varepsilon\big(\mathbb{E}[|\eta|^{p}]\big)^{\frac{1}{p}}<\infty,\ \ \varepsilon\in(0,1], by (H) (3) and [ 9 , Theorem 2.3(1)] for p=\infty and q=1 , we find a constant c_{0}\in(0,\infty) such that (3.16) \big\|h_{t}*(\mu_{t}-\mu_{t}^{\varepsilon})\big\|_{\infty}\leq\|h_{t}\|_{\tilde{L}^{k}}\|\mu_{t}-\mu_{t}^{\varepsilon}\|_{k*}\leq c_{0}\varepsilon t^{-\frac{1}{2}-\frac{d}{2k}},\ \ \ t\in(0,T]. Moreover, by the maximal function estimate [ 20 , Lemma 2.1] , we find a constant c_{1}\in(0,\infty) such that (3.17) \begin{split}&\|f(x)-f(y)\|\leq c_{1}|x-y|\big(\|f\|_{\infty}+\mathscr{M}f(x)+\mathscr{M}f(y)\big),\\ &\|\mathscr{M}f\|_{\tilde{L}_{q}^{p}}\leq c_{p,q}\|f\|_{\tilde{L}_{q}^{p}},\ \ \ p,q\in(1,\infty),\ x,y\in\mathbb{R}^{d},\end{split} where f is a nonnegative continuous function on \mathbb{R}^{d} , c_{p,q}\in(0,\infty) , and \mathscr{M}f(x):=\sup_{r\in(0,1)}\frac{1}{|B(0,r)|}\int_{B(0,r)}f(z)\text{\rm{d}}z. Combining ( 3.14 )-( 3.17 ), and noting that r_{0}:=\min\Big\{-\frac{1}{2}-\frac{d}{2k},\ \kappa-\frac{dp}{2k^{\prime}(p-1)}\Big\}>-1, we find a constant c_{2}\in(0,\infty) such that (3.18) \begin{split}&\text{\rm{d}}|Y_{t}^{\varepsilon}-X_{t}^{\varepsilon}|^{2n}\leq\text{\rm{d}}M_{t}+c_{2}\Big(\big(\mathbb{E}|X_{t}^{\varepsilon}-Y_{t}^{\varepsilon}|^{p}\big)^{\frac{2n}{p}}+\varepsilon^{n}\Big)t^{r_{0}}\text{\rm{d}}t\\ &\quad+c_{2}|X_{t}^{\varepsilon}-Y_{t}^{\varepsilon}|^{2n}\big(t^{r_{0}}+\mathscr{M}\|\sigma_{t}\|^{2}(X_{t}^{\varepsilon})+\mathscr{M}\|\sigma_{t}\|^{2}(Y_{t}^{\varepsilon})\big)\text{\rm{d}}t,\ \ \ t\in[0,T].\end{split} By the stochastic Gronwall’s inequality and Khasminskii’s inequality as in the proof of Lemma 3.1 , we find a constant c_{3}\in(0,\infty) such that ( 3.18 ) implies (3.19) \begin{split}&\bigg(\mathbb{E}\bigg[\sup_{s\in[0,t]}|Y_{s}^{\varepsilon}-X_{s}^{\varepsilon}|^{n}\bigg]\bigg)^{2}\\ &\leq c_{3}\int_{0}^{t}\Big(\big(\mathbb{E}|X_{s}^{\varepsilon}-Y_{s}^{\varepsilon}|^{p}\big)^{\frac{2n}{p}}+\varepsilon^{n}\Big)s^{r_{0}}\text{\rm{d}}s,\ \ t\in[0,T].\end{split} By ( 2.1 ) and r_{0}>-1 , the upper bound is finite. So, taking n=p we find a constant c_{4}\in(0,\infty) such that \mathbb{E}\bigg[\sup_{t\in[0,T]}|Y_{t}^{\varepsilon}-X_{t}^{\varepsilon}|^{p}\bigg]\leq c_{4}\varepsilon^{p},\ \ \ \varepsilon\in(0,1]. Substituting into ( 3.19 ) we find a constant c_{5}\in(0,\infty) such that (3.20) \mathbb{E}\bigg[\sup_{t\in[0,T]}|Y_{t}^{\varepsilon}-X_{t}^{\varepsilon}|^{n}\bigg]\leq c_{5}\varepsilon^{n},\ \ \ \varepsilon\in(0,1]. On the other hand, letting X_{t}^{\mu,x} solve ( 2.3 ) for random x measurable with respect to \mathscr{F}_{0} , we have Y_{t}^{\varepsilon}=X-t^{\mu,X_{0}^{\mu}+\varepsilon\eta},\ \ \ X_{t}=X_{t}^{\mu,X_{0}^{\mu}}. So, by the second inequality in ( 2.3 ), we obtain \mathbb{E}^{\mathscr{F}_{0}}\bigg[\sup_{t\in[0,T]}|X_{t}-Y_{t}^{\varepsilon}|^{n}\bigg]=\mathbb{E}^{\mathscr{F}_{0}}\bigg[\sup_{t\in[0,T]}|X_{t}^{\mu,x}-X_{t}^{\mu,y}|^{n}\bigg]\bigg|_{(x,y)=(X_{0}^{\mu},X_{0}^{\mu}+\varepsilon\eta)}\leq C(n)\varepsilon^{n}|\eta|^{n}. Noting that v_{t}^{\varepsilon}=\frac{X_{t}^{\varepsilon}-X_{t}}{\varepsilon} , this together with ( 3.20 ) implies ( 3.13 ) for some K_{n}\in(0,\infty). (b) By ( 2.5 ) and noting that X_{t}=X_{t}^{\mu}=X_{t}^{\mu,X_{0}^{\mu}} , we find a constant C(p,\varepsilon)\in(0,\infty) such that (3.21) \mathbb{E}\bigg[\sup_{t\in[0,T]}|v_{t}^{\varepsilon}|^{p}\bigg]=\mathbb{E}\bigg(\mathbb{E}^{\mathscr{F}_{0}}\Big[\sup_{t\in[0,T]}|v_{t}^{\varepsilon}|^{p}\Big]\bigg)\leq C(p,\varepsilon)\mathbb{E}\big[1+|X_{0}^{\mu}|^{p}+|\eta|^{p}\big]<\infty. This together with Lemma 3.1 implies (3.22) H_{t}:=\mathbb{E}\bigg[\sup_{s\in[0,t]}|v_{s}^{\varepsilon}-v_{s}|^{p}\bigg]<\infty,\ \ \ t\in[0,T]. Let \displaystyle\eta_{s}^{\varepsilon}:=\varepsilon\eta+\frac{\sigma_{s}(X_{s}^{\varepsilon})-\sigma_{s}(X_{s})}{\varepsilon}-\nabla_{v_{s}^{\varepsilon}}\sigma_{s}(X_{s}), \displaystyle\xi_{s}^{\varepsilon}:=\frac{b_{s}(X_{s}^{\varepsilon})-b_{s}(X_{s})}{\varepsilon}-\nabla_{v_{s}^{\varepsilon}}b_{s}(X_{s}) \displaystyle\qquad+\frac{(h_{s}*\mu_{s})(X_{s}^{\varepsilon})-(h_{s}*\mu_{s})(X_{s})}{\varepsilon}-\nabla_{v_{s}^{\varepsilon}}(h_{s}*\mu_{s})(X_{s}) \displaystyle\qquad+\mathbb{E}\Big[\frac{h_{s}(z-X_{s}^{\varepsilon})-h_{s}(z-X_{s})}{\varepsilon}-\nabla_{v_{s}^{\varepsilon}}h_{s}(z-X_{s})\Big]\Big|_{z=X_{s}^{\varepsilon}} \displaystyle\qquad+\mathbb{E}\big[\nabla_{v_{s}^{\varepsilon}}h_{s}(z-X_{s})-\nabla_{v_{s}^{\varepsilon}}h_{s}(z^{\prime}-X_{s})\big]\big|_{z=X_{s}^{\varepsilon},z^{\prime}=X_{s}}. Then \displaystyle v_{t}^{\varepsilon}-v_{t}=\int_{0}^{t}\Big(\nabla_{v_{s}^{\varepsilon}-v_{s}}b_{s}(X_{s})+\nabla_{v_{s}^{\varepsilon}-v_{s}}(h_{s}*\mu_{s})(X_{s})+\mathbb{E}\big[\nabla_{v_{s}^{\varepsilon}-v_{s}}h_{s}(z-X_{s})\big]\big|_{z=X_{s}}\Big)\text{\rm{d}}s \displaystyle\qquad+\int_{0}^{t}\nabla_{v_{s}^{\varepsilon}-v_{s}}\sigma_{s}(X_{s})\text{\rm{d}}W_{s}+\int_{0}^{t}\xi_{s}^{\varepsilon}\text{\rm{d}}s+\int_{0}^{t}\eta_{s}^{\varepsilon}\,\text{\rm{d}}W_{s},\ \ \ t\in[0,T]. Let \theta\in(1,1+p^{-1}) such that \theta p-1

1 such that \mathbb{P} -a.s. \sup_{\varepsilon\in(0,1]}\mathbb{E}^{\mathscr{F}_{0}}\bigg[\bigg(\int_{0}^{T}|\eta_{s}^{\varepsilon}|^{2\lambda}\text{\rm{d}}s\bigg)^{\theta p}\bigg]<\infty. By choosing \lambda>1 such that (\lambda p_{i},\lambda q_{i})\in\mathscr{K} for 1\leq i\leq l, this follows from (H) , ( 3.13 ), ( 3.23 ) and Krylov’s estimate. (d) Proof of \lim_{\varepsilon\downarrow 0}\beta_{\varepsilon}=0 . By the same reason leading to \lim_{\varepsilon\rightarrow 0}|\eta_{s}^{\varepsilon}|=0, and noting that \nabla h_{t} is a.e. continuous, we have (3.25) \lim_{\varepsilon\rightarrow 0}|\xi_{s}^{\varepsilon}|=0,\ \ \ \mathbb{P}\text{-a.s.},\ s\in(0,T]. By \|\nabla b\|_{\infty}<\infty due to (H) , ( 3.5 ) and ( 3.21 ), we find c_{1},c_{2}\in(0,\infty) such that (3.26) |\xi_{s}^{\varepsilon}|\leq c_{1}\Big(|v_{s}^{\varepsilon}|+\big(\mathbb{E}[|v_{s}^{\varepsilon}|^{p}]\big)^{\frac{1}{p}}\Big)s^{\kappa-\frac{d(p-1)}{2k^{\prime}(p-1)}}\leq c_{2}(1+|v_{s}^{\varepsilon}|)s^{\kappa-\frac{dp}{2k^{\prime}(p-1)}}. By ( 3.4 ), we find \lambda>1 such that \lambda^{\prime}:=\lambda\Big(\kappa-\frac{dp}{2k^{\prime}(p-1)}\Big)>-1, so that ( 3.13 ) and ( 3.26 ) yield that for some constant c_{3}\in(0,\infty) , \displaystyle\sup_{\varepsilon\in(0,1]}\mathbb{E}^{\mathscr{F}_{0}}\bigg[\bigg(\int_{0}^{T}|\xi_{s}^{\varepsilon}|^{\lambda}\text{\rm{d}}s\bigg)^{\theta p}\bigg] \displaystyle\leq c_{2}^{\lambda\theta p}\bigg(\sup_{\varepsilon\in(0,1]}\mathbb{E}^{\mathscr{F}_{0}}\Big[\sup_{s\in[0,T]}|v_{s}^{\varepsilon}|^{\theta\lambda p}\Big]\bigg)\bigg(\int_{0}^{T}s^{\lambda^{\prime}}\text{\rm{d}}s\bigg)^{\theta p}\leq c_{3}|\eta|^{\lambda\theta p}. Combining this with ( 3.25 ) and the dominated convergence theorem, we drive \mathbb{P} -a.s. \lim_{\varepsilon\rightarrow 0}\bigg|\mathbb{E}^{\mathscr{F}_{0}}\bigg(\int_{0}^{T}|\xi_{s}^{\varepsilon}|\text{\rm{d}}s\bigg)^{\theta p}\bigg|^{\frac{1}{\theta}}=0 and for some constant c_{4}\in(0,\infty) , \sup_{\varepsilon\in(0,1]}\bigg|\mathbb{E}^{\mathscr{F}_{0}}\bigg(\int_{0}^{T}|\xi_{s}^{\varepsilon}|\text{\rm{d}}s\bigg)^{\theta p}\bigg|^{\frac{1}{\theta}}\leq c_{4}|\eta|^{p}. Since \mathbb{E}[|\eta|^{p}]<\infty , by the dominated convergence theorem again, we obtain \lim_{\varepsilon\downarrow 0}\beta_{\varepsilon}=0 . ∎ 4 Proof of Theorem 2.1 (2) For any \eta\in L^{p}(\Omega\rightarrow\mathbb{R}^{d},\mathscr{F}_{0},\mathbb{P}) , \mu\in\mathscr{P}_{k} , consider \Gamma_{\eta}P_{t}f(\mu):=\lim_{\varepsilon\downarrow 0}\frac{\mathbb{E}[f(X_{t}^{\varepsilon\eta,\mu})-f(X_{t}^{\mu})]}{\varepsilon},\ \ t\in(0,T],f\in\mathscr{B}_{b}(\mathbb{R}^{d}). Then D_{\phi}P_{t}f(\mu)=\Gamma_{\phi(X_{0}^{\mu})}P_{t}f(\mu),\ \ \ \phi\in T_{\mu,p}^{*},\ t\in(0,T]. So, Theorem 2.1 (2) follows from the following result. Proposition 4.1 . In the situation of Theorem 2.1 . For any \eta\in L^{p}(\Omega\rightarrow\mathbb{R}^{d},\mathscr{F}_{0},\mathbb{P}) and \mu\in\mathscr{P}_{p} , \Gamma_{\eta}P_{t}f(\mu) exists and satisfies the following formula for any \beta\in C^{1}([0,t]) with \beta_{0}=0 and \beta_{t}=1: (4.1) \begin{split}&\Gamma_{\eta}P_{t}f(\mu)=\int_{\mathbb{R}^{d}\times\mathbb{R}^{d}}\mathbb{E}\bigg[f(X_{t}^{\mu,x})\int_{0}^{t}\beta_{s}^{\prime}\big\langle\zeta_{s}(X_{s}^{\mu,x})\nabla_{v}X_{s}^{\mu,x},\text{\rm{d}}W_{s}\big\rangle\bigg]\mathscr{L}_{(X_{0}^{\mu},\eta)}(\text{\rm{d}}x,\text{\rm{d}}v)\\ &+\mathbb{E}\bigg[f(X_{t}^{\mu})\int_{0}^{t}\Big\langle\zeta_{s}(X_{s}^{\mu})\mathbb{E}\big[\langle\nabla h_{s}(z-X_{s}^{\mu}),\nabla_{\eta}X_{s}^{\mu}\rangle\big]\big|_{z=X_{s}^{\mu}},\text{\rm{d}}W_{s}\Big\rangle\bigg].\end{split} Consequently, there exists a constant c>0 such that (4.2) \begin{split}&\big|\Gamma_{\eta}P_{t}f(\mu)\big|\leq\frac{c}{\sqrt{t}}\big(P_{t}|f|^{\frac{p}{p-1}}(\mu)\big)^{\frac{p-1}{p}}(\mathbb{E}[|\eta|^{p}])^{\frac{1}{p}},\\ &t\in(0,T],f\in\mathscr{B}_{b}(\mathbb{R}^{d}),\mu\in\mathscr{P}_{p},\eta\in L^{p}(\Omega\rightarrow\mathbb{R}^{d},\mathscr{F}_{0},\mathbb{P}).\end{split} To prove this result, we need the following lemma. Lemma 4.2 . Assume (H) and 2\kappa-\frac{d}{k^{\prime}}>-1. Let p\in[\frac{2k^{\prime}(\kappa+1)}{2k^{\prime}(\kappa+1)-d},\infty)\cap(\frac{k^{\prime}}{k^{\prime}-1},\infty) and denote X_{s}=X_{s}^{\mu},X_{s}^{\varepsilon}=X_{s}^{\varepsilon\eta,\mu},s\in[0,T]. (1) For any \theta\in(1,2\land\frac{k^{\prime}p}{k^{\prime}+p}) , there exists c(\theta)\in(0,\infty) such that (4.3) \sup_{z\in\mathbb{R}^{d}}\Big(\mathbb{E}\big|h_{s}(z-X_{s})-h_{s}(z-X_{s}^{\varepsilon})\big|^{\theta}\Big)^{\frac{1}{\theta}}\leq\varepsilon c(\theta)s^{\kappa-\frac{d}{2k^{\prime}}},\ \ \ s\in(0,T],\ \varepsilon\in(0,1]. (2) Let \mu_{t}=\mathscr{L}_{X_{t}},\mu_{t}^{\varepsilon}=\mathscr{L}_{X_{t}^{\varepsilon}} and (4.4) \Xi_{s}^{\varepsilon}:=\zeta_{s}(X_{s}^{\varepsilon})\big\{B_{s}(X_{s}^{\varepsilon},\mu_{s})-B_{s}(X_{s}^{\varepsilon},\mu_{s}^{\varepsilon})\big\},\ \ \ R_{t}^{\varepsilon}:=\text{\rm{e}}^{\int_{0}^{t}\langle\Xi_{s}^{\varepsilon},\text{\rm{d}}W_{s}\rangle-\frac{1}{2}\int_{0}^{t}|\Xi_{s}^{\varepsilon}|^{2}\text{\rm{d}}s}. Then for any n\in[1,\infty) , (4.5) \sup_{t\in[0,T],\varepsilon\in(0,1]}\frac{1}{\varepsilon^{n}}\mathbb{E}\big[|R_{t}^{\varepsilon}-1|^{n}\big]<\infty. Proof. (1) We have \displaystyle\big|h_{s}(z-X_{s})-h_{s}(z-X_{s}^{\varepsilon})\big|=\bigg|\int_{0}^{1}\frac{\text{\rm{d}}}{\text{\rm{d}}r}h_{s}(z-X_{s}^{\varepsilon r})\text{\rm{d}}r\bigg| \displaystyle=\bigg|\big(\nabla_{\nabla_{\eta}X_{s}^{\varepsilon r}}h\big)(z-X_{s}^{\varepsilon r})\text{\rm{d}}r\bigg|. By Hölder’s inequality and ( 2.9 ), we find a constant c_{1}\in(0,\infty) such that (4.6) \begin{split}&\sup_{z\in\mathbb{R}^{d}}\Big(\mathbb{E}\big|h_{s}(z-X_{s})-h_{s}(z-X_{s}^{\varepsilon})\big|^{\theta}\Big)^{\frac{1}{\theta}}\\ &\leq\bigg(\int_{0}^{1}\mathbb{E}\Big[\big|\nabla_{\eta}X_{s}^{\varepsilon r}\big|^{\theta}\big|\nabla h_{s}\big|^{\theta}(z-X_{s}^{\varepsilon r})\text{\rm{d}}r\bigg)^{\frac{1}{\theta}}\\ &\leq\bigg(\int_{0}^{1}\Big(\mathbb{E}\big|\nabla_{\eta}X_{s}^{\varepsilon r}\big|^{p}\Big)^{\frac{1}{p}}\Big(\mathbb{E}\big|\nabla h_{s}\big|^{\frac{p\theta}{p-\theta}}(z-X_{s}^{\varepsilon r})\Big)^{\frac{p-\theta}{p}}\text{\rm{d}}r\bigg)^{\frac{1}{\theta}}\\ &\leq c_{1}\varepsilon\bigg(\int_{0}^{1}\Big(\mathbb{E}\big|\nabla h_{s}\big|^{\frac{p\theta}{p-\theta}}(z-X_{s}^{\varepsilon r})\Big)^{\frac{p-\theta}{p}}\text{\rm{d}}r\bigg)^{\frac{1}{\theta}}.\end{split} By (H)(3) and ( 2.7 ) for p_{1}=\frac{k^{\prime}(p-\theta)}{p\theta}>1 and p_{2}=\infty , we find a constant c_{2}\in(0,\infty) such that \displaystyle\Big(\mathbb{E}\big|\nabla h_{s}\big|^{\frac{p\theta}{p-\theta}}(z-X_{s}^{\varepsilon r})\Big)^{\frac{p-\theta}{p}}=\Big(\mu_{0}^{\varepsilon r}\big(P_{s}^{\mu^{\varepsilon r}}|\nabla h_{s}|^{\frac{p\theta}{p-\theta}}(z-\cdot)\big)\Big)^{\frac{p-\theta}{p}} \displaystyle\leq\|\nabla h_{s}\|_{\tilde{L}^{k^{\prime}}}^{\theta}\|P_{s}^{\mu^{\varepsilon r}}\|_{\tilde{L}^{\frac{k^{\prime}(p-\theta)}{p\theta}}\rightarrow\tilde{L}^{\infty}}^{\frac{p-\theta}{p}}\leq c_{2}s^{\theta(\kappa-\frac{d}{2k^{\prime}})},\ \ s\in(0,T],\ r\in(0,1). Combining this with ( 4.6 ) and \theta(\kappa-\frac{d}{2k^{\prime}})>-1 , we prove ( 4.3 ) for some c(\theta)\in(0,\infty) . (2) By (H) and ( 4.3 ), we find a constant C_{1}\in(0,\infty) such that (4.7) \begin{split}&|\Xi_{s}^{\varepsilon}|\leq\|\zeta_{s}\|_{\infty}\Big|\mathbb{E}\big[h_{s}(z-X_{s})-h_{s}(z-X_{s}^{\varepsilon})\big]\big|_{z=X_{s}}\Big|\\ &\leq C_{1}\varepsilon s^{\kappa-\frac{d}{2k^{\prime}}},\ \ \ s\in(0,T],\ \varepsilon\in(0,1].\end{split} Since 2\kappa-\frac{d}{k^{\prime}}>-1 , for any n\geq 1, there exist C_{2},C_{3}\in(0,\infty) such that \displaystyle\mathbb{E}\bigg|\int_{0}^{t}\langle\Xi_{s}^{\varepsilon},\text{\rm{d}}W_{s}\rangle\bigg|^{2n}+\bigg(\mathbb{E}\int_{0}^{t}|\Xi_{s}^{\varepsilon}|^{2}\text{\rm{d}}s\bigg)^{2n} \displaystyle\leq C_{2}\bigg(\mathbb{E}\int_{0}^{t}|\Xi_{s}^{\varepsilon}|^{2}\text{\rm{d}}s\bigg)^{n}+\bigg(\mathbb{E}\int_{0}^{t}|\Xi_{s}^{\varepsilon}|^{2}\text{\rm{d}}s\bigg)^{2n} \displaystyle\leq C_{3}\varepsilon^{2n},\ \ \ t\in[0,T],\ \varepsilon\in(0,1]. Moreover, there exists constants C_{4},C_{5}\in(0,\infty) such that (4.8) \sup_{t\in[0,T],\varepsilon\in(0,1]}\mathbb{E}\big[|R_{t}^{\varepsilon}|^{2n}\big]\leq\sup_{t\in[0,T],\varepsilon\in(0,1]}\mathbb{E}\big[\text{\rm{e}}^{C_{4}\int_{0}^{t}|\Xi_{s}^{\varepsilon}|^{2}\text{\rm{d}}s}\big]\leq C_{5}. Combining this with |\text{\rm{e}}^{r}-1|\leq(\text{\rm{e}}^{r}+1)|r| for r\in R , we find constants C_{6},C_{7}\in(0,\infty) such that \displaystyle\mathbb{E}\big[|R_{t}^{\varepsilon}-1|^{n}\big]\leq\mathbb{E}\bigg[\big(R_{t}^{\varepsilon}+1\big)^{n}\bigg|\int_{0}^{t}\langle\Xi_{s}^{\varepsilon},\text{\rm{d}}W_{s}\rangle-\frac{1}{2}\int_{0}^{t}|\Xi_{s}^{\varepsilon}|^{2}\text{\rm{d}}s\bigg|^{n}\bigg] \displaystyle\leq C_{6}\Big(\mathbb{E}\big[\big(R_{t}^{\varepsilon}+1\big)^{2n}\big]\Big)^{\frac{1}{2}}\bigg(\mathbb{E}\bigg|\int_{0}^{t}\langle\Xi_{s}^{\varepsilon},\text{\rm{d}}W_{s}\rangle\bigg|^{2n}+\bigg(\mathbb{E}\int_{0}^{t}|\Xi_{s}^{\varepsilon}|^{2}\text{\rm{d}}s\bigg)^{2n}\bigg)^{\frac{1}{2}} \displaystyle\leq C_{7}\varepsilon^{n},\ \ \ t\in[0,T],\ \varepsilon\in(0,1]. Therefore, ( 4.5 ) holds. ∎ Proof of Proposition 4.1 . By ( 2.5 ), ( 2.8 ), ( 2.9 ) and taking \beta_{s}=\frac{s}{t} , we deduce ( 4.2 ) from ( 4.1 ). So, it suffices to prove ( 4.1 ). (a) Let X_{t}^{\mu,x} solve ( 2.3 ). Let (P_{s,t}^{\mu})_{0\leq s\leq t\leq T} be the semigroup associated with ( 2.3 ), i.e. for (X_{s,t}^{\mu,x})_{t\in[s,T]} solving ( 2.3 ) from time s with X_{s,s}^{\mu,x}=x , (4.9) P_{s,t}^{\mu}f(x):=\mathbb{E}[f(X_{s,t}^{\mu,x})],\ \ t\in[s,T],x\in\mathbb{R}^{d}. Then P_{t}^{\mu}=P_{0,t}^{\mu} and (4.10) P_{t}f(\mu)=\mathbb{E}[f(X_{t}^{\mu})]=\int_{\mathbb{R}^{d}}P_{t}^{\mu}f(x)\mu(\text{\rm{d}}x),\ \ t\in[0,T],f\in\mathscr{B}_{b}(\mathbb{R}^{d}). Next, denote \mu_{t}=P_{t}^{*}\mu=\mathscr{L}_{X_{t}^{\mu}} and let {\bar{X}}_{s}^{\varepsilon} solve the SDE (4.11) \text{\rm{d}}\bar{X}_{s}^{\varepsilon}=\big(b_{s}(\bar{X}_{s}^{\varepsilon})+B_{s}(\bar{X}_{s}^{\varepsilon},\mu_{s})\big)\text{\rm{d}}s+\sigma_{s}(\bar{X}_{s}^{\varepsilon})\text{\rm{d}}W_{s},\ \ s\in[0,t],\bar{X}_{0}^{\varepsilon}=X_{0}^{\mu}+\varepsilon\eta. We have \displaystyle\mathbb{E}[f(\bar{X}_{t}^{\varepsilon})]=\int_{\mathbb{R}^{d}}(P_{t}^{\mu})(x)\mathscr{L}_{X_{0}^{\mu}+\varepsilon\eta}(\text{\rm{d}}x) \displaystyle=\int_{\mathbb{R}^{d}\times\mathbb{R}^{d}}P_{t}^{\mu}f(x+\varepsilon v)\mathscr{L}_{(X_{0}^{\mu},\eta)}(\text{\rm{d}}x,\text{\rm{d}}v),\ \ f\in\mathscr{B}_{b}(\mathbb{R}^{d}). Combining this with ( 4.10 ) and ( 2.6 ), and applying the dominated convergence theorem, we obtain (4.12) \begin{split}&\lim_{\varepsilon\rightarrow 0}\frac{\mathbb{E}[f(\bar{X}_{t}^{\varepsilon})]-P_{t}f(\mu)}{\varepsilon}=\int_{\mathbb{R}^{d}\times\mathbb{R}^{d}}\nabla_{v}P_{t}^{\mu}f(x)\mathscr{L}_{(X_{0}^{\mu},\eta)}(\text{\rm{d}}x,\text{\rm{d}}v)\\ &=\int_{\mathbb{R}^{d}\times\mathbb{R}^{d}}\mathbb{E}\bigg[f(X_{t}^{\mu,x})\int_{0}^{t}\beta_{s}^{\prime}\langle\zeta_{s}(X_{s}^{\mu,x})\nabla_{v}X_{s}^{\mu,x},\text{\rm{d}}W_{s}\rangle\bigg]\mathscr{L}_{(X_{0}^{\mu},\eta)}(\text{\rm{d}}x,\text{\rm{d}}v).\end{split} By ( 4.7 ) and 2\kappa-\frac{d}{k^{\prime}}>-1 , we find a constant c_{2}\in(0,\infty) such that \int_{0}^{T}|\Xi_{s}^{\varepsilon}|^{2}\text{\rm{d}}s\leq c_{2}. So, by Girsanov’s theorem, \mathbb{Q}_{t}^{\varepsilon}:=R_{t}^{\varepsilon}\mathbb{P} is a probability measure under which \tilde{W}_{r}^{\varepsilon}:=W_{r}-\int_{0}^{r}\zeta_{s}(X_{s}^{\varepsilon})\big(B_{s}(X_{s}^{\varepsilon},\mu_{s})-B_{s}(X_{s}^{\varepsilon},\mu_{s}^{\varepsilon})\big)\text{\rm{d}}s,\ \ r\in[0,t] is a Brownian motion. Reformulate the SDE for X_{s}^{\varepsilon} as \text{\rm{d}}X_{s}^{\varepsilon}=\big(b_{s}(X_{s}^{\varepsilon})+B_{s}(X_{s}^{\varepsilon},\mu_{s})\big)\text{\rm{d}}s+\sigma_{s}(X_{s}^{\varepsilon})\text{\rm{d}}\tilde{W}_{s}^{\varepsilon},\ \ X_{0}^{\varepsilon}=\bar{X}_{0}^{\varepsilon}. By the weak well-posedness we obtain \mathbb{E}[f(\bar{X}_{t}^{\varepsilon})]=\mathbb{E}[R_{t}^{\varepsilon}f(X_{t}^{\varepsilon})],\ \ f\in\mathscr{B}_{b}(\mathbb{R}^{d}). Thus, \displaystyle\frac{\mathbb{E}[f(X_{t}^{\varepsilon})]-\mathbb{E}[f(\bar{X}_{t}^{\varepsilon})]}{\varepsilon}=\frac{\mathbb{E}[f(X_{t}^{\varepsilon})(1-R_{t}^{\varepsilon})]}{\varepsilon}=I_{1}(\varepsilon)+I_{2}(\varepsilon), \displaystyle I_{1}(\varepsilon):=\mathbb{E}\bigg[f(X_{t}^{\mu})\frac{1-R_{t}^{\varepsilon}}{\varepsilon}\bigg],\ \ I_{2}(\varepsilon):=\mathbb{E}\bigg[\big(f(X_{t}^{\varepsilon})-f(X_{t}^{\mu})\big)\frac{1-R_{t}^{\varepsilon}}{\varepsilon}\bigg]. So, it remains to verify (4.13) \lim_{\varepsilon\rightarrow 0}I_{1}(\varepsilon)=\mathbb{E}\bigg[f(X_{t}^{\mu})\int_{0}^{t}\big\langle\zeta_{s}(X_{s})\mathbb{E}[\langle\nabla h_{s}(z-X_{s}),\nabla_{\eta}X_{s}^{\mu}\rangle]|_{z=X_{s}},\text{\rm{d}}W_{s}\big\rangle\bigg], (4.14) \lim_{\varepsilon\rightarrow 0}I_{2}(\varepsilon)=0, By the definition of R_{t}^{\varepsilon} in ( 4.4 ) and the estimate ( 4.5 ), we may apply the dominated convergence theorem to derive \lim_{\varepsilon\downarrow 0}\frac{R_{t}^{\varepsilon}-1}{\varepsilon}=\int_{0}^{t}\big\langle\zeta_{s}(X_{s})\mathbb{E}[\langle\nabla h_{s}(z-X_{s}),\nabla_{\eta}X_{s}\rangle]|_{z=X_{s}},\text{\rm{d}}W_{s}\big\rangle in L^{1}(\mathbb{P}) (indeed in L^{n}(\mathbb{P}) for any n\in[1,\infty) ). So, ( 4.13 ) holds. (b) Proof of ( 4.14 ). When f\in C_{b}(\mathbb{R}^{d}) , it follows from ( 4.5 ) and the dominated convergence theorem. Below we prove it for f\in\mathscr{B}_{b}(\mathbb{R}^{d}) by using a time-shift argument as in the proof of [ 18 , Proposition 4.3] . By 2\kappa-\frac{d}{k^{\prime}}>-1 , ( 4.7 ) and ( 4.8 ), we find constants K_{1},K_{2}\in(0,\infty) such that for any T\geq t\geq r\geq 0 , \displaystyle\frac{1}{\varepsilon}\mathbb{E}\big[|R_{t}^{\varepsilon}-R_{r}^{\varepsilon}||\big]=\frac{1}{\varepsilon}\mathbb{E}\big[|R_{r}^{\varepsilon}(\text{\rm{e}}^{\int_{r}^{t}\langle\Xi_{s}^{\varepsilon},\text{\rm{d}}W_{s}\rangle-\frac{1}{2}\int_{r}^{t}|\Xi_{s}^{\varepsilon}|^{2}\text{\rm{d}}s}-1)|\big] \displaystyle\leq\frac{1}{\varepsilon}\Big(\mathbb{E}\big[|R_{r}^{\varepsilon}|^{2}\big]\Big)^{\frac{1}{2}}\Big(\mathbb{E}\big[\text{\rm{e}}^{2\int_{r}^{t}\langle\Xi_{s}^{\varepsilon},\text{\rm{d}}W_{s}\rangle-\int_{r}^{t}|\Xi_{s}^{\varepsilon}|^{2}\text{\rm{d}}s}-1\big]\Big)^{\frac{1}{2}} \displaystyle\leq\frac{K_{1}}{\varepsilon}\Big(\text{\rm{e}}^{C_{1}^{2}\varepsilon^{2}\int_{r}^{t}s^{2\kappa-\frac{d}{k^{\prime}}}\text{\rm{d}}s}-1\Big)^{\frac{1}{2}}\leq K_{2}\sqrt{t^{\kappa+1-\frac{d}{k^{\prime}}}-r^{\kappa+1-\frac{d}{k^{\prime}}}},\ \ \varepsilon\in[0,1]. Therefore, (4.15) \lim_{r\uparrow t}\sup_{\varepsilon\in(0,1]}\mathbb{E}\bigg[\frac{|R_{t}^{\varepsilon}-R_{r}^{\varepsilon}|}{\varepsilon}\bigg]=0,\ \ t\in(0,T]. By the same reason leading to ( 2.7 ), we find a constant c\in(0,\infty) such that (4.16) \|\nabla P_{r,t}^{\mu}f\|_{\infty}\leq c(t-r)^{-\frac{1}{2}}\|f\|_{\infty},\ \ \ T\geq t>r\geq 0,\ f\in\mathscr{B}_{b}(\mathbb{R}^{d}),\ \mu\in\mathscr{P}. Then by the Markov property, (4.17) \begin{split}&|\mathbb{E}[f(X_{t}^{\varepsilon})-f(X_{t}^{\mu})|\mathscr{F}_{r}]|=|(P_{r,t}^{\mu^{\varepsilon}}f)(X_{r}^{\varepsilon})-(P_{r,t}^{\mu}f)(X_{r}^{\mu})|\\ &\leq|(P_{r,t}^{\mu^{\varepsilon}}f)(X_{r}^{\varepsilon})-(P_{r,t}^{\mu^{\varepsilon}}f)(X_{r}^{\mu})|+|(P_{r,t}^{\mu^{\varepsilon}}f)(X_{r}^{\mu})-(P_{r,t}^{\mu}f)(X_{r}^{\mu})|\\ &\leq c\|f\|_{\infty}\mathbb{E}\bigg[\frac{|X_{r}^{\varepsilon}-X_{r}^{\mu}|}{\sqrt{t-s}}\bigg]+|(P_{r,t}^{\mu^{\varepsilon}}f)(X_{r}^{\mu})-(P_{r,t}^{\mu}f)(X_{r}^{\mu})|.\end{split} On the other hand, let (\tilde{X}_{r,s}^{\varepsilon})_{s\in[r,t]} solve the SDE \text{\rm{d}}\tilde{X}_{r,s}^{\varepsilon}=b_{s}(\tilde{X}_{r,s}^{\varepsilon},\mu_{s}^{\varepsilon})\text{\rm{d}}s+\sigma_{s}(\tilde{X}_{r,s}^{\varepsilon})\text{\rm{d}}W_{s},\ \ \tilde{X}_{r,r}^{\varepsilon}=X_{r}^{\mu},s\in[r,t]. We have P_{r,t}^{\mu^{\varepsilon}}f(X_{r}^{\mu})=\mathbb{E}\big[f(\tilde{X}_{r,t}^{\varepsilon})\big|\mathscr{F}_{r}\big],\ \ P_{r,t}^{\mu}f(X_{r}^{\mu})=\mathbb{E}\big[f(X_{t}^{\mu})|\mathscr{F}_{r}\big]. By ( 4.7 ) and Girsanov’s theorem, R_{r,t}^{\varepsilon}:=\text{\rm{e}}^{\int_{r}^{t}\langle\Xi_{s}^{\varepsilon},\text{\rm{d}}W_{s}\rangle-\frac{1}{2}\int_{r}^{t}|\Xi_{s}^{\varepsilon}|^{2}\text{\rm{d}}s},\ \ \ t\in[r,T] is a martingale, and \tilde{W}_{s}:=W_{s}-\int_{r}^{s}\Xi_{\theta}^{\varepsilon}\text{\rm{d}}\theta,\ \ s\in[r,t] is a Brownian motion under \mathbb{Q}_{r,t}:=R_{r,t}^{\varepsilon}\mathbb{P} . Reformulating the SDE for (X_{s}^{\mu})_{s\in[r,t]} as \text{\rm{d}}X_{s}^{\mu}=\big\{b_{s}(X_{s}^{\mu})+B_{s}(X_{s}^{\mu},\mu^{\varepsilon})\text{\rm{d}}s+\sigma_{s}(X_{s}^{\mu})\text{\rm{d}}\tilde{W}_{s},\ \ X_{r}^{\mu}=\tilde{X}_{r,r}^{\varepsilon},\ \ s\in[r,t], by the weak uniqueness we obtain P_{r,t}^{\mu^{\varepsilon}}f(X_{r}^{\mu})=\mathbb{E}\big[R_{r,t}^{\varepsilon}f(X_{t}^{\mu})\big|\mathscr{F}_{r}\big], so that by Pinsker’s inequality, 2\kappa-\frac{d}{k^{\prime}}>-1 and ( 4.7 ), we find a constant c_{2}>0 such that (4.18) \begin{split}&|(P_{r,t}^{\mu^{\varepsilon}}f)(X_{r}^{\mu})-(P_{r,t}^{\mu}f)(X_{r}^{\mu})|^{2}\leq\|f\|_{\infty}\big|\mathbb{E}[|1-R_{r,t}^{\varepsilon}|\big|\mathscr{F}_{r}]\big|^{2}\\ &\leq 2\|f\|_{\infty}\mathbb{E}_{\mathbb{Q}_{r,t}}\big[\log R_{r,t}^{\varepsilon}\big|\mathscr{F}_{0}\big]=\|f\|_{\infty}\int_{r}^{t}\mathbb{E}_{\mathbb{Q}_{r,t}}\big[|\Xi_{s}^{\varepsilon}|^{2}\big|\mathscr{F}_{r}\big]\text{\rm{d}}s\\ &\leq c_{2}\|f\|_{\infty}\varepsilon^{2},\ \ \varepsilon\in(0,1],\ 00 such that \displaystyle\bigg|\mathbb{E}\Big[\big(f(X_{t}^{\varepsilon})-f(X_{t})\big)\frac{1-R_{r}^{\varepsilon}}{\varepsilon}\Big]\bigg| \displaystyle\leq\bigg(\mathbb{E}\Big|\mathbb{E}\big[f(X_{t}^{\varepsilon})-f(X_{t})\big|\mathscr{F}_{r}\big]\Big|^{2}\bigg)^{\frac{1}{2}}\bigg(\mathbb{E}\Big[\frac{|1-R_{r}^{\varepsilon}|^{2}}{\varepsilon^{2}}\Big]\bigg)^{\frac{1}{2}} \displaystyle\leq c_{4}\|f\|_{\infty}\bigg(\frac{\mathbb{E}[|X_{r}^{\varepsilon}-X_{r}^{\mu}|]}{\sqrt{t-r}}\bigg)^{\frac{1}{2}}+c_{4}\|f\|_{\infty}\varepsilon \displaystyle\leq c_{5}\|f\|_{\infty}\Big(\frac{\varepsilon}{t-r}\Big)^{\frac{1}{2}},\ \ \varepsilon\in(0,1],t\in[0,T]. This together with ( 4.15 ) yields \lim_{\varepsilon\downarrow 0}I_{2}(\varepsilon)\leq\lim_{r\uparrow t}\lim_{\varepsilon\downarrow 0}\Bigg(\bigg|\mathbb{E}\Big[\big(f(X_{t}^{\varepsilon})-f(X_{t})\big)\frac{1-R_{r}^{\varepsilon}}{\varepsilon}\Big]\bigg|+2\|f\|_{\infty}\mathbb{E}\Big[\frac{|R_{t}^{\varepsilon}-R_{r}^{\varepsilon}|}{\varepsilon}\Big]\Bigg)=0. ∎