Estimating Aleatoric Uncertainty in the Causal Treatment Effect Liyuan Xu, Bijan Mazaheri Abstract Previous work on causal inference has primarily focused on averages and conditional averages of treatment effects, with significantly less attention on variability and uncertainty in individual treatment responses. In this paper, we introduce the variance of the treatment effect (VTE) and conditional variance of treatment effect (CVTE) as the natural measure of aleatoric uncertainty inherent in treatment responses, and we demonstrate that these quantities are identifiable from observed data under mild assumptions, even in the presence of unobserved confounders. We further propose nonparametric kernel-based estimators for VTE and CVTE, and our theoretical analysis establishes their convergence. We also test the performance of our method through extensive empirical experiments on both synthetic and semi-simulated datasets, where it demonstrates superior or comparable performance to naive baselines. 1 Introduction While much of statistics and machine learning focuses on accurately capturing associative relationships, causal inference 17 ; 18 applies these tools to understand causal dependencies. It seeks to understand the outcome of actions , such as the implications of an intervention or policy. To do this, we need to address confounding bias , which arises when confounders simultaneously affect both treatment and outcome. The vast majority of literature on causal inference focuses on recovering the average treatment effect (ATE) , i.e., the average influence of an intervention. Less attention has been paid to modeling aleatoric uncertainty in the causal effect across individuals, which is a critical measure of an intervention’s risk. Heterogeneity of treatment effects may inform critical decisions within epidemiology. For example, the emergence of a new strain or variant of a virus may lead to highly variable treatment effects with a vaccine. The ability to distinguish these events from a more homogeneous decline in effectiveness may help public health officials decide when to update a vaccine and when to administer boosters. Classically, the heterogeneity of a causal effect is measured via the conditional average treatment effect (CATE), which represents the average responses to the intervention within a subpopulation sharing specific attributes ( 34 ; 33 ; 10 ; 4 ) . This, however, only captures the heterogeneity driven by the observable attributes. Consequently, CATE cannot measure the uncertainty caused by the virus strains when the affected groups are similar, i.e., the observed covariates may not fully distinguish cases that respond to the vaccine from new vaccine-resistant cases. To fully capture this uncertainty, we propose to examine the variance of the treatment effect (VTE), or the conditional variance of the treatment effect (CVTE) for a more granular view of uncertainty. These quantities provide natural measures of the risk and uncertainty of a treatment response. The higher VTE suggests that treatment effects are highly individualized, while low VTEs suggest a more uniform response. In this paper, we develop identification conditions for the VTE and CVTE, showing that they can be estimated from observable data even when a confounder exists. This extends the work by 8 , which estimates the higher-order moments of causal effects under a different setting. Motivated by this, we derive non-parametric estimators based on kernel models which provably converge to the true causal quantities. We further test the performance of our estimators empirically through experiments, based on both synthetic and semi-simulated settings, and the proposed estimator performs promisingly in all settings. This paper is structured as follows: After reviewing the related work in Section 2 , we introduce the formal definition of VTE and CVTE in Section 3 . The identification condition is given in Section 4 . We then present the kernel-based non-parametric estimator in Section 5 , in which we also provide the theoretical analysis. We demonstrate the empirical performance of the proposed method in Section 6 , covering both synthetic and semi-simulated settings. 2 Related Works Heterogeneous treatment effects Numerous approaches study heterogeneous treatment effects by looking at the causal effects within different subpopulations. For example, the average treatment effect on the treated (ATT) 34 measures the discrepancy in causal effects between treated and untreated subpopulations, while the conditional average treatment effect (CATE) ( 34 ; 33 ; 10 ; 4 ) considers the effect within subpopulations sharing the same attributes. Furthermore, 13 recovers the CATE conditioned on latent class, using “Synthetic Potential Outcomes” extending proximal causal inference ( 14 ) . Although these metrics give useful insights into the heterogeneity of the causal effect, they tend to underestimate the uncertainty of the causal effect by ignoring the uncertainty caused by exogenous variables. Counterfactual Distributions Recently, there has been an increasing interest in exploring the causal effect on the distributional quantities, such as Gini coefficient. To address this, several methods are proposed to model the distribution of the potential outcome given a specific treatment ( 2 ; 9 ; 15 ) . However, these approaches have a different focus from VTE, since we are interested in the variation in the gap between potential outcomes rather than the potential outcomes themselves. This requires us to model the covariance between the potential outcomes, making these methods not directly applicable to our settings. Moments of the Causal Effect Our work is most closely related to 8 , which investigated the (central) moments of the causal effect, since VTE is the second central moments of the causal effect. Our work, however, diverges from 8 in three key ways. Firstly, we allow for the existence of confounders, while 8 assumed that the outcome is only affected by the treatment and latent exogenous variables and tested on Randomized Controlled Trials (RCTs). Such confounding has the ability to drive different treatment responses. To handle this, we secondly introduce the conditional VTE (CVTE) to disentangle treatment uncertainty between different groups at a chosen stratification. Finally, our kernel-based model does not require the additional monotonicity assumption employed in 8 . Our assumption of conditionally uncorrelated potential outcomes is sufficient to address our motivating examples. Variance of ATE Estimators A separate line of work seeks to quantify the variance of the ATE estimator ( 19 ; 12 ; 31 ) to provide the confidence interval of ATE. These approaches quantify the epistemic uncertainty in the ATE, which will decrease with additional data. In contrast, the VTE represents the aleatoric uncertainty, which is inherent in the population. Kernel Mean Embedding in Causal Inference In causal inference, we often need to compute the (conditional) expectation of a function of interest. The kernel mean embedding ( 7 ; 27 ) provides a powerful tool for this without unstable density estimation, when the function is expressed with features in a reproducing kernel Hilbert space (RKHS). This approach is applied to a wide range of causal inference problems, including ATE / CATE estimation ( 24 ) , front-door adjustment ( 24 ) , instrumental variable regression ( 25 ) . We also use this approach to estimate the CVTE. 3 Problem Setting In this section, we introduce our novel causal parameters and show that they can be estimated from observed data. Throughout the paper, we denote a random variable in a capital letter (e.g. A ), the realization of this random variable in lowercase (e.g. a ), and the set where a random variable takes values in a calligraphic letter (e.g. \mathcal{A} ). We assume that the data are generated from a distribution P . VTE Definition We introduce the target causal parameters using the potential outcome framework ( 22 ) . Let the treatment and the observed outcome be A\in\{0,1\} and Y\in\mathcal{Y}\subseteq[-R,R] . We denote the potential outcome given treatment a as Y^{(a)}\in\mathcal{Y} . Here, we assume no inference , which means that we observe Y=Y^{(a)} when A=a . Given these, we define the variance of treatment effect (VTE) as the variance of the differences of potential outcomes. Definition 3.1 . Define VTE as \displaystyle\mathrm{VTE} \displaystyle=\mathrm{Var}\left[Y^{(1)}-Y^{(0)}\right]. This can capture aleatoric uncertainty in the treatment effect that other methods cannot, as discussed below. Figure 1 : Histogram of treatment effect Y^{(1)}-Y^{(0)} Motivating Example To illustrate the descriptive value of the VTE, let’s consider the following two scenarios: Case 1: \displaystyle\quad Y^{(0)}\sim\mathcal{N}(0,1),\quad Y^{(1)}=Y^{(0)} Case 2: \displaystyle\quad Y^{(0)},Y^{(1)}\sim\mathcal{N}(0,1),\quad Y^{(1)}\mathop{\perp\!\!\!\perp}Y^{(0)} For now, let us assume no confounding for both cases, i.e. treatment A is assigned independently from potential outcomes Y^{(0)},Y^{(1)} . Although the average treatment effects (ATE) \mathbb{E}\left[Y^{(1)}-Y^{(0)}\right] are zero in both scenarios, we observe the larger heterogeneity in the individual causal effect in the second scenario (See Fig. 1 ). In particular, the treatment effect for Case 1 is homogeneous and completely certain. Meanwhile, the treatment effect for Case 2 is highly uncertain. Such information is critical when assessing the risk associated with policy decisions and medical interventions. The average treatment effect on the treated (ATT) \mathbb{E}\left[Y^{(1)}-Y^{(0)}|A=1\right] , is often used to model the differences in the treatment effects between treated and control groups ( 34 ) . However, in our setting, the ATT is an inappropriate measure of uncertainty, since both cases exhibit zero ATT under the no confounding assumption. Another relevant metric is the counterfactual distribution ( 2 ) , which characterizes the distribution of the potential outcomes by \displaystyle\mathbb{P}_{\left\langle a,a^{\prime}\right\rangle}\left[Y\right]=\mathbb{P}\left[Y^{(a)}\middle|A=a^{\prime}\right] for a,a^{\prime}\in\{0,1\} . Again, this is not appropriate risk measurement, since all counterfactual distributions \mathbb{P}_{\left\langle a,a^{\prime}\right\rangle}\left[Y\right] are the standard Gaussian distribution in both cases under no confounding. Hence, while counterfactual distributions may quantify the uncertainty of a single potential outcome, they are insufficient to quantify treatment effect uncertainty driven by the joint distribution of two potential outcomes. While these two toy cases are identical in all of these previously mentioned metrics, the VTE is able to capture their difference: Case 1: \displaystyle\quad\mathrm{VTE}=\mathrm{Var}\left[Y^{(0)}-Y^{(0)}\right]=0 Case 2: \displaystyle\quad\mathrm{VTE}=\mathrm{Var}\left[Y^{(0)}\right]+\mathrm{Var}\left[Y^{(1)}\right]=2. This shows the importance of VTE as a metric for heterogeneity and uncertainty. Extension to Conditional VTE It is often the case that we are interested in the variance of the treatment effect in a specific sub-population sharing a common trait. For example, we might want to determine whether the heterogeneity in vaccine effectiveness varies by geographic location, which is likely when this heterogeneity is driven by a new variant. In such cases, we may consider conditional variance of treatment effect (CVTE) as Definition 3.2 . Define CVTE as \displaystyle\mathrm{CVTE}(v) \displaystyle=\mathrm{Var}\left[Y^{(1)}-Y^{(0)}\middle|V=v\right] where V\in\mathcal{V} is some covariate observed. Such a metric is capable of identifying the drivers of heterogeneity in treatment effects. For example, if treatment effect uncertainty is fully explained by V=v , then \mathrm{VTE}(v)=0 . We can also similarly define the counterfactual quantity, within the sub-population that actually received treatment (i.e., V=A ). For the sake of simplicity, we focus on VTE and CVTE in this work. 4 Identification The definitions of VTE and CVTE presented in Section 3 depend on potential outcomes, which are not observable in reality. In this section, we show a sufficient condition for estimating VTE and CVTE from observational data. The majority of the literature in causal inference ( 33 ; 34 ; 23 ; 3 ; 1 ; 25 ) assumes that we observe some covariate X that satisfies a condition known as ignorability or conditional exchangability ( 22 ) . Assumption 4.1 (Ignorability) . \displaystyle Y^{(0)},Y^{(1)}\mathop{\perp\!\!\!\perp}A|X 4.1 ensures that groups with different values of A can be treated as “similar” for the purpose of computing counterfactuals, making the ATE computable as differences between the expected outcomes in both “treated” ( A=1 ) and “control” ( A=0 ) groups ( 22 ; 20 ) . This assumption alone, however, is not sufficient to identify VTE as shown in the following theorem. To see this, let us consider the following variance composition of the VTE. \displaystyle\mathrm{VTE} \displaystyle=\mathrm{Var}\left[Y^{(1)}-Y^{(0)}\right] \displaystyle=\mathrm{Var}\left[Y^{(1)}\right]+\mathrm{Var}\left[Y^{(0)}\right]-2\mathrm{Cov}[Y^{(1)},Y^{(0)}] (1) Although we can estimate the variance of potential outcomes \mathrm{Var}\left[Y^{(1)}\right],\mathrm{Var}\left[Y^{(0)}\right] from 4.1 alone, we cannot identify the covariance \mathrm{Cov}[Y^{(1)},Y^{(0)}] since we cannot observe both potential outcomes at the same time. Indeed, we can explicitly construct the non-identifiable data process. Theorem 4.2 . There exists two data generation processes P(X,A,Y^{(0)},Y^{(1)}) satisfying 4.1 that have different VTE but the same observational distribution P(X,A,Y) . These data generation processes can be found in Section B.1 . Therefore, we make the following additional assumption for the covariate X . Assumption 4.3 . \displaystyle\mathbb{E}\left[Y^{(0)}Y^{(1)}\middle|X\right]=\mathbb{E}\left[Y^{(0)}\middle|X\right]\mathbb{E}\left[Y^{(1)}\middle|X\right] 4.3 suggests that potential outcomes are uncorrelated conditioned on X , meaning that all the dependence between potential outcomes is explained by the covariates. 4.3 is a natural assumption whenever the covariates X are sufficiently informative. For example, we would not expect the variability in vaccine effectiveness to be associated with variability in unvaccinated outcomes, so long as we observe all relevant risk factors in X . Note that 4.3 is automatically satisfied in the more restrictive case of independent (when conditioned on X ) potential outcomes, but we only require uncorrelated potential outcomes in general. Under 4.3 , we can estimate VTE as follows. Theorem 4.4 . Let covariate X satisfy both 4.1 and 4.3 . Then, the the VTE can be estimated as \displaystyle\mathrm{VTE} \displaystyle=\mathbb{E}_{X}\left[g_{1}(X)+g_{0}(X)-2f_{1}(X)f_{0}(X)\right] \displaystyle\quad\quad\quad-\mathbb{E}_{X}\left[f_{1}(X)-f_{0}(X)\right]^{2}, where \displaystyle f_{a}(X) \displaystyle=\mathbb{E}\left[Y|A=a,X\right], \displaystyle g_{a}(X) \displaystyle=\mathbb{E}\left[Y^{2}|A=a,X\right] for a\in\{0,1\} . Similarly, we can also identify the CVTE as follows. Theorem 4.5 . Let covariate X satisfies both 4.1 and 4.3 . Then, for V\mathop{\perp\!\!\!\perp}Y^{(1)},Y^{(0)}|X the CVTE can be estimated as \displaystyle\mathrm{CVTE}(v) \displaystyle\quad=\mathbb{E}_{X}\left[g_{1}(X)+g_{0}(X)-2f_{1}(X)f_{0}(X)|V=v\right] \displaystyle\quad\quad\quad-\mathbb{E}_{X}\left[f_{1}(X)-f_{0}(X)|V=v\right]^{2}, where f_{a},g_{a} are defined as 4.4 . The proofs are presented in Section B.2 . The major difference from VTE is that we now take the conditional expectation \mathbb{E}_{X|V=v}\left[\cdot\right] , rather than the marginal expectation \mathbb{E}_{X}\left[\cdot\right] . A V Y^{(0)} Y^{(1)} Y X Figure 2 : A causal graph satisfying the constraints of our setting. The dotted circles indicate that the potential outcomes are not observed. The causal relationship is summarized in Fig. 2 , in which the bi-directional arrow between X and V means that we allow both directions or even a common ancestor variable. Note that 4.1 prohibits having an arrow between treatment A and potential outcomes Y^{(0)},Y^{(1)} , and 4.3 is satisfied when there is no arrow between potential outcomes (Y^{(0)},Y^{(1)}) , i.e. Y^{(0)}\mathop{\perp\!\!\!\perp}Y^{(1)}|X 1 1 1 Technically, Assumption 4.3 allows arrows and dependence between the potential outcomes so long as the correlation, i.e., linear dependence, remains zero. . One important example is where V is a subset of X , which represents the variance of causal effect within a subpopulation that shares the same traits. Remark 4.6 . We can rewrite the VTE in 4.4 as follows \displaystyle\mathrm{VTE} \displaystyle=\underbrace{\mathrm{Var}_{X}\left[\mathbb{E}\left[Y|A=1,X\right]-\mathbb{E}\left[Y|A=0,X\right]\right]}_{\text{Variance in CATE}} \displaystyle\quad\quad+\underbrace{\mathbb{E}_{X}\left[\mathrm{Var}\left[Y|A=1,X\right]+\mathrm{Var}\left[Y|A=0,X\right]\right]}_{\text{Exogenous uncertainty}} This can be interpreted as the variance decomposition in the treatment effect. The first term represents the variance in the conditional average treatment effect across different conditionings, i.e., variation due to the covariate X . The second term can be interpreted as the variance within the potential outcomes, which is uncertainty that is latent to our study. Note that if we estimate the CATE for each X , then the variance of these CATEs across different X can be used to estimate the first term. This captures endogenous variation in the treatment effect, e.g., variation in the treatment effect that is explained by observed variables. The full measurement of the VTE, however, requires the computation of exogenous uncertainty appearing in the second term. 5 Estimation In this section, we propose empirical estimation methods for VTE and CVTE based on kernel methods. We first review the kernel ridge regression, and then present the closed-form expression of estimators. 5.1 Preliminary Reproducing Kernel Hilbert Space We assume that f_{a}(x),g_{a}(x) is in a Reproducing Kernel Hilbert Space (RKHS) denoted as \mathcal{H}_{\mathcal{X}} , defined by a positive semidefinite k:\mathcal{X}\times\mathcal{X}\to\mathbb{R} . We assume all kernel functions are characteristic 29 and bounded. We denote canonical features as \phi and the inner product and the norm in \mathcal{H}_{\mathcal{X}} as \left\langle\cdot,\cdot\right\rangle_{\mathcal{H}_{\mathcal{X}}} and \|\cdot\|_{\mathcal{H}_{\mathcal{X}}} , respectively. We also define the tensor product as \otimes , which induces the Hilbert-Schmidt operator h_{1}\otimes h_{2}:\mathcal{H}_{2}\to\mathcal{H}_{1} for h_{1}\in\mathcal{H}_{1},h_{2}\in\mathcal{H}_{2} , such that (h_{1}\otimes h_{2})h^{\prime}_{2}=\left\langle h_{2},h^{\prime}_{2}\right\rangle h_{1} for h^{\prime}_{2}\in\mathcal{H}_{2} . Estimator of outcome models We use kernel ridge regression (KRR) to model f_{a},g_{a} defined in 4.4 . Given the whole dataset \{x_{i},y_{i},a_{i}\}_{i=1}^{n} , let us denote the subset of untreated data a_{i}=0 as \{x^{(0)}_{i},y^{(0)}_{i}\}_{i=1}^{n_{0}} and the subset of treated data a_{i}=1 as \{x^{(1)}_{i},y^{(1)}_{i}\}_{i=1}^{n_{1}} . Then, KRR estimators \hat{f}_{a},\hat{g}_{a} for a\in\{0,1\} are given as follows. \displaystyle\hat{f}_{a}(x) \displaystyle=\bm{k}_{a}(x)^{\top}\left(K_{a}+n_{a}\lambda_{f_{a}}I_{n_{a}}\right)^{-1}\bm{y}_{a}, (2) \displaystyle\hat{g}_{a}(x) \displaystyle=\bm{k}_{a}(x)^{\top}\left(K_{a}+n_{a}\lambda_{g_{a}}I_{n_{a}}\right)^{-1}\bm{y}^{2}_{a}, (3) where I_{n_{a}} is the identity matrix size of n_{a} , and K_{a} is the kernel matrix for untreated/treated subsets, i.e. \displaystyle K_{a} \displaystyle=(k(x^{(a)}_{i},x^{(a)}_{j}))_{ij}\in\mathbb{R}^{n_{a}\times n_{a}}, and vectors are \displaystyle\bm{k}_{a}(x)=[k(x,x^{(a)}_{1}),k(x,x^{(a)}_{2}),\dots,k(x,x^{(a)}_{n_{a}})]^{\top}, \displaystyle\bm{y}_{a}=[y^{(a)}_{1},\dots,y^{(a)}_{n_{a}}]^{\top},\quad\bm{y}^{2}_{a}=[(y^{(a)}_{1})^{2},\dots,(y^{(a)}_{n_{a}})^{2}]^{\top}. Note that \hat{f}_{a} is a standard KRR learning from the subset of the untreated (a_{i}=0) or treated (a_{i}=1) data points, and g_{a} is the same except using the squared outcomes as the target of the prediction. The convergence of such models are widely studied ( 5 ; 32 ; 26 ) . Proposition 5.1 ( 5 , Theorem 1 ) . If f_{a},g_{a}\in\mathcal{H}_{\mathcal{X}} for a\in\{0,1\} , under a certain regularity conditions, we have \displaystyle\|\hat{f}_{a}(\cdot)-f_{a}(\cdot)\|_{\mathcal{H}_{\mathcal{X}}}\to 0,~\|\hat{g}_{a}(\cdot)-g_{a}(\cdot)\|_{\mathcal{H}_{\mathcal{X}}}\to 0 when \lambda_{f_{a}},\lambda_{g_{a}} is set adaptively to the datasize. The complete version of 5.1 can be found in Section B.3 , in which we present the detailed regularity conditions and the rate of convergence. We use this result to construct consistent VTE and CVTE estimators as follows. 5.2 VTE Estimator Assuming we can have consistent outcome models \hat{f}_{a},\hat{g}_{a} , the VTE can be estimated by taking the empirical average over the data sample. Theorem 5.2 . Given dataset \{x_{i},y_{i},a_{i}\}_{i=1}^{n} , the estimator of the VTE defined as \displaystyle\widehat{\mathrm{VTE}} \displaystyle=\frac{1}{n}\sum_{i=1}^{n}\hat{g}_{1}(x_{i})+\hat{g}_{0}(x_{i})-2\hat{f}_{1}(x_{i})\hat{f}_{0}(x_{i}) \displaystyle\quad-\left(\frac{1}{n}\sum_{i=1}^{n}\hat{f}_{1}(x_{i})-\hat{f}_{0}(x_{i})\right)^{2} converges to the true VTE under the conditions of 4.4 and 5.1 , where \hat{f}_{1},\hat{f}_{0},\hat{g}_{1},\hat{g}_{0} are the KRR models defined in ( 2 ) and ( 3 ). The convergence rate is the same as the convergence rate of KRR in 5.1 . The proof is shown in Section B.3 , which combines the convergence results of KRR 5.1 and Hoeffding’s inequality. The time complexity of O(n^{3}) , which can be reduced by the usual Cholesky or Nyström techniques. 5.3 CVTE Estimator Unlike VTE, CVTE requires computing the conditional expectation \mathbb{E}_{X|V}\left[\cdot\right] . To do this, we use conditional mean embedding ( 28 ; 7 ; 11 ; 16 ) . Lemma 5.3 . Assume f_{a},g_{a}\in\mathcal{H}_{\mathcal{X}} . Under the condition of 4.5 \displaystyle\mathrm{CVTE}(v) \displaystyle=\left\langle{g}_{1}+{g}_{0},{\mu}_{X|V}(v)\right\rangle_{\mathcal{H}_{\mathcal{X}}} \displaystyle\quad-2\left\langle{f}_{1},{C}_{XX|V}(v){f}_{0}\right\rangle_{\mathcal{H}_{\mathcal{X}}} \displaystyle\quad\quad-\left\langle{f}_{1}-{f}_{0},{\mu}_{X|V}(v)\right\rangle_{\mathcal{H}_{\mathcal{X}}}^{2} for \displaystyle{\mu}_{X|V}(v) \displaystyle=\mathbb{E}\left[\phi(X)|V=v\right], \displaystyle C_{XX|V}(v) \displaystyle=\mathbb{E}\left[\phi(X)\otimes\phi(X)|V=v\right] The proof can be found in Section B.3 , which uses the linearity of expectation and the reproducing property. Here, {\mu}_{X|V}(v),C_{XX|V}(v) are the conditional mean embedding ( 28 ; 7 ; 11 ; 16 ) . Under the regularity condition, it is shown that this can be estimated as a solution of the least-squares problem. Proposition 5.4 ( 25 , Thoerem 1 ) . Under some regularity conditions, given data \{x_{i},v_{i}\}_{i=1}^{n} , we have \displaystyle\left\|\mu_{X|V}(v)-\sum_{i=1}^{n}w_{i}(v)\phi(x_{i})\right\|_{\mathcal{H}_{\mathcal{X}}}\to 0, \displaystyle\left\|C_{XX|V}(v)-\sum_{i=1}^{n}w_{i}(v)\phi(x_{i})\otimes\phi(x_{i})\right\|_{\mathcal{H}_{\mathcal{X}}}\to 0, for all v\in\mathcal{V} , where w_{i}(v) is the i -th element of the vector \displaystyle\bm{w}(v)=\left(K_{V}+n\lambda_{V}I\right)^{-1}\bm{k}_{V}(v). Here, K_{V},\bm{k}_{V} are defined as \displaystyle K_{V}=(k_{V}(v_{i},v_{j}))_{ij}\in\mathbb{R}^{n\times n}, \displaystyle\bm{k}_{V}(v)=[k_{V}(v_{1},v),k_{V}(v_{2},v),\dots,k_{V}(v_{n},v)]^{\top}\in\mathbb{R}^{n}, for kernel function k_{V}:\mathcal{V}\times\mathcal{V}\to\mathbb{R} . The complete version of 5.4 can be found in Section B.3 . Using this estimator of conditional mean embeddings, we can construct the empirical estimator of CVTE as follows. Theorem 5.5 . Given dataset \{x_{i},y_{i},a_{i},v_{i}\}_{i=1}^{n} , the following estimator, \widehat{\mathrm{CVTE}} , converges to the true CVTE under the condition of 4.4 , 5.1 and 5.4 . \displaystyle\widehat{\mathrm{CVTE}}(v)= \displaystyle\quad\sum_{i=1}^{n}w_{i}(v)\left(\hat{g}_{1}(x_{i})+\hat{g}_{0}(x_{i})-2\hat{f}_{1}(x_{i})\hat{f}_{0}(x_{i})\right) \displaystyle\qquad-\left(\sum_{i=1}^{n}w_{i}(v)\left(\hat{f}_{1}(x_{i})-\hat{f}_{0}(x_{i})\right)\right)^{2} for the KRR models \hat{f}_{1},\hat{f}_{0},\hat{g}_{1},\hat{g}_{0} defined in ( 2 ), ( 3 ), respectively, and w_{i}(v) are the weights for conditional mean embedding defined in 5.4 . The convergence rate is equal to the slower rate of KRR estimation in 5.1 or the conditional mean embedding estimation in 5.4 . The proof can be found in Section B.3 . The only difference between the CVTE estimator and the VTE estimator in 5.2 is that the VTE estimator averages over samples with equal weights, while CVTE considers the weighted average induced from the conditional mean embedding w_{i}(v) . Therefore, compared to the VTE estimator, CVTE requires O(n^{3}) additional operations to obtain weights w_{i}(v) , which can be accelerated again by the usual Cholesky or Nyström techniques. Note that solutions in 5.5 cannot be used for the case where V\subseteq X , since it does not satisfy the assumptions in 5.4 . We will present an alternative solution for such cases in Appendix A . 6 Experiments In this section, we report the empirical performances of our kernel estimators. We first discuss the baseline methods we propose, and then, we present the results for both VTE and CVTE estimations. 6.1 Baselines Since VTE or CVTE has not been discussed before, we made sensible adjustments to devise following baselines. We first describe the baseline for VTE, and adaptation to CVTE will be discussed subsequently. Naive Estimator We introduce a naive baseline that ignores the confounding P(Y^{(a)})=P(Y|A=a) and assumes potential outcomes are marginally uncorrelated \mathrm{Cov}(Y^{(1)},Y^{(0)})=0 . Under these simplifications, we can see that VTE has the simple form \displaystyle\mathrm{VTE} \displaystyle=\mathrm{Var}\left[Y|A=1\right]+\mathrm{Var}\left[Y|A=0\right], which can be estimated from data. CATE-based Estimator Many models exist to estimate the CATE \tau(x) defined as \displaystyle\tau(x)=\mathbb{E}\left[Y|A=1,X=x\right]-\mathbb{E}\left[Y|A=0,X=x\right]. We might be tempted to use the variance of the estimated CATE \mathrm{Var}_{X}\left[\tau(X)\right] as the estimation of VTE. This is, however, a biased estimator, as discussed in Remark 4.6 . We compare to this estimator using causal forests ( 33 ) to estimate the CATE. Match-based Estimator Causal matching ( 30 ) is an approach to replicate a randomized experiment as closely as possible by matching treated and untreated units. Specifically, for each subject i in the treated group, the unobserved potential outcome Y^{(0)} is estimated by the average of observed outcomes of the k -nearest neighbor of the untreated subject. We repeat the same process to infer the potential outcome of the treated Y^{(1)} for the untreated groups, and then compute the VTE \mathrm{Var}\left[Y^{(1)}-Y^{(0)}\right] using all data. We attempted to match using Euclidean distance on the covariance matrix X and propensity score matching (PSM) ( 21 ) . 6.2 Experiment Results Synthetic setting for VTE estimation To test the performance of baselines, we employ the following data generation process, which is adopted from 24 . The covariance X\in\mathbb{R}^{100} is sampled from multivariate Gaussian \mathcal{N}(0,\Sigma) where the covariance matrix \Sigma is given as \displaystyle\Sigma_{ij}=\begin{cases}1&(i=j)\\ 0.5&(|i-j|=1)\\ 0&(\text{otherwise})\end{cases}. Then, the probability of treatment A=1 is given as \displaystyle\mathbb{P}\left[A=1\right]=\Phi(\bm{\beta}^{\top}X), where \Phi is CDF of standard normal distribution and \bm{\beta} is the vector whose i -th element is \beta_{i}=1/(i+1)^{2} . Given treatment X and outcome A , the outcome is generated as \displaystyle Y=\bm{\beta}^{\top}X+AX_{1}+\varepsilon,\quad\varepsilon\sim\mathcal{N}(0,1) where X_{1} denotes the first element of the covariate X . Table 1 summarizes the mean absolute error for 20 repetitions on various data sizes, and Fig. 3 presents the predictive distribution. We used a Gaussian kernel for the proposed estimator, with the bandwidth set to the median of pairwise distances. The regularization parameters \lambda_{f_{a}},\lambda_{g_{a}} are set by minimizing the leave-one-out error of the kernel ridge regression. Data size 500 1000 5000 Causal Forest 2.34 (0.17) 2.31 (0.26) 2.13 (0.10) Naive 3.77 (0.47) 3.79 (0.37) 3.87 (0.14) Euc. Match. 0.82 (0.28) 0.69 (0.29) 0.50 (0.11) PSM 0.43 (0.40) 0.41 (0.35) 0.18 (0.11) Proposed 0.35 (0.33) 0.38 (0.24) 0.15 (0.11) Table 1 : Mean and standard error of absolute error for synthetic VTE estimation. Figure 3 : Box plot for VTE prediction. The red line shows the true VTE. From Fig. 3 , we can see that Causal Forest and Naive baseline exhibit the large bias discussed in Section 3 . Although Euc. Match. also consistently overestimates the VTE, PSM seems to have little minimum bias, which is because the propensity score model is almost correctly satisfied. Still, the proposed model consistently outperforms all baselines in all data sizes, as shown in Table 1 . Synthetic Setting for CVTE We use the same data generation process when testing CVTE, instead aiming to estimate the CVTE with X_{2}=0 , where X_{2} denotes the second element of the covariate X . Since V is a subset of X , we used the alternative solution presented in Appendix A . To compute the conditioning, we only used the data subset of |X_{2}|\leq 0.1 in the matching and naive baseline. For the CATE-based Estimator, we used all data to train CATE \tau(x) , and computed the variance of \tau(x) within the data subset of |X_{2}|\leq 0.1 . We determined the remaining hyperparameters using the same procedure as for synthetic VTE, and the mean absolute error and the predictive error over 20 repeats for various data sizes are shown in Table 2 and Fig. 4 , respectively. Data size 500 1000 5000 Causal Forest 1.98 (0.15) 1.94 (0.18) 1.83 (0.08) Naive 2.21 (1.25) 2.84 (0.75) 2.95 (0.40) Euc. Match. 1.08 (1.09) 1.25 (0.68) 0.93 (0.33) PSM 1.63 (1.67) 1.06 (0.73) 0.48 (0.57) Proposed 0.61 (0.33) 0.40 (0.16) 0.19 (0.12) Table 2 : Mean and standard error of absolute error for synthetic CVTE estimation. Figure 4 : Box plot for CVTE prediction. The red line shows the true CVTE. Similar to the VTE setting, we see bias in the Causal Forest and Naive baselines and we observe the larger variance in the matching baselines. This is because we only used the small subset of data |X_{2}|\leq 0.1 to estimate the CVTE. Our proposed method, again, outperforms all baselines. Semi-Simulated setting for VTE The IHDP dataset is widely used to evaluate the performance of the estimators for the ATE ( 23 ; 3 ; 1 ) . This is a semi-synthetic data set based on the Infant Health and Development Program (IHDP) ( 6 ) , which examines the effects of home visits and specialized clinics on future developmental and health outcomes for premature infants. Following prior work, we generate outcomes and binary treatments from the 25-dimensional observable confounder, which comprises both continuous and categorical variables. Each dataset consists of 747 observations, and we normalized the outputs so that the observed outputs have unit variance. The performance in 1000 datasets is summarized in Table 3 . Causal Forest 0.52 (0.11) Naive 0.17 (0.08) Euc. Match 0.06 (0.04) PSM 0.16 (0.09) Proposed 0.10 (0.08) Table 3 : Mean and standard error of absolute error for IHDP dataset. Although we see that proposed methods outperform Causal Forest and Naive baselines, which yield biased estimation, Euc. Match. achieves better performance than the proposed method (though this difference is not statistically significant). We suspect that this is because the covariate X contains both continuous and categorical variables, a challenging setting for kernel ridge regression with Gaussian kernels. We could improve performance by tuning the appropriate kernel function or by using neural networks to model f_{a} and g_{a} , though these modifications would not provide the same rigorous theoretical foundation. 7 Conclusion We have proposed a novel causal quantity, the VTE, to measure the uncertainty in the causal effect. We have also extended VTE to CVTE, which measures uncertainty within subgroups sharing the same traits. We discussed the sufficient conditions for estimating these quantities from observable data, based on which we proposed kernel-based estimators. We established the consistency of the proposed method using kernel ridge regression and kernel conditional mean embedding arguments. Our empirical evaluation shows that the proposed method outperforms existing estimators, especially for CVTE estimation. As future work, it would be promising to consider a doubly robust estimator for VTE and CVTE. A current limitation of our consistency result is that the rate of convergence cannot exceed that of the kernel ridge regressor. A doubly robust estimator could achieve a better rate by introducing additional nuisance parameters to estimate, leveraging the mixed bias property . Furthermore, it would be interesting to consider similar kernel estimators for higher moments of the causal effect. Prior work ( 8 ) proposed quantifying skewness and kurtosis, which depend on the third and fourth moments. It would be beneficial to develop estimators for these higher-order moments under confounding bias to provide a more complete picture of the causal effect distribution. Impact Statement This paper presents work whose goal is to advance the field of machine learning. There are many potential societal consequences of our work, none of which we feel must be specifically highlighted here. Appendix A Empirical solution for CVTE conditioned on covariates In this section, we discuss the CVTE solution where X contains the conditioning V . In such a case, we cannot use the empirical solution presented in 5.5 , since the identity operator is not the Hilbert-Schmidt operator when the RKHS is of infinite dimension, which contradicts the assumptions in 5.4 . Instead, we use kernel tensor feature similar to kernel CATE estimator proposed in [ 25 ] . Given data \{x_{i},y_{i},a_{i}\} , where x_{i}=(\tilde{x}_{i},v_{i}) , define composite kernel function k as \displaystyle k(x_{i},x_{j})=k_{\tilde{X}}(\tilde{x}_{i},\tilde{x}_{j})k_{V}(v_{i},v_{j}), where k_{\tilde{X}},k_{V} are arbitrary kernel functions. The solution of CVTE can be given as \displaystyle\widehat{\mathrm{CVTE}}(v) \displaystyle=\sum_{i=1}^{n}w_{i}(v)\left(\hat{g}_{1}(\tilde{x}_{i},v)+\hat{g}_{0}(\tilde{x}_{i},v)-2\hat{f}_{1}(\tilde{x}_{i},v)\hat{f}_{0}(\tilde{x}_{i},v)\right)-\left(\sum_{i=1}^{n}w_{i}(v)\left(\hat{f}_{1}(\tilde{x}_{i},v)-\hat{f}_{0}(\tilde{x}_{i},v)\right)\right)^{2}, where f_{a},g_{a} are the kernel ridge regressors defined in ( 2 ), ( 3 ) using the composite kernel k and weight w_{i}(v) defined in 5.5 . This idea uses the fact that for any function h(x) \displaystyle\mathbb{E}\left[h(X)|V=v\right]=\mathbb{E}_{\tilde{X}}\left[h(\tilde{X},v)\middle|V=v\right], where right hand side can be computed by the conditional mean embedding. Appendix B Theoretical Results In this section, we provide deferred proofs from the main paper. B.1 Proof of 4.2 Let X\sim\mathcal{N}(0,1) and A is sampled from Bernoulli distribution with \mathbb{P}\left[A=1\right]=0.5 . Consider two distributions for potential outcomes. Case 1: \displaystyle\quad Y^{(0)}\sim\mathcal{N}(0,1),\quad Y^{(1)}=Y^{(0)} Case 2: \displaystyle\quad Y^{(0)}\sim\mathcal{N}(0,1),\quad Y^{(1)}=-Y^{(0)} Since Y^{(0)},Y^{(1)}\mathop{\perp\!\!\!\perp}A , we can see that X satisfies the ignorability 4.1 . Although these two has different VTEs, the observational distribution P(Y|A,X) is given as \mathcal{N}(0,1) . This shows the existence of the data generation processes stated in the theorem. B.2 Proof of 4.4 and 4.5 From the definition of VTE, we have \displaystyle\mathrm{VTE} \displaystyle=\mathrm{Var}\left[Y^{(1)}-Y^{(0)}\right] \displaystyle=\mathbb{E}\left[(Y^{(1)}-Y^{(0)})^{2}\right]-\mathbb{E}\left[(Y^{(1)}-Y^{(0)})\right]^{2} \displaystyle=\mathbb{E}\left[(Y^{(1)})^{2}\right]-2\mathbb{E}\left[Y^{(1)}Y^{(0)}\right]+\mathbb{E}\left[(Y^{(0)})^{2}\right]-\left(\mathbb{E}\left[Y^{(1)}\right]-\mathbb{E}\left[Y^{(0)}\right]\right)^{2} For a\in\{0,1\} and n\in\{1,2\} , we have \displaystyle\mathbb{E}\left[(Y^{(a)})^{n}\right] \displaystyle=\mathbb{E}_{X}\left[\mathbb{E}\left[(Y^{(a)})^{n}\middle|X\right]\right] \displaystyle=\mathbb{E}_{X}\left[\mathbb{E}\left[(Y^{(a)})^{n}\middle|A=a,X\right]\right]\quad\because\text{\lx@cref{creftype\lx@tilde refnum}{assum:ignorability}} \displaystyle=\mathbb{E}_{X}\left[\mathbb{E}\left[Y^{n}\middle|A=a,X\right]\right]\quad\because\text{No inference} \displaystyle=\begin{cases}\mathbb{E}_{X}\left[f_{a}(X)\right]&(n=1)\\ \mathbb{E}_{X}\left[g_{a}(X)\right]&(n=2)\end{cases} Furthermore, \displaystyle\mathbb{E}\left[Y^{(1)}Y^{(0)}\right] \displaystyle=\mathbb{E}_{X}\left[\mathbb{E}\left[Y^{(1)}Y^{(0)}\middle|X\right]\right] \displaystyle=\mathbb{E}_{X}\left[\mathbb{E}\left[Y^{(1)}\middle|X\right]\mathbb{E}\left[Y^{(0)}\middle|X\right]\right]\quad\because\text{\lx@cref{creftype\lx@tilde refnum}{assum:discomposional}} \displaystyle=\mathbb{E}_{X}\left[f_{0}(X)f_{1}(X)\right] Rearranging these results gives what we wanted. We can show the identification results for CVTE using a similar discussion as well. If we would like to relax 4.3 , then we observe that the second step in the final block, which applies 4.3 , may also add a correlation term between Y^{(1)} and Y^{(0)} . Since this term may not be observable, its value must be assumed, or the results would need to be relaxed into upper and lower bounds. B.3 Proofs in VTE estimation We first state the detailed convergence results for kernel ridge regression and kernel mean embeddings. Proposition B.1 (Corollary of 5 , Theorem 1 ) . Assume that kernel is bounded k(x,x)\leq\kappa^{2} and f_{a},g_{a} are in the \beta -power space \mathcal{H}^{\beta}_{\mathcal{X}} with \beta\in(1,2) . We assume the eigen-value decay satisfies a polynomial upper bound of order 1/p for p>0 . If |Y-f_{a}(X)| and |Y^{2}-g_{a}(X)| are upper-bounded by a constant M almost surely, we have \displaystyle\|\hat{f}_{a}-f_{a}\|_{\mathcal{H}_{\mathcal{X}}}\leq\log(16/\delta)\mathfrak{C}_{f_{a}}n_{a}^{-\frac{\beta}{2(\beta+p)}},\quad\|\hat{g}_{a}-g_{a}\|_{\mathcal{H}_{\mathcal{X}}}\leq\log(16/\delta)\mathfrak{C}_{g_{a}}n_{a}^{-\frac{\beta}{2(\beta+p)}} for all a\in\{0,1\} with the probabilty of 1-\delta by setting \lambda_{f_{a}},\lambda_{g_{a}}=O(n^{-1/(\beta+p)}) , where \mathfrak{C}_{f_{a}},\mathfrak{C}_{g_{a}} denotes the constants does not depends on n_{a},\delta . We also use the following lemma for applying Hoeffding’s inequality. Proposition B.2 (Corollary of 5 , Lemma 14 ) . We have \displaystyle\|\hat{f}_{a}\|_{\mathcal{H}_{\mathcal{X}}}\leq\|f_{a}\|_{\mathcal{H}_{\mathcal{X}}},\quad\|\hat{g}_{a}\|_{\mathcal{H}_{\mathcal{X}}}\leq\|g_{a}\|_{\mathcal{H}_{\mathcal{X}}} Now, we prove 5.2 . Under the condition of B.1 , for all i\in[n] , we have \displaystyle\left|\hat{g}_{a}(x_{i})-g_{a}(x_{i})\right| \displaystyle\leq\kappa\|\hat{g}_{a}-g_{a}\|_{\mathcal{H}_{\mathcal{X}}}\leq\kappa\log(16/\delta)\mathfrak{C}n_{a}^{-\frac{\beta}{2(\beta+p)}} \displaystyle\left|\hat{f}_{0}(x_{i})\hat{f}_{1}(x_{i})-f_{0}(x_{i})f_{1}(x_{i})\right| \displaystyle\leq\left|\hat{f}_{0}(x_{i})\hat{f}_{1}(x_{i})-\hat{f}_{0}(x_{i})f_{1}(x_{i})\right|+\left|\hat{f}_{0}(x_{i})f_{1}(x_{i})-f_{0}(x_{i})f_{1}(x_{i})\right| \displaystyle=|\hat{f}_{0}(x_{i})||\hat{f}_{1}(x_{i})-f_{1}(x_{i})|+|f_{1}(x_{i})||\hat{f}_{0}(x_{i})-f_{0}(x_{i})| \displaystyle\leq\kappa(\|f_{1}\|_{\mathcal{H}_{\mathcal{X}}}+\|f_{0}\|_{\mathcal{H}_{\mathcal{X}}})\log(16/\delta)\mathfrak{C}(n_{0}^{-\frac{\beta}{2(\beta+p)}}+n_{1}^{-\frac{\beta}{2(\beta+p)}}) \displaystyle\left|\hat{f}_{a}(x_{i})-f_{a}(x_{i})\right| \displaystyle\leq\kappa\|\hat{f}_{a}-f_{a}\|_{\mathcal{H}_{\mathcal{X}}}\leq\kappa\log(16/\delta)\mathfrak{C}n_{a}^{-\frac{\beta}{2(\beta+p)}} for \displaystyle\mathfrak{C}=\max(\mathfrak{C}_{f_{1}},\mathfrak{C}_{f_{0}},\mathfrak{C}_{g_{1}},\mathfrak{C}_{g_{0}}). Therefore, for \widetilde{\mathrm{VTE}} defined \displaystyle\widetilde{\mathrm{VTE}} \displaystyle=\frac{1}{n}\sum_{i=1}^{n}g_{1}(x_{i})+g_{0}(x_{i})-2f_{1}(x_{i})f_{0}(x_{i})-\left(\frac{1}{n}\sum_{i=1}^{n}f_{1}(x_{i})-f_{0}(x_{i})\right)^{2}, we have, \displaystyle|\widetilde{\mathrm{VTE}}-\widehat{\mathrm{VTE}}| \displaystyle\leq\kappa(1+2\|f_{1}\|_{\mathcal{H}_{\mathcal{X}}}+2\|f_{0}\|_{\mathcal{H}_{\mathcal{X}}})\log(16/\delta)\mathfrak{C}(n_{0}^{-\frac{\beta}{2(\beta+p)}}+n_{1}^{-\frac{\beta}{2(\beta+p)}}) \displaystyle\quad+\left|\left(\frac{1}{n}\sum_{i=1}^{n}(f_{1}(x_{i})-\hat{f}_{1}(x_{i}))-(f_{0}(x_{i})-\hat{f}_{0}(x_{i}))\right)\left(\frac{1}{n}\sum_{i=1}^{n}(f_{1}(x_{i})+\hat{f}_{1}(x_{i}))-(f_{0}(x_{i})+\hat{f}_{0}(x_{i}))\right)\right| \displaystyle\leq\kappa(1+2\|f_{1}\|_{\mathcal{H}_{\mathcal{X}}}+2\|f_{0}\|_{\mathcal{H}_{\mathcal{X}}})\log(16/\delta)\mathfrak{C}n_{a}^{-\frac{\beta}{2(\beta+p)}}+(2\|f_{1}\|_{\mathcal{H}_{\mathcal{X}}}+2\|f_{0}\|_{\mathcal{H}_{\mathcal{X}}})(2\kappa\log(16/\delta)\mathfrak{C}(n_{0}^{-\frac{\beta}{2(\beta+p)}}+n_{1}^{-\frac{\beta}{2(\beta+p)}})), with probability 1-4\delta . From Hoeffding’s inequality we have \displaystyle\left|\sum_{i=1}^{n}g_{1}(x_{i})+g_{0}(x_{i})-2f_{1}(x_{i})f_{0}(x_{i})-\mathbb{E}\left[g_{1}(X)+g_{0}(X)-2f_{1}(X)f_{0}(X)\right]\right|\leq O_{p}(1/n^{-1/2}), \displaystyle\left|\frac{1}{n}\sum_{i=1}^{n}f_{1}(x_{i})-f_{0}(x_{i})-\mathbb{E}\left[f_{1}(X)-f_{0}(X)\right]\right|\leq O_{p}(1/n^{-1/2}). Therefore, we have \displaystyle|\mathrm{VTE}-\widehat{\mathrm{VTE}}| \displaystyle\leq|\mathrm{VTE}-\widetilde{\mathrm{VTE}}|+|\widetilde{\mathrm{VTE}}-\widehat{\mathrm{VTE}}| \displaystyle\leq O_{p}(n_{0}^{-\frac{\beta}{2(\beta+p)}}+n_{1}^{-\frac{\beta}{2(\beta+p)}}). From this, we can see that the convergence rate is equal to the kernel ridge regression rate in B.1 . B.4 Proofs in CVTE Estimation We first prove 5.3 . Proof. From 4.5 , under 4.3 and 4.1 , \displaystyle\mathrm{CVTE}(v)=\mathbb{E}_{X}\left[g_{1}(X)+g_{0}(X)-2f_{1}(X)f_{0}(X)|V=v\right]-\mathbb{E}_{X}\left[f_{1}(X)-f_{0}(X)|V=v\right]^{2}. Now if f_{a},g_{a}\in\mathcal{H}_{\mathcal{X}} , from linearlity, we have \displaystyle\mathbb{E}_{X}\left[g_{1}(X)+g_{0}(X)|V=v\right] \displaystyle=\mathbb{E}_{X}\left[\left\langle g_{1}+g_{0},\phi(X)\right\rangle_{\mathcal{H}_{\mathcal{X}}}|V=v\right] \displaystyle=\left\langle g_{1}+g_{0},\mathbb{E}_{X}\left[\phi(X)\right]|V=v\right\rangle_{\mathcal{H}_{\mathcal{X}}} \displaystyle=\left\langle g_{1}+g_{0},\mu_{X|V}(v)\right\rangle_{\mathcal{H}_{\mathcal{X}}} \displaystyle\mathbb{E}_{X}\left[f_{1}(X)f_{0}(X)|V=v\right] \displaystyle=\mathbb{E}_{X}\left[\left\langle f_{1},\phi(X)\otimes\phi(X)f_{0}\right\rangle_{\mathcal{H}_{\mathcal{X}}}|V=v\right] \displaystyle=\left\langle f_{1},\mathbb{E}_{X}\left[\phi(X)\otimes\phi(X)|V=v\right]f_{0}\right\rangle_{\mathcal{H}_{\mathcal{X}}} \displaystyle=\left\langle f_{1},C_{XX|V}(v)f_{0}\right\rangle_{\mathcal{H}_{\mathcal{X}}} \displaystyle\mathbb{E}_{X}\left[f_{1}(X)-f_{0}(X)|V=v\right] \displaystyle=\mathbb{E}_{X}\left[\left\langle f_{1}-f_{0},\phi(X)\right\rangle_{\mathcal{H}_{\mathcal{X}}}|V=v\right] \displaystyle=\left\langle f_{1}-f_{0},\mathbb{E}_{X}\left[\phi(X)\right]|V=v\right\rangle_{\mathcal{H}_{\mathcal{X}}} \displaystyle=\left\langle f_{1}-f_{0},\mu_{X|V}(v)\right\rangle_{\mathcal{H}_{\mathcal{X}}} Combine them yields what we wanted. ∎ Next, we state the convergence result of conditional mean embedding \mu_{X|V} . Proposition B.3 (Corollary of 25 , Thoerem 1 ) . Assume k(x,x)\leq\kappa^{2} and k_{V}(v,v)\leq Q^{2} and the operator operator H_{\rho}:f\in\mathcal{H}_{\mathcal{X}}\to\mathbb{E}\left[f(X)|V=\cdot\right]\in\mathcal{H}_{\mathcal{V}} is Hilbert-Schmidt. Furthermore, we assume there exists Hilbert-Schmidt operator G and constant c\in(1,2] such that \displaystyle H_{\rho}=\mathbb{E}\left[\psi(V)\otimes\psi(V)\right]^{\frac{c-1}{2}}G, where \psi(v)=k_{V}(v,\cdot) . Then, with probability 1-\delta , we have \displaystyle\left\|\mu_{X|V}(v)-\sum_{i=1}^{n}w_{i}(v)\phi(x_{i})\right\|_{\mathcal{H}_{\mathcal{X}}}\leq\mathfrak{D}(n\log(1/\delta))^{-\frac{c-1}{2(c+1)}} for \lambda=O(n^{-\frac{1}{c+1}}) , where \mathfrak{D} is a constant that is independent of data size. We can prove a similar convergence result for C_{XX|V} as well. Given this, we can prove 5.5 as follows. Proof. Let \hat{\mu}_{X|V}(v),\hat{C}_{XX|V} defined as \displaystyle\hat{\mu}_{X|V}(v)=\sum_{i=1}^{n}w_{i}(v)\phi(x_{i}),\quad\hat{C}_{XX|V}(v)=\sum_{i=1}^{n}w_{i}(v)\phi(x_{i})\otimes\phi(x_{i}). Then, from reproducing characteristics, we have \displaystyle\widehat{\mathrm{CVTE}}(v)=\left\langle\hat{g}_{1}+\hat{g}_{0},\hat{\mu}_{X|V}(v)\right\rangle_{\mathcal{H}_{\mathcal{X}}}-2\left\langle\hat{f}_{1},\hat{C}_{XX|V}(v)\hat{f}_{0}\right\rangle_{\mathcal{H}_{\mathcal{X}}}-\left\langle\hat{f}_{1}-\hat{f}_{0},\hat{\mu}_{X|V}(v)\right\rangle_{\mathcal{H}_{\mathcal{X}}}^{2}. Therefore, from 5.3 , we have \displaystyle|\widehat{\mathrm{CVTE}}(v)-\mathrm{CVTE}(v)| \displaystyle\leq\left|\left\langle\hat{g}_{1}+\hat{g}_{0},\hat{\mu}_{X|V}(v)\right\rangle_{\mathcal{H}_{\mathcal{X}}}-\left\langle{g}_{1}+{g}_{0},{\mu}_{X|V}(v)\right\rangle_{\mathcal{H}_{\mathcal{X}}}\right| \displaystyle\qquad+2\left|\left\langle\hat{f}_{1},\hat{C}_{XX|V}(v)\hat{f}_{0}\right\rangle_{\mathcal{H}_{\mathcal{X}}}-\left\langle{f}_{1},{C}_{XX|V}(v){f}_{0}\right\rangle_{\mathcal{H}_{\mathcal{X}}}\right| \displaystyle\qquad+\left|\left\langle\hat{f}_{1}-\hat{f}_{0},\hat{\mu}_{X|V}(v)\right\rangle_{\mathcal{H}_{\mathcal{X}}}^{2}-\left\langle{f}_{1}-{f}_{0},{\mu}_{X|V}(v)\right\rangle_{\mathcal{H}_{\mathcal{X}}}^{2}\right|. Now, for each term, \displaystyle\left|\left\langle\hat{g}_{1}+\hat{g}_{0},\hat{\mu}_{X|V}(v)\right\rangle_{\mathcal{H}_{\mathcal{X}}}-\left\langle{g}_{1}+{g}_{0},{\mu}_{X|V}(v)\right\rangle_{\mathcal{H}_{\mathcal{X}}}\right| \displaystyle\leq\|{\mu}_{X|V}(v)\|_{\mathcal{H}_{\mathcal{X}}}(\|\hat{g}_{1}-g_{1}\|_{\mathcal{H}_{\mathcal{X}}}+\|\hat{g}_{0}-g_{0}\|_{\mathcal{H}_{\mathcal{X}}}) \displaystyle\quad+\|\hat{g}_{1}+\hat{g}_{0}\|_{\mathcal{H}_{\mathcal{X}}}\|\hat{\mu}_{X|V}(v)-{\mu}_{X|V}(v)\|_{\mathcal{H}_{\mathcal{X}}}, \displaystyle\left|\left\langle\hat{f}_{1},\hat{C}_{XX|V}(v)\hat{f}_{0}\right\rangle_{\mathcal{H}_{\mathcal{X}}}-\left\langle{f}_{1},{C}_{XX|V}(v){f}_{0}\right\rangle_{\mathcal{H}_{\mathcal{X}}}\right| \displaystyle\leq\|\hat{f}_{1}-f_{1}\|_{\mathcal{H}_{\mathcal{X}}}\|\hat{C}_{XX|V}(v)\hat{f}_{0}\|_{\mathcal{H}_{\mathcal{X}}} \displaystyle\quad+\|f_{1}\|_{\mathcal{H}_{\mathcal{X}}}\|{C}_{XX|V}(v)-\hat{C}_{XX|V}(v)\|_{\mathrm{op}}\|\hat{f}_{0}\|_{\mathcal{H}_{\mathcal{X}}} \displaystyle\quad\quad+\|f_{1}\|_{\mathcal{H}_{\mathcal{X}}}\|{C}_{XX|V}(v)\|_{\mathrm{op}}\|f_{0}-\hat{f}_{0}\|_{\mathcal{H}_{\mathcal{X}}}, \displaystyle\left|\left\langle\hat{f}_{1}-\hat{f}_{0},\hat{\mu}_{X|V}(v)\right\rangle_{\mathcal{H}_{\mathcal{X}}}^{2}-\left\langle{f}_{1}-{f}_{0},{\mu}_{X|V}(v)\right\rangle_{\mathcal{H}_{\mathcal{X}}}^{2}\right| \displaystyle\leq\left|\left\langle\hat{f}_{1}-\hat{f}_{0},\hat{\mu}_{X|V}(v)\right\rangle_{\mathcal{H}_{\mathcal{X}}}+\left\langle{f}_{1}-{f}_{0},{\mu}_{X|V}(v)\right\rangle_{\mathcal{H}_{\mathcal{X}}}\right| \displaystyle\quad\times\left|\left\langle\hat{f}_{1}-\hat{f}_{0},\hat{\mu}_{X|V}(v)\right\rangle_{\mathcal{H}_{\mathcal{X}}}-\left\langle{f}_{1}-{f}_{0},{\mu}_{X|V}(v)\right\rangle_{\mathcal{H}_{\mathcal{X}}}\right| \displaystyle\leq\left|\|\hat{f}_{1}-\hat{f}_{0}\|_{\mathcal{H}_{\mathcal{X}}}\|\hat{\mu}_{X|V}(v)\|_{\mathcal{H}_{\mathcal{X}}}+\|{f}_{1}-{f}_{0}\|_{\mathcal{H}_{\mathcal{X}}}\|{\mu}_{X|V}(v)\|_{\mathcal{H}_{\mathcal{X}}}\right| \displaystyle\quad\times\left|\|{\mu}_{X|V}(v)\|_{\mathcal{H}_{\mathcal{X}}}(\|\hat{f}_{1}-f_{1}\|_{\mathcal{H}_{\mathcal{X}}}+\|\hat{f}_{0}-f_{0}\|_{\mathcal{H}_{\mathcal{X}}})\right. \displaystyle\quad\quad\left.+\|\hat{f}_{1}-\hat{f}_{0}\|_{\mathcal{H}_{\mathcal{X}}}\|\hat{\mu}_{X|V}(v)-{\mu}_{X|V}(v)\|_{\mathcal{H}_{\mathcal{X}}}\right| From these, we see |\widehat{\mathrm{CVTE}}(v)-\mathrm{CVTE}(v)|\to 0 if \displaystyle\|\hat{f}_{a}-f_{a}\|_{\mathcal{H}_{\mathcal{X}}}\to 0,\|\hat{g}_{a}-g_{a}\|_{\mathcal{H}_{\mathcal{X}}}\to 0,\|\hat{\mu}_{X|V}(v)-{\mu}_{X|V}(v)\|_{\mathcal{H}_{\mathcal{X}}}\to 0 for a\in\{0,1\} . The rate is dominated by the slowest convergence rate above. ∎