Thesis title: Supervisor: Abstract We propose a novel and model-free estimand to measure the conditional association between a time-to-event and an exposure given covariates. The estimand may be interpreted as a weighted hazard difference, and can be viewed as an assumption-lean generalization of the cumulative exposure coefficient in the Aalen additive hazards model. We develop an estimation method based on the principles of double machine learning, which is algorithm-agnostic and incorporates cross-fitting. We prove that our method is doubly robust in the sense that, when the nuisance functions are learned with modest rate conditions, the resulting estimator converges to the true estimand at a n \sqrt{n} -rate. A simulation study is conducted, showcasing that our estimation procedure yields an efficient and robust estimator of our estimand. \theauthor \thetitle phd thesis this thesis has been submitted to the phd school of the faculty of science, University of Copenhagen Department of Mathematical Sciences University of Copenhagen August 2024 \theauthor amc@math.ku.dk Department of Mathematical Sciences University of Copenhagen Universitetsparken 5 2100 Copenhagen Denmark \thetitle Professor Niels Richard Hansen University of Copenhagen Associate Professor Sebastian Weichwald (chair) University of Copenhagen Professor Ingrid Van Keilegom KU Leuven Professor Stijn Vansteelandt Ghent University August 31, 2024 November 15, 2024 978-87-7125-233-0 Chapter 1: \copyright Christgau, A. M. Chapter 2: \copyright Institute of Mathematical Statistics. Chapter 3 and 4: \copyright Christgau, A. M. & Hansen, N. R. This thesis has been submitted to the PhD School of The Faculty of Science, University of Copenhagen on 31 August 2024. It was supported by the Novo Nordisk Foundation (research grant NNF20OC0062897). In loving memory of my grandparents, Ole and Sigrid. Preface This thesis is the culmination of three wonderful years from September 2021 to August 2024, under the supervision of Professor Niels Richard Hansen at the Department of Mathematical Sciences, University of Copenhagen. The thesis features three distinct manuscripts on varied, yet related, topics. Each manuscript is a stand-alone scientific contribution and can be read independently. Small discrepancies may occur between the contents of a chapter and its associated manuscript. Any typographical or mathematical errors are my own responsibility. Chapter 1 Contributions and Structure Chapter 2 is an introduction, which briefly motivates model-free statistical inference based on machine learning. The introduction is not meant to be a literature review, but rather an effort to build intuition around some key principles that permeate the rest of the thesis. It is followed by 3 chapters, each of which corresponds to a paper. For reference within this thesis, we give each paper an acronym, for example [ LCM ]. Notation established in each chapter should be considered specific to the chapter where it is introduced. Chapter 3 discusses hypothesis testing for time-to-event responses using the Local Covariance Measure (LCM) and corresponds to the paper: [ LCM ] ( Christgau et al., 2023b ) . . Chapter 4 formulates a general framework for the method of covariate adjustment, which leads to the Debiased Outcome-adapted Propensity Estimator (DOPE) , and corresponds to the paper: [ DOPE ] ( Christgau and Hansen, 2024 ) . . Chapter 5 introduces a measure of the conditional association between an exposure and a time-to-event, namely the Aalen Covariance Measure (ACM) , and corresponds to the following paper in preparation: [ ACM ] ( Christgau and Hansen, 2024+ ) . During my PhD studies, I also worked on the following two publications, which, however, are not included in this thesis. 1. . 2. Chapter 2 Introduction This thesis delves into a range of statistical challenges, including event history analysis, statistical efficiency, hypothesis testing, effect estimation, and assumption-lean inference. Despite the variety of topics, a central theme is that the problems and methods are studied from a model-free perspective. To understand what this means, suppose we are given a sample consisting of n observations Z_{1},\ldots,Z_{n} , and that our objective is to infer properties about the mechanisms that generated this data. To simplify matters, we may start by assuming that the observations are independent and identically distributed (i.i.d.) according to a distribution P , referred to as the data-generating process (DGP) . Whether this is reasonable assumption depends on the application, but it will be assumed throughout this thesis. Under the i.i.d. assumption, our objective can be reformulated in terms of inferring properties about P . To this end, it is convenient to let Z denote an auxiliary independent observation with distribution P . Before we can understand and appreciate a model-free approach to statistics, we first follow the thought process of Rhonda Fisher, a (fictional) model-based statistician. Example 1 . Rhonda has obtained a sample in which each observation is an independent copy of the template observation Z=(X,Y)\in\real^{d}\times\real . Here X=(X^{1},\ldots,X^{d}) is a d -dimensional covariate and Y is a real-valued response variable. She knows that without further assumptions, she can hardly infer anything about the relationship between the covariate and the response. With this consideration, Rhonda begins by positing a linear model: \displaystyle Y=\alpha+\beta^{\top}X+\varepsilon,\qquad\text{with}\quad\varepsilon\sim\mathrm{N}(0,\sigma^{2})\text{ and }\varepsilon\,\perp\!\!\!\perp\,X, (1) where \alpha\in\real , \beta=(\beta_{1},\ldots,\beta_{d})\in\real^{d} , and \sigma^{2}>0 are unknown parameters. Conveniently, her favorite statistical software can ‘fit’ the linear model ( 1 ). She now recalls that her primary objective is to describe the effect of X^{1} on Y . In view of the linear model ( 1 ), she concludes that \beta_{1} summarizes such an effect. Thus she decides to report the summary of the fitted model, which in particular includes an estimate of \beta_{1} and a valid confidence interval. While Rhonda is a caricature, her line of reasoning is ubiquitous and applies to many applications using generalized linear models (GLMs) and Cox models, among other semiparametric models. Whereas Rhonda is ‘lucky’ that her model conveniently summarizes her target of interest, others may choose a model with this objective in mind. In some applications, for example in physics, a thorough understanding of the data-generating process may justify the belief that the data follow a (semi)parametric model. However, in more complex systems, e.g., those analyzed in the physiological and social sciences, (semi)parametric models are often chosen for simplicity and convenience, rather than being a consequence of principled reasoning. Because the data-generating process is often more complicated than desired, this leads to a difficult trade-off between model misspecification due to simplicity, and impracticality due to complexity. Model misspecification may lead to bias in the results of the analysis, but a potentially more serious problem is the lack of interpretability of the target parameter for distributions that do not conform to the model. Other issues with model-based reasoning were pointed out in the seminal paper by Breiman (2001) and are also discussed by Hines et al. (2022) , among others. We will proceed to discuss how to define a model-free target parameter. 2.1 Model-free statistical objectives The importance of explicitly defining a target of interest at the onset of statistical analyses has been increasingly highlighted, particularly within the field of causal inference ( van der Laan and Rose, 2011 ) . A starting point is to consider a general collection \mathcal{P} of possible data-generating processes, that is, a collection of probability distributions over the sample space for a single observation. Although causal analyses require additional structure, this thesis will concentrate on observational quantities and their estimation. We call a function an estimand if its domain is \mathcal{P} . For example, if each observation is real-valued, a possible estimand is the population average outcome \displaystyle\mu\colon\mathcal{P}\to\real,\qquad\mu(P)\coloneq\int zP(\mathrm{d}z)=\mathbb{E}_{P}[Z]. (2) The statistician is responsible for defining an estimand that effectively summarizes the target of interest. Note that the estimand \mu in ( 2 ) requires the mild condition that the possible DGPs are integrable. Most estimands require similar assumptions to be well-defined, such as the existence of moments, the positivity of certain probabilities, absolute continuity, or regularity conditions on conditional means. These are properties that can be justified based on knowledge of the underlying DGP. We say that an estimand is model-based if it explicitly requires a parametrization of a component of the DGPs and reduces the dimension of the component. 1 1 1 This is, admittedly and intentionally, a vague definition. If an estimand is not model-based, we say that it is model-free , also commonly referred to as nonparametric in other literature. Returning to the setting of Example 1 , Rhonda defined her target parameter by restricting \mathcal{P} to the linear Gaussian model \displaystyle\mathcal{P}^{\text{lin}}\coloneq\{P\in\mathcal{P}\,|\,\exists(\alpha,\beta,\sigma^{2}) \displaystyle\in\real\times\real^{d}\times\real_{>0}\colon\text{Equation }\eqref{eq:linearmodel}\text{ holds for }(X,Y)\sim P\}. Rhonda’s target can be interpreted as the model-based estimand \tau_{\text{mb}}\colon\mathcal{P}^{\text{lin}}\to\real that inverts the parametrization in \beta_{1} (technically, this requires that \mathcal{P} is initially restricted enough to ensure that \beta_{1} is identifiable ). Critically, her statistical analysis becomes meaningless if the model is misspecified. That is, for a distribution P\notin\mathcal{P}^{\text{lin}} , the estimand \tau_{\text{mb}} is undefined and it is a priori unclear what any estimator of \tau_{\text{mb}} , or equivalently, \beta , will target. In view of this, model-free estimands have been increasingly advocated over model-based ones. It turns out, however, that the model-based estimand \tau_{\text{mb}} can be extended to a model-free estimand. For convenience, we let X=(D,W) , where D\coloneq X^{1} denotes the covariate of interest, and W\coloneq(X^{2},\ldots,X^{d}) represents the other covariates. Then we define the estimand \tau_{\text{mf}}\colon\mathcal{P}\to\real given by \displaystyle\tau_{\text{mf}}(P)\coloneq\frac{\mathbb{E}_{P}[(D-\mathbb{E}_{P}[D\,|\,W])Y]}{\mathbb{E}_{P}[(D-\mathbb{E}_{P}[D\,|\,W])^{2}]}=\frac{\mathbb{E}_{P}[\cov_{P}(D,Y\,|\,W)]}{\mathbb{E}_{P}[\var_{P}(D\,|\,W)]}, (3) where we use a subscript P to indicate that an operator is computed under the distribution P . This estimand unambiguously defines a target parameter without reference to a (semi)parametric model, and the conditions for being well-defined are clear from the expression, unlike the model-based estimand \tau_{\text{mb}} . 2 2 2 Both estimands are well-defined under the moment conditions \mathbb{E}_{P}[|DY|]<\infty and \mathbb{E}_{P}[D^{2}]<\infty and the positivity condition \mathbb{E}_{P}[\var_{P}(D\,|\,W)]>0 . To see how \tau_{\text{mf}} is a generalization of \tau_{\text{mb}} , consider a distribution \mathsf{P}\in\mathcal{P} that follows the partially linear model : \mathbb{E}_{\mathsf{P}}[Y\,|\,D,W]=\beta_{\mathsf{P}}D+g_{\mathsf{P}}(W), (4) where \beta_{\mathsf{P}}\in\real and where g_{\mathsf{P}} is an integrable function with respect to the distribution of W under \mathsf{P} . This semiparametric model generalizes the linear model by allowing a more flexible dependency on the covariates W . By applying iterated expectations conditionally on W , we obtain that \displaystyle\tau_{\text{mf}}(\mathsf{P})=\frac{\mathbb{E}_{\mathsf{P}}[(D-\mathbb{E}_{\mathsf{P}}[D\,|\,W])(\beta_{\mathsf{P}}D+g_{\mathsf{P}}(W))]}{\mathbb{E}_{\mathsf{P}}[(D-\mathbb{E}_{\mathsf{P}}[D\,|\,W])^{2}]}=\beta_{\mathsf{P}}\frac{\mathbb{E}_{\mathsf{P}}[D^{2}-(\mathbb{E}_{\mathsf{P}}[D\,|\,W])^{2}]}{\mathbb{E}_{\mathsf{P}}[(D-\mathbb{E}_{\mathsf{P}}[D\,|\,W])^{2}]}=\beta_{\mathsf{P}}. This shows that \tau_{\text{mf}} reduces to the coefficient \beta_{\mathsf{P}} in the (partially) linear model. Thus, we can more generally make sense of estimators that target \tau_{\text{mf}} , while maintaining the same interpretation within the (partially) linear model. There can exist multiple extensions of a model-based estimand. For example, another possible extension of \tau_{\text{mb}} is the average partial effect , defined by \displaystyle\tau_{\text{ape}}(P)=\mathbb{E}_{P}\left[\frac{\partial}{\partial d}\mathbb{E}_{P}[Y\,|\,D=d,W]|_{d=D}\right]. (5) Within the partially linear model ( 4 ), we observe that the derivative inside the expectation equals \beta , and, consequently, \tau_{\text{ape}} is also a model-free extension of \tau_{\text{mb}} . Arguably, the estimand \tau_{\text{ape}} offers more direct interpretations for causal analyses than \tau_{\text{mf}} . However, \tau_{\text{mf}} can also serve as a reasonable summary of conditional association, and estimators of \tau_{\text{mf}} may be more robust and well-behaved than those of \tau_{\text{ape}} ( Lundborg and Pfister, 2023 ) . 2.2 Estimation In this section, we explore how \sqrt{n} -consistent estimation of an estimand can be achieved, even when dealing with complex or high-dimensional underlying DGPs. A substantial body of work exists on nonparametric estimation using influence functions , with methods such as one-step estimation ( Pfanzagl and Wefelmeyer, 1985 ; Bickel et al., 1998 ) and Targeted Maximum Likelihood Estimation (TMLE) ( van der Laan and Rose, 2011 ) . This literature is well summarized in tutorial papers by, e.g., Hines et al. (2022) and Kennedy (2022) . While the theory of influence functions is useful for defining an effective estimator, rigorously establishing the distributional properties of the estimator is a task that is typically done through case-specific analysis. In this introduction, we focus on this task through direct and concrete analyses, without invoking influence functions. Drawing from Chernozhukov et al. (2018) , we begin with a motivating example, emphasizing an estimand-based perspective rather than a semiparametric (score-based) approach. After discussing the example, we will explore how these insights can be extended to more general contexts. 2.2.1 An instructive example Consider again the setting where the observed sample Z_{1},\ldots,Z_{n} consists of i.i.d. copies of Z=(D,W,Y)\in\real\times\real^{d-1}\times\real with Z\sim P\in\mathcal{P} . Suppose our target of interest is the numerator of ( 3 ), i.e., the estimand \rho\colon\mathcal{P}\to\real given by \displaystyle\rho(P)\coloneq\mathbb{E}_{P}[(D-\mathbb{E}_{P}[D\,|\,W])Y]. (6) This estimand has been studied for the purpose of quantifying and testing conditional (mean) independence ( Shah and Peters, 2020 ; Lundborg, 2023 ) . We shall assume that D,Y , and DY are square-integrable under each P\in\mathcal{P} , which in particular ensures that \rho is well-defined. Expression ( 6 ) combines two components of the distribution: the expectation operator, \mathbb{E}_{P}[\cdot] , and the conditional mean function, m_{P}(\cdot)\coloneq\mathbb{E}_{P}[D\,|\,W=\cdot] . According to the central limit theorem (CLT), the expectation operator is pointwise \sqrt{n} -approximated by the empirical mean operator, denoted \mathbb{P}_{n}[\cdot] and given by \mathbb{P}_{n}[f(Z)]\coloneq\frac{1}{n}\sum_{i=1}^{n}f(Z_{i}) , for any function f\in\mathcal{L}^{2}(P) . Distributional quantities that are used to compute the target estimand, but are not of primary interest, such as m_{P} , are called nuisance parameters . Estimating conditional means can be done using various regression methods, including model-free prediction algorithms from machine learning (ML), which we discuss further in Section 2.2.3 . Assume, for now, that an estimate \widehat{m} of m_{P} is given. This suggests the estimator \displaystyle\hat{\rho}^{\text{plug-in}}\coloneq\mathbb{P}_{n}[(D-\widehat{m}(W))Y]=\frac{1}{n}\sum_{i=1}^{n}(D_{i}-\widehat{m}(W_{i}))Y_{i}. Estimators like \hat{\rho}^{\text{plug-in}} , which are derived by substituting nuisance estimates directly into the expression for the estimand, are often referred to as plug-in estimators. However, it is important to note that such estimators are not necessarily of the form \rho(\widehat{P}) for an estimate \widehat{P}\in\mathcal{P} of the entire distribution P , which is a commonly used representation for plug-in estimators. As we will see shortly, there can be multiple valid expressions for the same estimand, resulting in different plug-in estimators. To understand the behavior of this estimator, consider the following decomposition \displaystyle\sqrt{n}(\hat{\rho}^{\text{plug-in}}-\rho(P)) \displaystyle=\sqrt{n}\mathbb{P}_{n}[(D-\widehat{m}(W))Y]-\sqrt{n}\mathbb{E}_{P}[(D-m_{P}(W))Y] \displaystyle=\underbrace{\sqrt{n}(\mathbb{P}_{n}-\mathbb{E}_{P})[(D-m_{P}(W))Y]}_{\eqcolon U^{\text{plug-in}}}+\underbrace{\sqrt{n}\mathbb{P}_{n}[(m_{P}(W)-\widehat{m}(W))Y]}_{\eqcolon R^{\text{plug-in}}}. The term U^{\text{plug-in}} is an oracle term that describes the error of the plug-in estimator based on the true conditional mean m_{P}(\cdot) . The CLT asserts that U^{\text{plug-in}} converges in distribution to a Gaussian distribution with mean zero. The term R^{\text{plug-in}} is a sum of n conditionally i.i.d. terms that are controlled by the estimation error of m_{P}(\cdot) . As we discuss in Section 2.2.3 , we can generally expect the root mean squared error (RMSE) of \widehat{m}(\cdot) to converge at a rate of n^{-\alpha} , where \alpha\in(0,\frac{1}{2}) . Consequently, if \mathbb{E}_{P}[Y\,|\,W]\neq 0 , then we can expect R^{\text{plug-in}} to be of stochastic order n^{\frac{1}{2}-\alpha} , in which case |\sqrt{n}(\hat{\rho}^{\text{plug-in}}-\rho(P))|\xrightarrow{P}\infty. This is, of course, undesirable and makes inference about \rho(P) based on \hat{\rho}^{\text{plug-in}} intractable. Fortunately, the bias in R^{\text{plug-in}} can be fixed by adding a correction term in the expression. Motivated by the fact that R^{\text{plug-in}} becomes centered when \mathbb{E}_{P}[Y\,|\,W]=0 , we rewrite the estimand as \displaystyle\rho(P)=\mathbb{E}_{P}[(D-\mathbb{E}_{P}[D\,|\,W])(Y-\mathbb{E}_{P}[Y\,|\,W])]. (7) This introduces a new nuisance parameter, g_{P}(\cdot)\coloneq\mathbb{E}_{P}[Y\,|\,W=\cdot] , which can be estimated similarly to m_{P}(\cdot) , e.g., using an ML algorithm, yielding another estimate \widehat{g}(\cdot) . This suggests the following estimator, \displaystyle\hat{\rho}^{\text{double}}=\mathbb{P}_{n}[(D-\widehat{m}(W))(Y-\widehat{g}(W))]=\frac{1}{n}\sum_{i=1}^{n}(D_{i}-\widehat{m}(W_{i}))(Y_{i}-\widehat{g}(W_{i})). (8) To understand why \hat{\rho}^{\text{double}} might be preferable to \hat{\rho}^{\text{plug-in}} , we can decompose its estimation error as follows: \displaystyle\sqrt{n}(\hat{\rho}^{\text{double}}-\rho(P))=U+R_{m}+R_{g}+R_{mg} (9) where \displaystyle U \displaystyle=\sqrt{n}(\mathbb{P}_{n}-\mathbb{E}_{P})[(D-m_{P}(W))(Y-g_{P}(W))], \displaystyle R_{m} \displaystyle=\sqrt{n}\mathbb{P}_{n}[(m_{P}(W)-\widehat{m}(W))(Y-g_{P}(W))], \displaystyle R_{g} \displaystyle=\sqrt{n}\mathbb{P}_{n}[(D-m_{P}(W))(g_{P}(W)-\widehat{g}(W))], \displaystyle R_{mg} \displaystyle=\sqrt{n}\mathbb{P}_{n}[(m_{P}(W)-\widehat{m}(W))(g_{P}(W)-\widehat{g}(W))]. The first term, U , is again an oracle term that is asymptotically Gaussian, that is, U\xrightarrow{d}\mathrm{N}(0,\sigma_{P}^{2}) with asymptotic variance \sigma_{P}^{2}\coloneq\var_{P}((D-m_{P}(W))(Y-g_{P}(W))) . We will argue that, under suitable conditions, the error terms R_{m},R_{g} , and R_{mg} converge to zero in probability, in which case Slutsky’s theorem asserts that \sqrt{n}(\hat{\rho}^{\text{double}}-\rho(P))\xrightarrow{d}\mathrm{N}(0,\sigma_{P}^{2}). (10) There are several strategies for controlling a term like R_{m} , which we elaborate further in Section 2.2.4 . For simplicity, let us assume that \widehat{m}(\cdot) is estimated on an auxiliary sample that is independent from the sample (Z_{i})_{i\in[n]} used in \mathbb{P}_{n} , where [n]\coloneq\{1,\ldots,n\} . Then, the summands in R_{m} are independent conditionally on \widehat{m} and (W_{i})_{i\in[n]} , and their conditional means are zero since \mathbb{E}[Y_{i}\,|\,\widehat{m},(W_{j})_{j\in[n]}]=\mathbb{E}[Y_{i}\,|\,W_{i}]=g_{P}(W_{i}) for i\in[n] . Note that the first equality crucially relies on \widehat{m} being estimated on an independent sample. It follows that the conditional variance of R_{m} is given by \displaystyle\var_{P}(R_{m}\,|\,\widehat{m},(W_{i})_{i\in[n]})=\frac{1}{n}\sum_{i=1}^{n}(\widehat{m}(W_{i})-m_{P}(W_{i}))^{2}\var_{P}(Y_{i}\,|\,W_{i}). Thus, if there exists a bound C>0 such that \var_{P}(Y\,|\,W)\leq C almost surely and if \widehat{m} is (out-of-sample) RMSE consistent for m_{P} , then it holds that \var_{P}(R_{m}\,|\,\widehat{m},(W_{i})_{i\in[n]})\xrightarrow{P}0 . In this case, an application of Chebyshev’s inequality, conditionally on \widehat{m} and (W_{i})_{i\in[n]} , lets us to conclude that R_{m}\xrightarrow{P}0 . Since R_{m} and R_{g} are symmetric in (m_{P},D) and (g_{P},Y) , the same argument can be applied to show that R_{g}\xrightarrow{P}0 under analogous conditions on \widehat{g} and \var_{P}(D\,|\,W) . For the product error term, R_{mg} , the Cauchy-Schwarz inequality yields that \displaystyle R_{mg}\leq\sqrt{n}\cdot\sqrt{\mathbb{P}_{n}[(\widehat{m}(W)-m_{P}(W))^{2}]}\cdot\sqrt{\mathbb{P}_{n}[(\widehat{g}(W)-g_{P}(W))^{2}]}. (11) As a consequence, we see that R_{mg}\xrightarrow{P}0 if the product of the RMSE for \widehat{m}(\cdot) and the RMSE for \widehat{g}(\cdot) decays at an order of o_{P}(n^{-1/2}) . When the rate requirements for nuisance estimators reduce to this condition, we say that the estimator exhibits rate double robustness . There are several settings where this requirement can be achieved by nonparametric regression estimators, as we elaborate in Section 2.2.3 . We proceed to discuss, from a more general perspective, conditions under which an estimator may exhibit (rate) double robustness. 2.2.2 Double robustness and orthogonality In this section, we generalize some of the insights obtained from the example in the preceding section, and we derive a condition required for rate double robustness. Suppose that \tau\colon\mathcal{P}\to\real is an estimand that can be written of the form \displaystyle\tau(P)=\frac{\mathbb{E}_{P}[\psi(Z,\eta_{0}(P))]}{\mathbb{E}_{P}[\phi(Z,\eta_{0}(P))]}, (12) where \eta_{0}\colon\mathcal{P}\to\mathcal{E} is a nuisance parameter, and where \phi,\psi\colon\mathcal{Z}\times\mathcal{E}\to\real are measurable maps, with \mathcal{Z} denoting the sample space for Z . We assume that for all \eta\in\mathcal{E} and P\in\mathcal{P} , the random variables \psi(Z,\eta) and \phi(Z,\eta) are integrable under P with \mathbb{E}_{P}[\phi(Z,\eta)]\neq 0 . Note that all the estimands considered so far have been of this form. An estimand may be written of the form ( 12 ) in more than one way, as was highlighted in Section 2.2.1 . Given a nuisance estimate \widehat{\eta}\in\mathcal{E} of \eta_{0}(P) , we can define a plug-in estimator more generally as: \widehat{\tau}(\widehat{\eta})=\frac{\mathbb{P}_{n}[\psi(Z,\widehat{\eta})]}{\mathbb{P}_{n}[\phi(Z,\widehat{\eta})]} (13) Both \hat{\rho}^{\text{plug-in}} and \hat{\rho}^{\text{double}} were conceived in this way, so why does \hat{\rho}^{\text{double}} exhibit rate double robustness while \hat{\rho}^{\text{plug-in}} does not? To answer this question, consider first an estimand that can be written of the form ( 12 ) with \phi(\cdot,\cdot)\equiv 1 , and let \eta_{P}\coloneq\eta_{0}(P) . We can then decompose the general plug-in estimator ( 13 ) similarly to the example in Section 2.2.1 : \displaystyle\sqrt{n}(\widehat{\tau}(\widehat{\eta})-\tau(P))=\sqrt{n}(\mathbb{P}_{n}-\mathbb{E}_{P})[\psi(Z,\eta_{P})]+\sqrt{n}\mathbb{P}_{n}[\psi(Z,\widehat{\eta})-\psi(Z,\eta_{P})] The first term is again an oracle term, whose behavior is governed by the CLT. To analyze the second term, we may appeal to a Taylor expansion. Assume that \mathcal{E} is a convex set, and assume that the map r\mapsto\psi(z,\eta_{P}+r(\eta-\eta_{P})) is two times continuously differentiable for all (z,\eta)\in\mathcal{Z}\times\mathcal{E} . Then, a Taylor expansion yields that \displaystyle\sqrt{n}\mathbb{P}_{n}[\psi(Z,\widehat{\eta})- \displaystyle\psi(Z,\eta_{P})] (14) \displaystyle=\underbrace{\sqrt{n}\mathbb{P}_{n}[\partial_{r}\psi(Z,\eta_{P}+r(\widehat{\eta}-\eta_{P}))|_{r=0}]}_{\eqcolon T_{1}}+\underbrace{\sqrt{n}\mathbb{P}_{n}[R_{2}(Z,\eta_{P},\widehat{\eta})]}_{\eqcolon T_{2}}, (15) where R_{2}(Z,\eta_{P},\widehat{\eta}) is a second-order remainder term that is left unspecified for now. As we will discuss in Section 2.2.3 , we can generally expect a nuisance estimator to converge at a rate of n^{-\alpha} , where \alpha\in(0,\frac{1}{2}) . To simplify the analysis, suppose that \widehat{\eta}-\eta_{P}=n^{-\alpha}\Delta\eta for a fixed \Delta\eta\in\mathcal{E} . Although this might seem like an oversimplification, if the plug-in estimator is \sqrt{n} -consistent for general nuisance estimates, we can reasonably expect it to be \sqrt{n} -consistent under this simplifying assumption. Then, by the chain rule, T_{1}=n^{\frac{1}{2}-\alpha}(\mathbb{P}_{n}-\mathbb{E}_{P})[\partial_{r}\psi(Z,\eta_{P}+r\Delta\eta)|_{r=0}]+n^{\frac{1}{2}-\alpha}\partial_{r}\mathbb{E}_{P}[\psi(Z,\eta_{P}+r\Delta\eta)]|_{r=0} provided we can interchange derivative and expectation. The first term vanishes in probability, whereas the absolute value of the second term is either diverging to infinity or equal to zero for all n . In conclusion, we can expect T_{1} to vanish in probability if for all \eta\in\mathcal{E} : \partial_{r}\mathbb{E}_{P}\left[\psi(Z,\eta_{P}+r(\eta-\eta_{P})\right]|_{r=0}=0 (16) We can interpret the condition ( 16 ) as the bias of the plug-in estimator not being sensitive to small estimation errors of the nuisance parameter \eta_{0} . The condition ( 16 ) is similar to a condition at the core of Double Machine Learning (DML) ( Chernozhukov et al., 2018 ) . Indeed, we can explicitly translate ( 12 ) into the DML framework by considering (\tau_{P},\eta_{P})\coloneq(\tau(P),\eta_{0}(P)) as solutions to the score equation \mathbb{E}_{P}[S(Z;\theta,\eta))]=0,\qquad\text{where}\quad S(Z;\theta,\eta)\coloneq\theta\cdot\phi(Z,\eta)-\psi(Z,\eta). (17) Definition 2.1 in Chernozhukov et al. (2018) states that the score S satisfies the Neyman orthogonality condition at (\tau_{P},\eta_{P}) if \partial_{r}\mathbb{E}_{P}\left[S(Z;\tau_{P},\eta_{P}+r(\eta-\eta_{P}))\right] exists for all \eta\in\mathcal{E} and r\in[0,1) , and if \partial_{r}\mathbb{E}_{P}\left[S(Z;\tau_{P},\eta_{P}+r(\eta-\eta_{P}))\right]|_{r=0}=0. (18) This is essentially equivalent to ( 16 ) and \partial_{r}\mathbb{E}_{P}\left[\phi(Z,\eta_{P}+r(\eta-\eta_{P})\right]|_{r=0}=0 . Orthogonality is paramount in order for an estimator \widehat{\tau} of the form ( 13 ) to satisfy that \sqrt{n}(\widehat{\tau}-\tau_{P})\xrightarrow{d}\mathrm{N}(0,\sigma_{P}^{2}) for some \sigma_{P}^{2}>0 . It is straightforward to verify that the expression in ( 7 ) corresponds to a score that satisfies the orthogonality condition, whereas the expression ( 6 ) does not, unless g_{P}\equiv 0 . Heuristically, this explains why \widehat{\psi}^{\text{double}} , which is based on ( 7 ), exhibits rate double robustness. Orthogonality alone is not sufficient to ensure asymptotic normality, and Chernozhukov et al. (2018) provide additional conditions that ensure this; see their Assumptions 3.1 and 3.2. However, these conditions essentially entail a reformulation of the condition that T_{2}\xrightarrow{P}0 , cf. Assumption 3.2(c). Obtaining a general bound for T_{2} with minimal assumptions is a complex task, so T_{2} is typically analyzed case-by-case. When the nuisance parameter \eta_{P}=(\eta_{P,1},\ldots,\eta_{P,q}) consists of several nuisance functions, it is often possible to establish a bound in the form: \displaystyle T_{2}\leq O_{P}\Big(\sqrt{n}\sum_{(i,j)\in\mathcal{S}}\|\widehat{\eta}_{i}-\eta_{P,i}\|\cdot\|\widehat{\eta}_{j}-\eta_{P,j}\|\Big), (19) for a set \mathcal{S}\subseteq[q]\times[q] . This represents a general form of rate double robustness, which is met, for example, when \|\widehat{\eta}_{i}-\eta_{P,i}\|=o_{P}(n^{-1/4}) for each i\in[q] . The bound ( 11 ), for instance, is of this form. Keeping the orthogonality condition – or analogous conditions in other frameworks – in mind when constructing an estimator is crucial. This approach is taken in [ LCM ], [ ACM ], and [ DOPE ], though the details of the latter are more intricate. 2.2.3 Estimation of nuisance parameters using machine learning The estimation procedures discussed up to this point have relied on the ability to estimate the nuisance parameter, and the analysis suggested that an estimation error of order n^{-1/4} would be sufficient. Often, the nuisance parameter consists of functions given by conditional expectations, as in Section 2.2.1 with \eta(P)=(m_{P},g_{P}) . To discuss estimation of such nuisance functions, consider a generic regression setting where Z=(X,Y)\in\real^{d}\times\real and suppose that f_{P}(\cdot)\coloneq\mathbb{E}_{P}[Y\,|\,X=\cdot] is the nuisance parameter. Assuming that \mathbb{E}_{P}[Y^{2}]<\infty , recall that f_{P}\in\argmin_{f\in\mathcal{F}}\mathbb{E}_{P}[(Y-f(X))^{2}] for any collection of measurable functions \mathcal{F} that contains f_{P} . This connects the estimation of the conditional mean function, f_{P} , with the minimization of the mean squared prediction error over a sufficiently rich function class. When f_{P} is known to be linear, this naturally leads to ordinary least squares, and the resulting estimator for f_{P} converges at a rate of O_{P}(n^{-1/2}) under a few additional conditions. Similarly, other classical regression techniques based on semiparametric models that represent \mathcal{F} based on a finite-dimensional representation, such as GLMs, generally yield \sqrt{n} -consistent estimators of f_{P} when the model is correctly specified. However, contemporary datasets and regression competitions, such as those hosted by Kaggle ( Bojer and Meldgaard, 2021 ) , indicate that ML methods, e.g. random forests, gradient boosting, and neural nets, routinely and significantly outperform classical regression methods in terms of prediction accuracy. This suggests that the function classes corresponding to classical methods are not rich enough to capture good approximations of the truth. Considering larger nonparametric function classes can come with two challenges: it can make the resulting optimization problem difficult and usually leads to overfitting if implemented naively. Remarkable advancements in machine learning have resulted in powerful and efficient tools for handling optimization tasks with few assumptions on the function class. To prevent overfitting, these methods often depend on advanced (implicit) regularization techniques, making them difficult to analyze theoretically. In view of the above, it is often left as a general assumption that the nuisance parameter can be estimated with a sufficiently fast rate. This assumption can be justified based on (i) the empirical observation that machine learning estimators perform well in practice and (ii) by comparing with achievable (minimax) rates for reasonable function classes. To elaborate on (ii), suppose, for example, that f_{P} is known to be differentiable up to order \lfloor{s}\rfloor , with partial derivatives of order \lfloor{s}\rfloor that are (s-\lfloor{s}\rfloor) -Hölder continuous, for some s>0 . In the absence of additional constraints on f_{P} , the optimal uniform estimation rate is O_{P}(n^{-\frac{s}{2s+d}}) , which can be attained using local polynomials ( Györfi et al., 2002 ; Tsybakov, 2009 ) . The key insight is not necessarily to use local polynomials, but to understand that effective estimators of f_{P} can attain an estimation rate, e.g., of order n^{-1/4} , when f_{P} has a smoothness of order s>d/2 . While the discussion above revolves around conditional mean estimation, other estimation tasks might also be of interest. Estimation of the average partial effect ( 5 ) with DML requires density and derivative estimation ( Klyne and Shah, 2023 ) , and in both [ LCM ] and [ ACM ] we require estimation of conditional hazards. Such estimation methods are discussed within each manuscript, see for example Section 3 in [ LCM ]. 2.2.4 Controlling cross-terms by cross-fitting In this section we elaborate the discussion of how to control cross-terms such as R_{m} and R_{g} from the decomposition ( 9 ) of \sqrt{n}(\hat{\rho}-\rho(P)) . More generally, in Section 2.2.2 we encountered the ‘first-order’ term T_{1}=\sqrt{n}\mathbb{P}_{n}[\partial_{r}\psi(Z,\eta_{P}+r(\widehat{\eta}-\eta_{P}))|_{r=0}]. By simplifying the analysis and considering the deterministic sequence of nuisance estimates \widehat{\eta}=\eta_{P}+n^{-\alpha}\Delta\eta for a fixed \Delta\eta\in\mathcal{E} , we derived that the orthogonality condition ( 16 ) was essential for achieving T_{1}\xrightarrow{P}0 . We now discuss how to proceed when \widehat{\eta} is a stochastic estimate, e.g., obtained by machine learning as described in Section 2.2.3 . When \widehat{\eta} is estimated independently of the sample in \mathbb{P}_{n} , the orthogonality condition ( 16 ) implies that T_{1} has mean zero conditionally on \widehat{\eta} . In many concrete examples, we can then control the conditional variance of T_{1} by the error in nuisance estimation, in which case the convergence T_{1}\xrightarrow{P}0 follows from consistency of the nuisance estimator and Chebyshev’s inequality. For example, this was the case for the estimator \hat{\rho}^{\text{double}} in ( 8 ), where it is straightforward to show that T_{1}=R_{m}+R_{g} . Obtaining an independent nuisance estimate can be achieved by initially splitting the sample into two folds , and then using first part for nuisance estimation and the second part for plug-in estimation. This comes at the cost of reducing the effective sample size. However, it is possible to recover full-sample efficiency by swapping the roles of the two folds and then aggregating the resulting estimates. More generally, we can perform K -fold cross-fitting for any integer K\geq 2 as follows: i) Partition the observation indices into K disjoint folds: [n]=I_{1}\cup\cdots\cup I_{K} . ii) For each k\in[K] , use the holdout data (Z_{i})_{i\in[n]\setminus I_{k}} to compute an ML estimate \widehat{\eta}_{k} . iii) Compute the plug-in estimates on each fold and aggregate the estimates by \check{\tau}\coloneq\frac{1}{K}\sum_{k=1}^{K}\underbrace{\frac{\sum_{i\in I_{k}}\psi(Z_{i},\widehat{\eta}_{k})}{\sum_{i\in I_{k}}\phi(Z_{i},\widehat{\eta}_{k})}}_{\widehat{\tau}_{k}},\qquad\text{or}\qquad\tilde{\tau}\coloneq\frac{\frac{1}{K}\sum_{k=1}^{K}\sum_{i\in I_{k}}\psi(Z_{i},\widehat{\eta}_{k})}{\frac{1}{K}\sum_{k=1}^{K}\sum_{i\in I_{k}}\phi(Z_{i},\widehat{\eta}_{k})}. (20) The estimators \check{\tau} and \tilde{\tau} are known as the dml 1 and dml 2 estimators, respectively (see Definitions 3.1 and 3.2 in Chernozhukov et al. (2018) ). The estimators are asymptotically equivalent (under conditions) and they are equal when \phi is a constant, which was the case in ( 7 ). In small samples, however, dml 2 may perform better due to the increased numerical stability achieved by pooling the estimates before division. The dml 1 estimator is considered in all the manuscripts in this thesis; therefore, we present a simple result for its asymptotics. Lemma 2.2.1 (Asymptotics of dml 1 estimator) . Let \check{\tau} and (\widehat{\tau}_{k})_{k\in[K]} be the estimators defined in ( 20 ) and let \sigma_{P}^{2}>0 . Suppose that each k\in[K] , \lim_{n\to\infty}n/|I_{k}|=K\qquad\text{and}\qquad\sqrt{|I_{k}|}\cdot(\widehat{\tau}_{k}-\tau_{P})=U_{k}+R_{k}, where U_{k} and R_{k} are variables satisfying that U_{k}\xrightarrow{d}\mathrm{N}(0,\sigma_{P}^{2}) and R_{k}\xrightarrow{P}0 as n\to\infty . Assume also the joint independence statement U_{1}\,\perp\!\!\!\perp\,\cdots\,\perp\!\!\!\perp\,U_{K} . Then it holds that \sqrt{n}(\check{\tau}-\tau_{P})\xrightarrow{d}\mathrm{N}(0,\sigma_{P}^{2}) as n\to\infty . Proof. The conditions on I_{k},U_{k} , and R_{k} imply that \tilde{U}_{k}\coloneq\frac{\sqrt{n}}{\sqrt{K|I_{k}|}}U_{k}\xrightarrow{d}\mathrm{N}(0,\sigma_{P}^{2})\qquad\text{and}\qquad\tilde{R}_{k}\coloneq\frac{\sqrt{n}}{\sqrt{K|I_{k}|}}R_{k}\xrightarrow{P}0. By joint independence, it follows that (\tilde{U}_{1},\ldots,\tilde{U}_{k})\xrightarrow{d}\mathrm{N}(0,\sigma_{P}^{2})^{\otimes K} ( Billingsley, 2013 , Theorem 2.8(ii)) . By continuous mapping and the convolution property of the Gaussian distribution, we conclude that \displaystyle\sqrt{n}(\check{\tau}-\tau_{P})=\frac{1}{\sqrt{K}}\sum_{k=1}^{K}(\tilde{U}_{k}+\tilde{R}_{k})\xrightarrow{d}\mathrm{N}(0,\sigma_{P}^{2}) as n\to\infty . ∎ In practice, we can apply the lemma with oracle terms (U_{k}) corresponding to using the oracle nuisance estimate \eta_{P} . In this case, it simplifies the analysis of the dml 1 estimator to that of a single sample split estimator \widehat{\tau}_{k} . Note that the dml 1 estimator indeed recovers full-sample efficiency, as it is scaled by \sqrt{n} rather than \sqrt{|I_{k}|} . In particular, the asymptotic distribution is independent of the number of folds K . The choice of K will have a practical impact in smaller samples, as it will affect the remainder terms (R_{k})_{k\in[K]} , which are controlled by the nuisance estimation error. Larger values of K will allocate more data to the estimation of the nuisance parameter and are thus likely to result in smaller error terms. However, this also comes at the cost of higher computational demand since the nuisance estimator has to be fitted K times. Choosing K=4 or K=5 might be reasonable in practice, cf. Remark 3.1. in Chernozhukov et al. (2018) , which was also consistent with the findings in the simulation studies conducted for the work in this thesis. 2.2.5 Alternatives to cross-fitting In the preceding discussion, we have covered how cross-fitting can be used to control the cross-term. This raises the question: Is cross-fitting necessary? (21) There is no simple or general answer to this question, and it is instead typically discussed on a case-specific basis. In [ LCM ] and [ ACM ], we found that cross-fitting was necessary, and for [ DOPE ] we found that cross-fitting was neither necessary nor significantly detrimental. To understand how a cross-term might be controlled without cross-fitting, consider again the term R_{m} from ( 9 ), but now as a map \displaystyle R_{m}(\bar{m})\coloneq\frac{1}{\sqrt{n}}\sum_{i=1}^{n}(m_{P}(W_{i})-\bar{m}(W_{i}))(Y_{i}-g_{P}(W_{i})) which takes as input any measurable function \bar{m}\colon\real^{d-1}\to\real . Assuming for simplicity that |Y|\leq C for some constant C>0 , the CLT implies that for each \bar{m}\in\mathcal{L}^{2}(P_{W}) , R_{m}(\bar{m})\xrightarrow{d}\mathrm{N}(0,\nu_{P}(\bar{m})) (22) as n\to\infty , where \nu_{P}(\bar{m})\coloneq\mathbb{E}_{P}[(m_{P}(W)-\bar{m}(W))^{2})(Y-g_{P}(W))^{2}] . The question ( 21 ) is now whether R_{m}(\widehat{m})\xrightarrow{P}0 can be established from a consistency condition of \widehat{m} , e.g., \nu_{P}(\widehat{m})\xrightarrow{P}0 . Unfortunately, this is not generally true, but it can be concluded under additional assumptions on \widehat{m} . Donsker class conditions: Let \mathcal{F}_{m}\subset\mathcal{L}^{2}(P_{W}) denote a function space such that \widehat{m}\in\mathcal{F}_{m} almost surely. A sufficient condition for the implication \nu_{P}(\widehat{m})\xrightarrow{P}0\quad\implies\quad R_{m}(\widehat{m})\xrightarrow{P}0 (23) to hold is that the collection of random variables \displaystyle\{(m_{P}(W)-\bar{m}(W))(Y-g_{P}(W))\colon\bar{m}\in\mathcal{F}_{m}\} is a Donsker class. See, for example, Lemma 19.24 in van der Vaart (2000) . Informally, this Donsker class condition means that the weak convergence ( 22 ) holds uniformly over \bar{m}\in\mathcal{F}_{m} . There are numerous ways to establish the Donsker condition in itself, which typically involve technical bounds on the ‘size’ of the function class \mathcal{F}_{m} . However, these conditions are unsuitable for high-dimensional settings ( Chernozhukov et al., 2018 ) or when the nuisance estimates belong to a complex function class. Algorithmic stability: More recently, Chen et al. (2022) have shown that cross-fitting can be avoided when the algorithm for producing the nuisance estimates is stable . Informally, this means that the learned function does change significantly when the training data is perturbed, and there are several different definitions that formalize this idea. For the cross-term R_{m} , Proposition S15 in Lundborg et al. (2022a) describes algorithmic stability conditions that guarantee R_{m}(\widehat{m})\xrightarrow{d}0 without the need for cross-fitting. It is possible to verify that certain algorithms are stable, see, for example, Hardt et al. (2016) ; Bousquet and Elisseeff (2002) , and recent work has shown that bagging can increase the stability of any algorithm ( Soloff et al., 2024b ; Soloff et al., 2024a ) . These works, however, are not all working under the same notion of stability, and it is therefore unclear to what extent bagging can be used as a replacement for cross-fitting. Donsker class conditions and algorithmic stability have not been investigated in depth in this thesis. However, the analysis of cross-terms plays a central role in the asymptotic theory, and these terms are controlled by cross-fitting or the aforementioned alternative conditions. Since the answer to question ( 21 ) appears to be yes in both [ LCM ] and [ ACM ], these alternative conditions must somehow be violated. A deeper understanding of why these conditions are violated could provide valuable insights into our methods. Chapter 3 Nonparametric conditional local independence testing Alexander Mangulad Christgau, Lasse Petersen and Niels Richard Hansen 3.1 Introduction Notions of how one variable influences a target variable are central to both predictive and causal modeling. Depending on the objective, the relevant notion of influence can be variable importance in a predictive model of the target, but it can also be the causal effect of the variable on the target. In either case, we can investigate influence conditionally on a third variable – to quantify the added predictive value, the direct causal effect or the causal effect adjusted for a confounder. Our interests are in an asymmetric notion of direct influence among stochastic processes, which is not adequately captured by classical (symmetric) notions of conditional dependence. The objective of this paper is therefore to quantify this notion of asymmetric influence and specifically to develop a new nonparametric test of the hypothesis that one stochastic process does not directly influence another. The hypothesis we consider is that of local independence – a concept introduced by Schweder (1970) for Markov processes as a continuous time formalization of the phenomenon that the past of one stochastic process does not directly influence the evolution of another stochastic process. Generalizations to other continuous time processes were given by Aalen (1987) and studied by Commenges and Gégout-Petit (2009) , who systematically used the term conditional local independence for the general concept. We will in this paper follow that convention whenever we want to emphasize the conditional nature of the local independence. We note that (conditional) local independence is a continuous time version of the discrete time concept of Granger non-causality ( Granger, 1969 ; Aalen, 1987 ) . To illustrate the concept of conditional local independence we will in this introduction consider an example involving three processes: X , Z and N – see Figure 3.1.1 . The process N is the indicator of death, N_{t}=\mathbbl{1}(T\leq t) , for an individual with survival time T , and X_{t} denotes the total pension savings of the individual at time t . The process Z is a covariate process, e.g., health variables or employment status, that may directly affect both the pension savings and the survival time. This is indicated in Figure 3.1.1 by edges pointing from Z to X and N . Edges pointing from N to X and Z indicate that a death event directly affects both X and Z (which take the values X_{T} and Z_{T} , respectively, after time T , see Section 3.2.2 ). To define conditional local independence let \mathcal{F}^{N,Z}_{t}=\sigma(N_{s},Z_{s};s\leq t) denote the filtration generated by the N - and Z -processes. The \sigma -algebra \mathcal{F}_{t}^{N,Z} represents the information contained in the N - and the Z - processes before time t . Informally, the process N_{t} is conditionally locally independent of the process X_{t} given \mathcal{F}_{t}^{N,Z} if (X_{s})_{s\leq t} does not add predictable information to \mathcal{F}_{t-}^{N,Z} about the infinitesimal evolution of N_{t} . For this particular example this means that the conditional hazard function of T does not depend on (X_{s})_{s\leq t} given \mathcal{F}_{t}^{N,Z} . In Figure 3.1.1 the hypothesis of interest, that N_{t} is conditionally locally independent of X_{t} given \mathcal{F}^{N,Z}_{t} , is represented by the lack of an edge from X to N . Z Covariate process X Pension savings N Death indicator Figure 3.1.1 : Local independence graph illustrating a dependence structure among the three processes X , Z and N . Here N is the indicator of death for an individual, X is their cumulative pension savings and Z is a covariate process. All nodes in this graph have implicit self-loops. There is no edge from X to N , which indicates that death is not directly influenced by pension savings. This can be formalized as N being conditionally locally independent of X , which is the hypothesis we aim to test. A systematic investigation of algebraic properties of conditional local independence was initiated by Didelez (2006) ; Didelez (2008) ; Didelez (2015) . She also introduced local independence graphs, such as the directed graph in Figure 3.1.1 , to graphically represent all conditional local independencies among several processes, and she studied the semantics of these graphs. This work was extended further by Mogensen and Hansen (2020) to graphical representations of partially observed systems. While we will not formally discuss local independence graphs, the problem of learning such graphs from data was an important motivation for us to develop a nonparametric test of conditional local independence. A constraint based learning algorithm of local independence graphs was given by Mogensen et al. (2018) in terms of a conditional local independence oracle, but a practical algorithm requires that the oracle is replaced by conditional local independence tests. Another important motivation for considering conditional local independence arises from causal models. With a structural assumption about the stochastic process specification, a conditional local independence has a causal interpretation ( Aalen, 1987 ; Aalen et al., 2012 ; Commenges and Gégout-Petit, 2009 ) , and if the causal stochastic system is completely observed, a test of conditional local independence is a test of no direct causal effect. See also Røysland et al. (2022) , who use local independence graphs to formulate criteria for identification of causal effects in continuous-time survival models. If the causal stochastic system is only partially observed, a conditional local dependency need not correspond to a direct causal effect due to unobserved confounding, but the projected local independence graph, as introduced by Mogensen and Hansen (2020) , retains a causal interpretation, and its Markov equivalence class can be learned by conditional local independence testing. In addition, within the framework of structural nested models, testing the hypothesis of no total causal effect can also be cast as a test of conditional local independence ( Lok, 2008 , Thm. 9.2) . To appreciate what conditional local independence means – and, in particular, what it does not mean – it is useful to compare with ordinary conditional independence. In our example, N_{t} is conditionally locally independent of X_{t} given \mathcal{F}^{N,Z}_{t} , but this implies neither that N\,\perp\!\!\!\perp\,X\mid Z (as processes), nor that N_{t}\,\perp\!\!\!\perp\,X_{t}\mid\mathcal{F}_{t}^{Z} . In fact, these conditional independencies cannot hold in this example where X_{t}=X_{T} for t\geq T – except in special cases such as T being a deterministic function of Z . Theorem 2 in Didelez (2008) gives a sufficient condition for N_{t}\,\perp\!\!\!\perp\,X_{t}\mid\mathcal{F}_{t}^{Z} to hold in terms of the local independence graph, but this condition is also not fulfilled by the graph in Figure 3.1.1 due to the edge from N to X . Moreover, conditional local independence is in general also different from the baseline conditional independence T\,\perp\!\!\!\perp\,X_{0}\mid Z_{0} unless both X and Z are time-independent, see Section 3.3.2 . In Section 3 in the supplementary material ( Christgau et al., 2023c ) , we elaborate further upon the connection to semiparametric survival models. Didelez (2008) argues that N_{t} being conditionally locally independent of X_{t} given \mathcal{F}^{N,Z}_{t} heuristically means that N_{t}\,\perp\!\!\!\perp\,\mathcal{F}^{X}_{t-}\mid\mathcal{F}_{t-}^{N,Z} , but this is technically problematic in continuous time. If T has a continuous distribution, then for any fixed t , N_{t}=N_{t-} almost surely, whence N_{t} is almost surely \mathcal{F}_{t-}^{N,Z} -measurable and conditionally independent of anything given \mathcal{F}_{t-}^{N,Z} . This heuristic can thus not be used to formally define conditional local independence in continuous time. See instead the formal Definition 2 by Didelez (2008) or our Definition 1 . Several examples from health sciences given by Didelez (2008) demonstrate the usefulness of conditional local independence for multivariate event systems, and more recent attention to event systems in the machine learning community ( Zhou et al., 2013 ; Xu et al., 2016 ; Achab et al., 2017 ; Bacry et al., 2018 ; Cai et al., 2022 ) testifies to the relevance of conditional local independence. This line of research relies primarily on the linear Hawkes process model, which is effectively used to infer local independence graphs – sometimes even interpreted causally. The Hawkes model is attractive because conditional local independencies can be inferred from corresponding kernel functions being zero – and statistical tests can readily be based on parametric or nonparametric estimation of kernels. A less attractive property of the Hawkes model is that it is not closed under marginalization. As with any model based statistical test, the validity of the test is jeopardized by model misspecification, hence even within a subsystem of a linear Hawkes process, a test of conditional local independence based on a Hawkes model may be invalid. The challenges resulting from model misspecification and marginalization is investigated further in Sections 3.2.2 and 3.6 based on an extension of our introductory example and Cox’s survival model. Both the Hawkes model and the Cox model illustrate that conditional local independence might be expressed and tested within a (semi-)parametric model, but model misspecification makes us question the validity of any such model based test. Thus there is a need for a nonparametric test of the hypothesis of conditional local independence. Moreover, since we cannot translate the hypothesis into an equivalent hypothesis about classical conditional independence, we cannot directly use existing nonparametric tests, such as the GCM ( Shah and Peters, 2020 ) or the GHCM ( Lundborg et al., 2022b ) , of conditional independence. We propose a new nonparametric test when the target process N is a counting process and X is a real valued process, and where the hypothesis is that N is conditionally locally independent of X given a filtration \mathcal{F}_{t} . In the context of the introductory example, \mathcal{F}_{t}=\mathcal{F}_{t}^{N,Z} . We consider a counting process target primarily because the theory of conditional local independence is most complete in this case, but generalizations are possible – we refer to the discussion in Section 3.7 . Within our framework we base our test on an infinite dimensional parameter, which we call the Local Covariance Measure (LCM). It is a function of time, which is constantly equal to zero under the hypothesis. Our main result is that the LCM can be estimated by using the ideas of double machine learning ( Chernozhukov et al., 2018 ) in such a way that the estimator converges uniformly at a \sqrt{n} -rate to a mean zero Gaussian martingale under the hypothesis of conditional local independence. We use the LCM to develop the (cross-fitted) Local Covariance Test ((X)-LCT), for which we derive uniform level and power results. 3.1.1 Organization of the paper In Section 3.2 we introduce the general framework for formulating the hypothesis of conditional local independence. This includes the introduction in Section 3.2.1 of an abstract residual process, which is used to define the LCM as a functional target parameter indexed by time. The LCM equals the zero-function under the hypothesis of conditional local independence, and to test this hypothesis we introduce an estimator of the LCM in Section 3.2.3 . The estimator is a stochastic process, and we describe how sample splitting is to be used for its computation via the estimation of two unknown components. In Section 3.3 we give interpretations of the LCM and its estimator. We show that the LCM estimator is a Neyman orthogonalized score statistic in Section 3.3.1 , and in Section 3.3.2 we relate LCM to the partial copula when X is time-independent. In Section 3.4 we state the main results of the paper. We establish in Section 3.4.1 that the LCM estimator generally approximates the LCM with an error of order n^{-1/2} . Under the hypothesis of conditional local independence, we show that the (scaled) LCM estimator converges weakly to a mean zero Gaussian martingale. The estimator requires a model of the target process N as well as the process X conditionally on \mathcal{F}_{t} to achieve the orthogonalization at the core of double machine learning. The model of X is in this paper expressed indirectly in terms of the residual process, and we show that if we can learn the residual process at rate g(n) and the model of N at rate h(n) such that g(n),h(n)\to 0 and \sqrt{n}g(n)h(n)\to 0 for n\to\infty then we achieve a \sqrt{n} -rate convergence of the LCM estimator. We also show that the variance function of the Gaussian martingale can be estimated consistently, and we give a general result on the asymptotic distribution of univariate test statistics based on the LCM estimator. All asymptotic results are presented in the framework of uniform stochastic convergence. Section 3.5 gives explicit examples of univariate test statistics, including the Local Covariance Test based on the normalized supremum of the LCM estimator. Its asymptotic distribution is derived and we present results on uniform asymptotic level and power. In Section 3.5.2 we present the generalization from the sample split estimator to the cross-fit estimator. Though this estimator and the corresponding cross-fit Local Covariance Test (X-LCT) are a bit more involved to compute and analyze, X-LCT is more powerful and thus our recommended test for practical usage. The survival example from the introduction is used and elaborated upon throughout the paper. We introduce a Cox model in terms of the time-varying covariate processes, and we report in Section 3.6 the results from a simulation study based on this model. The paper is concluded by a discussion in Section 3.7 . The supplementary material ( Christgau et al., 2023c ) , henceforth referred to as the supplement, consists of Sections 3 through 3 and contains: proofs of results in this paper ( 3 ); definitions and results on uniform asymptotics ( 3 ); a uniform version of Rebolledo’s martingale CLT ( 3 ); an overview of achievable rate results for estimation of nuisance parameters that enter into the LCM estimator ( 3 ); a comparison with semiparametric survival models ( 3 ); details on Neyman orthogonality ( 3 ); and additional results from the simulation study ( 3 ). 3.2 The Local Covariance Measure In this section we present the general framework of the paper, we define conditional local independence and we introduce the Local Covariance Measure as a means to quantify deviations from conditional local independence. In Section 3.2.3 we outline how the Local Covariance Measure can be estimated using double machine learning and sample splitting. We illustrate the central concepts and methods by an example based on Cox’s survival model with time-varying covariates. We consider a counting process N=(N_{t}) and another real value process X=(X_{t}) , both defined on the probability space (\Omega,\mathbb{F},\mathbb{P}) . All processes are assumed to be defined on a common compact time interval. We assume, without loss of generality, that the time interval is [0,1] . We will assume that N is adapted w.r.t. a right continuous and complete filtration \mathcal{F}_{t} , and we denote by \mathcal{G}_{t} the right continuous and complete filtration generated by \mathcal{F}_{t} and X_{t} . We assume throughout that X is càglàd (that is, has sample paths that are continuous from the left and with limits from the right), which will ensure bounded sample paths and that the process is \mathcal{G}_{t} -predictable. In the survival example of the introduction, N_{t}=\mathbbl{1}(T\leq t) is the indicator of whether death has happened by time t , and there can only be one event per individual observed. Furthermore, \mathcal{F}_{t}=\mathcal{F}_{t}^{N,Z} and \mathcal{G}_{t}=\mathcal{F}_{t}^{N,X,Z} . Our general setup works for any counting process, thus it allows for recurrent events and censoring, and the filtration \mathcal{F}_{t} can contain the histories of any number of processes in addition to the history of N itself. 3.2.1 The hypothesis of conditional local independence The counting process N is assumed to have an \mathcal{F}_{t} -intensity \lambda_{t} , that is, \lambda_{t} is \mathcal{F}_{t} -predictable and with \Lambda_{t}=\int_{0}^{t}\lambda_{s}\mathrm{d}s being the compensator of N , M_{t}=N_{t}-\Lambda_{t} (3.2.1) is a local \mathcal{F}_{t} -martingale. Within this framework we can define the hypothesis of conditional local independence precisely. Definition 1 (Conditional local independence) . We say that N_{t} is conditionally locally independent of X_{t} given \mathcal{F}_{t} if the local \mathcal{F}_{t} -martingale M_{t} defined by ( 3.2.1 ) is also a local \mathcal{G}_{t} -martingale. For simplicity, we may also refer to this hypothesis as local independence and write H_{0}:M_{t}=N_{t}-\Lambda_{t}\text{ is a local }\mathcal{G}_{t}\text{-martingale}. (3.2.2) As argued in the introduction, the hypothesis of local independence is the hypothesis that observing X on [0,t] does not add any information to \mathcal{F}_{t-} about whether an N -event will happen in an infinitesimal time interval [t,t+\mathrm{d}t) . Definition 1 captures this interpretation by requiring that the \mathcal{F}_{t} -compensator, \Lambda , of N is also the \mathcal{G}_{t} -compensator. Thus, \lambda is also the \mathcal{G}_{t} -intensity under H_{0} . If N has \mathcal{G}_{t} -intensity \bm{\lambda} , the innovation theorem, Theorem II.T14 in Brémaud (1981) , gives that the predictable projection \lambda_{t}=\mathbb{E}(\bm{\lambda}_{t}\mid\mathcal{F}_{t-}) is the (predictable) \mathcal{F}_{t} -intensity. Local independence follows if \bm{\lambda} is \mathcal{F}_{t} -predictable. Intensities are, however, only unique almost surely, and we can have local independence even if \bm{\lambda} is not a priori \mathcal{F}_{t} -predictable but have an \mathcal{F}_{t} -predictable version. When N has \mathcal{G}_{t} -intensity \bm{\lambda} , H_{0} is thus equivalent to \bm{\lambda} having an \mathcal{F}_{t} -predictable version. We find Definition 1 preferable because it directly gives an operational criterion for determining whether N has an \mathcal{F}_{t} -predictable version of a \mathcal{G}_{t} -intensity. Remark 1 (Censoring) . Suppose that the data is censored such that (N_{t},X_{t},\mathcal{F}_{t})=(N_{t\wedge C}^{*},X_{t\wedge C}^{*},\mathcal{F}_{t\wedge C}^{*}) , where (N^{*},X^{*},\mathcal{F}^{*}) are uncensored data and where C is the censoring time. The hypothesis regarding the uncensored data, H_{0}^{*} : N_{t}^{*} is locally independent of X_{t}^{*} given \mathcal{F}_{t}^{*} , might then be the hypothesis of interest. If \mathbbl{1}(C\geq t) happens to be \mathcal{F}_{t}^{*} -predictable, it is straightforward to show that H_{0}^{*} implies H_{0} , and consequently a test of H_{0} is also a test of H_{0}^{*} . However, \mathcal{F}_{t}^{*} may not a priori contain information about the censoring process. Suppose instead that the common condition of independent censoring ( Andersen et al., 1993 ) holds, which is equivalent to N_{t}^{*} being locally independent of \mathcal{C}_{t}\coloneqq\mathbbl{1}(C\leq t) given \mathcal{G}_{t}^{*} ( Røysland et al., 2022 ) . Then H_{0}^{*} implies that N_{t} is locally independent of X_{t} given \mathcal{F}_{t}\vee\mathcal{F}_{t}^{\mathcal{C}} . Thus, in order to test H_{0}^{*} , we replace \mathcal{F}_{t} by the enlarged filtration \mathcal{F}_{t}\vee\mathcal{F}_{t}^{\mathcal{C}} and proceed mutatis mutandis with testing H_{0} using the observed data. Since X is assumed càglàd, and thus especially \mathcal{G}_{t} -predictable, the stochastic integral \int_{0}^{t}X_{s}\mathrm{d}{M}_{s}, (3.2.3) is under H_{0} a local \mathcal{G}_{t} -martingale. A test could be based on detecting whether ( 3.2.3 ) is, indeed, a local martingale. We will take a slightly different approach where we replace the integrand X by a residual process as defined below. We do so for two reasons. First, to achieve a \sqrt{n} -rate via double machine learning we need the integrand to fulfill ( 3.2.4 ) below. Second, other choices of integrands than X could potentially lead to more powerful tests. Definition 2 (Residual Process) . A residual process G=(G_{t})_{t\in[0,1]} of X_{t} given \mathcal{F}_{t} is a càglàd stochastic process that is \mathcal{G}_{t} -adapted and satisfies \displaystyle\mathbb{E}(G_{t}\mid\mathcal{F}_{t-})=0 (3.2.4) for t\in[0,1] . The geometric interpretation is that the residual process evolves such that G_{t} is orthogonal to L_{2}(\mathcal{F}_{t-}) within L_{2}(\mathcal{G}_{t-}) at each time t . One obvious residual process is the additive residual process given by \displaystyle G_{t}=X_{t}-\Pi_{t}=X_{t}-\mathbb{E}(X_{t}\mid\mathcal{F}_{t-}), where \Pi_{t}=\mathbb{E}(X_{t}\mid\mathcal{F}_{t-}) denotes the predictable projection of the càglàd process X_{t} , see Theorem VI.19.6 in Rogers and Williams (2000) . The additive residual projects X_{t} onto the orthogonal complement of L_{2}(\mathcal{F}_{t-}) , but this may not necessarily remove all \mathcal{F}_{t} -predictable information from X_{t} . An alternative choice that does so under sufficient regularity conditions is the quantile residual process given by G_{t}=F_{t}(X_{t})-\frac{1}{2}, where F_{t} is the conditional distribution function given by F_{t}(x)=\mathbb{P}(X_{t}\leq x\mid\mathcal{F}_{t-}) . The quantile residual process satisfies ( 3.2.4 ) provided that (t,x)\mapsto F_{t}(x) is continuous. In Section 3.3.1 we discuss additional transformations of X that can also be applied before any residualization procedure. We will formulate the general results in terms of an abstract residual process, but we focus on the additive residual process in the examples. Any non-degenerate residual process will contain a predictive model of (aspects of) X_{t} given \mathcal{F}_{t-} in order to satisfy ( 3.2.4 ). We use \widehat{G}_{t} to denote the residual obtained by plugging in an estimate of that predictive model. For the additive residual process, the predictive model is \Pi_{t} and \widehat{G}_{t}=X_{t}-\widehat{\Pi}_{t} . For the quantile residual process, the predictive model is F_{t} and \widehat{G}_{t}=\widehat{F}_{t}(X_{t})-\frac{1}{2} . We can now define our functional target parameter of interest, which we call the Local Covariance Measure . Definition 3 (Local Covariance Measure) . With G_{t} a residual process, define for t\in[0,1] \gamma_{t}=\mathbb{E}\left(I_{t}\right),\qquad\text{where}\quad I_{t}=\int_{0}^{t}G_{s}\mathrm{d}M_{s}, (3.2.5) whenever the expectation is well defined. We call the function t\mapsto\gamma_{t} the Local Covariance Measure (LCM). The following propositions illuminate how \gamma relates to the null hypothesis of N_{t} being conditionally locally independent of X_{t} given \mathcal{F}_{t} . Proposition 3.2.1 . Under H_{0} , the process I=(I_{t}) is a local \mathcal{G}_{t} -martingale with I_{0}=0 . If I is a martingale, then \gamma_{t}=0 for t\in[0,1] . To interpret \gamma in the alternative, we assume that N has \mathcal{G}_{t} -intensity \bm{\lambda} . Proposition 3.2.2 . If \int_{0}^{1}\mathbb{E}(|G_{s}|(\bm{\lambda}_{s}+\lambda_{s}))\mathrm{d}s<\infty , then for every t\in[0,1] , \displaystyle\gamma_{t}=\int_{0}^{t}\cov(G_{s},\bm{\lambda}_{s}-\lambda_{s})\mathrm{d}s. In particular, \gamma is the zero-function if and only if \cov(G_{s},\bm{\lambda}_{s}-\lambda_{s})=0 for almost all s\in[0,1] . We note that under H_{0} , the condition \int_{0}^{1}\mathbb{E}(|G_{s}|\lambda_{s})\mathrm{d}s<\infty is sufficient to ensure that I is a martingale and \gamma_{t}=0 for all t\in[0,1] . By Proposition 3.2.2 , the LCM quantifies deviations from H_{0} in terms of the covariance between the residual process and the difference of the \mathcal{F}_{t} - and \mathcal{G}_{t} -intensities. To this end, note that if X happens to be \mathcal{F}_{t} -adapted, then \mathcal{G}_{t}=\mathcal{F}_{t} and N is trivially locally independent of X . The hypothesis of local independence is only of interest when \mathcal{G}_{t} is a strictly larger filtration than \mathcal{F}_{t} , that is, when X provides information not already in \mathcal{F}_{t} . For the additive residual process, where G_{t}=X_{t}-\Pi_{t} , \displaystyle\gamma_{t} \displaystyle=\mathbb{E}\left(\int_{0}^{t}G_{s}\mathrm{d}M_{s}\right)=\mathbb{E}\left(\int_{0}^{t}X_{s}\mathrm{d}M_{s}\right)-\mathbb{E}\left(\int_{0}^{t}\Pi_{s}\mathrm{d}M_{s}\right) provided that the expectations are well defined. Since the predictable projection \Pi_{t} has a càglàd version and is \mathcal{F}_{t} -predictable, and since M_{t} is a local \mathcal{F}_{t} -martingale, \int_{0}^{t}\Pi_{s}\mathrm{d}M_{s} is a local \mathcal{F}_{t} -martingale. If it is a martingale, it is a mean zero martingale, and \gamma_{t}=\mathbb{E}\left(\int_{0}^{t}X_{s}\mathrm{d}M_{s}\right)=\mathbb{E}\left(\sum_{\tau\leq t:\Delta N_{\tau}=1}X_{\tau}-\int_{0}^{t}X_{s}\lambda_{s}\mathrm{d}s\right). (3.2.6) The computation above shows that the additive residual process defines the same functional target parameter \gamma_{t} as the stochastic integral ( 3.2.3 ) would. It is, however, the representation of \gamma_{t} as the expectation of the residualized stochastic integral that will allow us to achieve a \sqrt{n} -rate of convergence of the estimator of \gamma_{t} in cases where the estimator of \lambda_{t} converges at a slower rate. 3.2.2 A Cox model with a partially observed covariate process To further illustrate the hypothesis of conditional local independence and the Local Covariance Measure we consider an example based on Cox’s survival model with time dependent covariates. This is an extension of the example from the introduction with T being the time to death of an individual, and with X and Z being time-varying processes. There is, moreover, one additional time-varying process Y in the full model. An interpretation of the processes is as follows: \displaystyle X \displaystyle=\text{Pension savings} \displaystyle Y \displaystyle=\text{Blood pressure} \displaystyle Z \displaystyle=\text{BMI} Periods of overweight or obesity may influence blood pressure in the long term, and due to, e.g., job market discrimination, high BMI could influence pension savings negatively. Death risk is influenced directly by BMI and blood pressure but not the size of your pension savings. Figure 3.2.2 illustrates two possible dependence structures among the three processes and the death time as local independence graphs, and we will use these two graphs to discuss the concept of conditional local independence of pension savings on time to death. Z BMI Y Blood pressure X Pension savings N Death indicator Z BMI Y Blood pressure X Pension savings N Death indicator Figure 3.2.2 : Local independence graphs illustrating how the three processes X , Y , and Z could affect each other and time of death in the Cox example. There is no direct influence of X (pension savings) on time of death in either of the two graphs, but in the left graph the death indicator is furthermore conditionally locally independent of X given the history of Z and N . In the right graph, Z and N does not block all paths from X to N , thus conditioning on the history of Z and N only would not render N conditionally locally independent of X . We assume that T\in[0,1] and that X , Y and Z have continuous sample paths. Recall also that N_{t}=\mathbbl{1}(T\leq t) is the death indicator process. To maintain some form of realism, all processes are stopped at time of death, that is, X_{t}=X_{T} , Y_{t}=Y_{T} and Z_{t}=Z_{T} for t\geq T . This feedback from the death event to the other processes is reflected in Figure 3.2.2 by the edges pointing out of N . Recall also that \mathcal{F}_{t}^{N,Z}=\sigma(N_{s},Z_{s};s\leq t) is the filtration generated by the N - and Z -processes. We use a similar notation for other processes and combinations of processes. For example, \mathcal{F}_{t}^{N,X,Y,Z} is the filtration generated by N and all three X -, Y -, and Z -processes. With \lambda_{t}^{\text{full}} denoting the \mathcal{F}_{t}^{N,X,Y,Z} -intensity of time of death based on the history of all processes, we assume in this example a Cox model given by \lambda_{t}^{\text{full}}=\mathbbl{1}(T\geq t)\lambda_{t}^{0}e^{Y_{t}+\beta Z_{t}} (3.2.7) with \lambda_{t}^{0} a deterministic baseline intensity. It is not important that \lambda_{t}^{\text{full}} is a Cox model for our general theory, but it allows for certain theoretical computations in this example. The fact that \lambda_{t}^{\text{full}} does not depend upon X_{t} implies that \lambda_{t}^{\text{full}} is also the \mathcal{F}_{t}^{N,Y,Z} -intensity, and according to Definition 1 , N_{t} is conditionally locally independent of X_{t} given \mathcal{F}_{t}^{N,Y,Z} . This is in agreement with the local independence graphs in Figure 3.2.2 where there is no edge in either of them from X to N . We will take an interest in the case where Y is unobserved and test the hypothesis: H_{0}: N_{t} is conditionally locally independent of X_{t} given \mathcal{F}_{t}^{N,Z} . That is, with Y unobserved we want test if the intensity of time to death given the history of N , X and Z depends on X . To simplify notation let \mathcal{F}_{t}=\mathcal{F}_{t}^{N,Z} and \mathcal{G}_{t}=\mathcal{F}_{t}^{N,X,Z} – in accordance with the general notation. The \mathcal{G}_{t} -intensity is by the innovation theorem given as \bm{\lambda}_{t}=\mathbb{E}(\lambda_{t}^{\text{full}}\mid\mathcal{G}_{t-})=\mathbbl{1}(T\geq t)\lambda_{t}^{0}e^{\beta Z_{t}}\mathbb{E}(e^{Y_{t}}\mid\mathcal{G}_{t-}), (3.2.8) while the \mathcal{F}_{t} -intensity is \lambda_{t}=\mathbb{E}(\lambda_{t}^{\text{full}}\mid\mathcal{F}_{t-})=\mathbbl{1}(T\geq t)\lambda_{t}^{0}e^{\beta Z_{t}}\mathbb{E}(e^{Y_{t}}\mid\mathcal{F}_{t-}), (3.2.9) and H_{0} is equivalent to \lambda_{t}=\bm{\lambda}_{t} almost surely. Comparing ( 3.2.8 ) and ( 3.2.9 ) we see that H_{0} holds in this example if \mathbb{E}(e^{Y_{t}}\mid\mathcal{G}_{t-})=\mathbb{E}(e^{Y_{t}}\mid\mathcal{F}_{t-}) , and a sufficient condition for this is \mathcal{F}_{t}^{X}\,\perp\!\!\!\perp\,\mathcal{F}_{t}^{Y}\mid\mathcal{F}_{t}. (3.2.10) The condition ( 3.2.10 ) is in concordance with the left graph in Figure 3.2.2 , see Theorem 2 in Didelez (2008) , but not the right, and it implies H_{0} . We will in Section 3.6.1 elaborate on condition ( 3.2.10 ) and give explicit examples. We recall that H_{0} can be reformulated as \bm{\lambda}_{t} not depending on X , and we could investigate the hypothesis via a marginal Cox model \bm{\lambda}_{t}^{\text{cox}}=\mathbbl{1}(T\geq t)\bm{\lambda}_{t}^{0}e^{\alpha_{1}X_{t}+\alpha_{2}Z_{t}} (3.2.11) and test if \alpha_{1}=0 . The Cox model is, however, not closed under marginalization and the semi-parametric model ( 3.2.11 ) is quite likely misspecified. Consequently, a test of \alpha_{1}=0 is not equivalent to a test of H_{0} . Our proposed nonparametric test of H_{0} does not rely on a specific (semi-)parametric model of \bm{\lambda}_{t} . To test H_{0} we consider the LCM using the additive residual process. Then ( 3.2.6 ) implies that \displaystyle\gamma_{t} \displaystyle=\mathbb{E}\left(X_{T}N_{t}-\int_{0}^{t}X_{s}\lambda_{s}\mathrm{d}s\right), By Proposition 3.2.1 , \gamma_{t}=0 for t\in[0,1] under H_{0} , whence conditional local independence implies \gamma_{t}=0 , and we test H_{0} by estimating \gamma_{t} and testing if it is constantly equal to 0 . Before introducing a general estimator of the LCM in Section 3.2.3 we outline how to estimate the end point parameter \gamma_{1} in this example. Due to T\leq 1 and the appearance of the indicator \mathbbl{1}(T\geq t) in ( 3.2.9 ), \displaystyle\gamma_{1} \displaystyle=\mathbb{E}\left(X_{T}-\int_{0}^{T}X_{s}\lambda_{s}\mathrm{d}s\right). With i.i.d. observations (T_{1},X_{1},Z_{1}),\ldots,(T_{n},X_{n},Z_{n}) and (nonparametric) estimates, \widehat{\lambda}_{j,t} , based on (T_{1},Z_{1}),\ldots,(T_{n},Z_{n}) , we could compute the plug-in estimate \widehat{\gamma}_{1,\text{plug-in}}^{(n)}=\frac{1}{n}\sum_{j=1}^{n}\left(X_{j,T_{j}}-\int_{0}^{T_{j}}X_{j,s}\widehat{\lambda}_{j,s}\mathrm{d}s\right). However, we cannot expect the plug-in estimator to have a \sqrt{n} -rate unless \widehat{\lambda} has \sqrt{n} -rate, which effectively requires parametric model assumptions on the intensity. Figure 3.2.3 : Histograms of the distributions of three different estimators of \gamma_{1} . Each histogram contains 1000 estimates fitted to samples of size n=500 . The samples were sampled from a model that satisfies the hypothesis of conditional local independence and hence the ground truth is \gamma_{1}=0 . See Section 3.6.2 for further details of the data generating process. Using the definition of \gamma_{1} in terms of the additive residual process G_{t}=X_{t}-\Pi_{t} , we also have that \gamma_{1}=\mathbb{E}\left(X_{T}-\Pi_{T}-\int_{0}^{T}(X_{s}-\Pi_{s})\lambda_{s}\mathrm{d}s\right). (3.2.12) A double machine learning estimator based on the ideas by Chernozhukov et al. (2018) is therefore obtained by plugging in two nonparametric estimators: \widehat{\gamma}_{1,\text{double}}^{(n)}=\frac{1}{n}\sum_{j=1}^{n}\left(X_{j,T_{j}}-\widehat{\Pi}_{j,T_{j}}-\int_{0}^{T_{j}}(X_{j,s}-\widehat{\Pi}_{j,s})\widehat{\lambda}_{j,s}\mathrm{d}s\right). To achieve a small bias and a \sqrt{n} -rate of convergence, we use sample splitting. The nonparametric estimates \widehat{\Pi}_{j} and \widehat{\lambda}_{j} are based on one part of the sample only, and are thus independent of the other part of the sample used for testing, see Section 3.2.3 . To obtain a fully efficient estimator, multiple sample splits can be combined, e.g., via cross-fitting, see Section 3.5.2 . Figure 3.2.3 shows the distributions of \widehat{\gamma}_{1,\text{plug-in}}^{(500)} and \widehat{\gamma}_{1,\text{double}}^{(500)} for the Cox example with \gamma_{1}=0 , see Section 3.6.2 for details on the full model specification. The latter estimator was computed using cross-fitting but also without using any form of sample splitting. The figure illustrates the bias of \widehat{\gamma}_{1,\text{plug-in}}^{(500)} , which is somewhat diminished by double machine learning without sample splitting and mostly eliminated by double machine learning in combination with cross-fitting. 3.2.3 Estimating the Local Covariance Measure To estimate the LCM we assume that we have observed n i.i.d. replications of the processes, (N_{1},X_{1},\mathcal{F}_{1}),\ldots,(N_{n},X_{n},\mathcal{F}_{n}) , where observing \mathcal{F}_{j}=(\mathcal{F}_{j,t}) signifies that anything adapted to the j -th filtration is computable from observations. The process N_{j} is adapted to \mathcal{F}_{j} , while X_{j} is not, and \mathcal{G}_{j} denotes the smallest right continuous and complete filtration generated by X_{j} and \mathcal{F}_{j} . For each n , we consider a sample split corresponding to a partition J_{n}\cup J_{n}^{c}=\{1,\ldots,n\} of the indices into two disjoint sets. We let \widehat{\lambda}^{(n)} and \widehat{G}^{(n)} be estimates of the intensity and the residualization map, respectively, fitted on data indexed by J_{n}^{c} only. By an estimate, \widehat{\lambda}^{(n)} , of \lambda we mean a (stochastic) function that can be evaluated on the basis of \mathcal{F}_{j,t} for j\in J_{n} , and its value, denoted by \widehat{\lambda}_{j,t}^{(n)} , is interpreted as a prediction of \lambda_{j,t} . The stochasticity in \widehat{\lambda}^{(n)} arises from its dependence on data indexed by J_{n}^{c} , from which its functional form is completely determined. Similarly, \widehat{G}^{(n)} is a function that can be evaluated on the basis of \mathcal{G}_{j,t} for j\in J_{n} to give a prediction \widehat{G}_{j,t}^{(n)} of G_{j,t} . In Section 3.6.1 we illustrate through the Cox example how \widehat{\lambda}^{(n)} and \widehat{G}^{(n)} are to be computed in practice when we use sample splitting. In Section 3 in the supplement we give more examples of such estimation procedures and discuss their statistical properties in greater detail. To ease notation, we will throughout assume that (N,X,\mathcal{F}) denotes one additional process and filtration – independent of and with the same distribution as the observed processes. Then the estimated intensity \widehat{\lambda}^{(n)} and estimated residual process \widehat{G}^{(n)} can be evaluated on (N,X,\mathcal{F}) , and thus we may write \widehat{\lambda}_{t}^{(n)} and \widehat{G}_{t}^{(n)} to denote template copies of \widehat{\lambda}^{(n)}_{j,t} and \widehat{G}^{(n)}_{j,t} for j\in J_{n} . In terms of the estimates \widehat{\lambda}^{(n)} and \widehat{G}^{(n)} we estimate LCM by the stochastic process \widehat{\gamma}^{(n)} given by \widehat{\gamma}_{t}^{(n)}=\frac{1}{|J_{n}|}\sum_{j\in J_{n}}\int_{0}^{t}\widehat{G}_{j,s}^{(n)}\mathrm{d}\widehat{M}^{(n)}_{j,s}, (3.2.13) where \widehat{M}_{j,t}^{(n)}=N_{j,t}-\int_{0}^{t}\widehat{\lambda}_{j,s}^{(n)}\mathrm{d}s . We can regard \widehat{\gamma}_{t}^{(n)} as a double machine learning estimator of \gamma_{t} , with the observations indexed by J_{n}^{c} used to learn models of \lambda and G , and with observations indexed by J_{n} used to estimate \gamma_{t} based on these models. In Section 3.5.2 we define the more efficient estimator that uses cross-fitting, but it is instructive to study the simpler estimator based on sample splitting first. In practical applications, we do not directly observe the filtration \mathcal{F}_{j} , but rather samples from the stochastic processes generating the filtration. In accordance with the introductory Cox example, consider \mathcal{F}_{j} and \mathcal{G}_{j} given by \mathcal{F}_{j,t}=\sigma(Z_{j,s},N_{j,s};s\leq t) and \mathcal{G}_{j,t}=\sigma(X_{j,s},Z_{j,s},N_{j,s};s\leq t) for a third stochastic process Z_{j} , with Z_{j} possibly being multivariate. Within this setup, a general procedure for numerically computing the LCM is described in Algorithm 1 . Here, historical regression refers to any method which regresses the outcome at a given time on the history of the regressors up to that time. For example, historical linear regression is discussed in Section 3.6 and various alternative methods are discussed in Section 3 in the supplement. The choice of sample split will be discussed further in Section 3.5.2 in the context of cross-fitting. Algorithm 1 Sample split estimator of LCM input : processes (N_{j},X_{j},Z_{j})_{j=1,\ldots,n} , partition J_{n}\cup J_{n}^{c} of indices ; 1 options : historical regression methods for estimation of \lambda and G given N and Z , 2 discrete time grid 0=t_{0}<\cdots0 • linear filters, \bar{X}_{t}=\int_{0}^{t}\kappa(t-s)X_{s}\mathrm{d}s for a kernel \kappa • non-linear filters, \bar{X}_{t}=\varphi\left(\int_{0}^{t}\kappa(t-s)f(X_{s})\mathrm{d}s\right) for a kernel \kappa and functions f and \varphi . Any finite number of such processes could, of course, also be combined into a vector process, and we could, indeed, generalize the LCM estimator ( 3.2.13 ) to a vector process. The generalization is straightforward. 3.3.2 Survival time with time-independent covariates A different perspective on the test statistic is obtained if X is constant over time, if N_{t}=\mathbbl{1}(T\leq t) is the counting process of a survival time T , and if \mathcal{F}_{t}=\sigma(N_{s},Z;s\leq t) where Z is a vector of additional baseline variables. Then the \mathcal{F}_{t} -intensity is \lambda_{t}=\mathbbl{1}(T\geq t)h(t,Z), where h(t,Z) is the hazard function for T given the baseline Z . In this special case, the hypothesis of conditional local independence is equivalent to the ordinary conditional independence X\,\perp\!\!\!\perp\,T\mid Z. (3.3.14) We also find that \gamma_{t}=\mathbb{E}(X(\mathbbl{1}(T\leq t)-\Lambda_{t\wedge T})), and in particular \gamma_{1}=\mathbb{E}(X(1-\Lambda_{T})) as T\in[0,1] by assumption. Since \Lambda_{T} is exponentially distributed with mean 1 , we may write \gamma_{1}=-\mathrm{cov}(X,\Lambda_{T}). Testing if \gamma_{1}\neq 0 in this particular setup is effectively a test of the conditional independence ( 3.3.14 ). When ( 3.3.14 ) is true, it further holds that \Pi_{t}=\mathbb{E}(X\mid\mathcal{F}_{t-})=\mathbb{E}(X\mid Z)=\Pi_{0} is independent of t , and if we incorporate this into our model of \Pi , the LCM estimator of \gamma_{1} equals \widehat{\gamma}_{1}^{(n)}=\frac{1}{|J_{n}|}\sum_{j\in J_{n}}(X_{j}-\widehat{\Pi}_{j,0})(1-\widehat{\Lambda}_{T_{j}}). (3.3.15) This is a (non-normalized) generalized covariance measure (GCM), see ( Shah and Peters, 2020 ) , which is simply the (negative) empirical covariance between the additive residuals X_{j}-\widehat{\Pi}_{j,0} and the Cox-Snell residuals \widehat{\Lambda}_{T_{j}} . Alternatively, consider the quantile residual process G_{j,t}=F_{t}(X_{j})-\frac{1}{2} where F_{t}(x)=\mathbb{P}(X\leq x\mid\mathcal{F}_{t-}) . If ( 3.3.14 ) is true, it holds again that F_{t}(x)=F_{0}(x)=\mathbb{P}(X\leq x\mid Z) is independent of t , and our LCM estimator becomes \widehat{\gamma}_{1}^{(n)}=\frac{1}{|J_{n}|}\sum_{j\in J_{n}}\widehat{G}_{j,0}\left(1-\widehat{\Lambda}_{T_{j}}\right). (3.3.16) This is likewise an empirical covariance, but now between the generalized residuals and the Cox-Snell residuals. This is closely related to the partial copula between X and T given Z , which can be estimated as \frac{1}{|J_{n}|}\sum_{j\in J_{n}}\widehat{G}_{j,0}\left(\frac{1}{2}-\exp(-\widehat{\Lambda}_{T_{j}})\right). See Petersen and Hansen (2021) for further details on the partial copula and how this statistic can be used to test conditional independence. Under a combined rate condition on estimation of G and \Lambda , the endpoint statistics above are known to be asymptotically Gaussian with mean zero when the hypothesis of conditional independence in ( 3.3.14 ) holds. Within this survival setting, the endpoint statistics ( 3.3.15 ) can, furthermore, be seen as a score test derivable from a semiparametric efficient score function. Section 3 in the supplement gives the details for two specific semiparametric survival models. Whenever \widehat{G}_{j,t}=\widehat{G}_{j,0} is independent of time, e.g., if we incorporate ( 3.3.14 ) into the residual model, the t -indexed LCM estimator is \widehat{\gamma}_{t}^{(n)}=\frac{1}{|J_{n}|}\sum_{j\in J_{n}}\widehat{G}_{j,0}\left(\mathbbl{1}(T_{j}\leq t)-\widehat{\Lambda}_{T_{j}\wedge t}\right), which can be seen as a t -indexed extension of ( 3.3.16 ). For a general, time-dependent residual process, the full t -indexed LCM estimator is \widehat{\gamma}_{t}^{(n)}=\frac{1}{|J_{n}|}\sum_{j\in J_{n}}\mathbbl{1}(T_{j}\leq t)\widehat{G}_{j,T_{j}}-\int_{0}^{t\wedge T_{j}}\widehat{G}_{j,s}\widehat{\lambda}_{s}\mathrm{d}s. The general results of this paper show that the t -indexed LCM estimator is asymptotically distributed as a mean zero Gaussian martingale under H_{0} . This appears to be a novel result even when X is constant over time. However, the main contributions of this paper is to the case where X and Z are stochastic processes varying with time – where the hypothesis of conditional local independence is also distinct from ( 3.3.14 ). 3.4 General asymptotic results In this section we derive uniform asymptotic results regarding the general LCM estimator as a stochastic process. In Section 3.5 we discuss how to construct tests of H_{0} based on the asymptotic results. We assume that N has a \mathcal{G}_{t} -intensity \bm{\lambda}_{t} , we let \bm{\Lambda}_{t}=\int_{0}^{t}\bm{\lambda}_{s}\mathrm{d}s denote the \mathcal{G}_{t} -compensator of N and let \mathbf{M}_{t}=N_{t}-\bm{\Lambda}_{t} be the compensated local \mathcal{G}_{t} -martingale. We also recall that \widehat{\gamma}^{(n)} denotes the LCM estimator based on sample splitting as defined in Section 3.2.3 . Within this framework we consider the decomposition \displaystyle\sqrt{|J_{n}|}\widehat{\gamma}^{(n)}=U^{(n)}+R_{1}^{(n)}+R_{2}^{(n)}+R_{3}^{(n)}+D_{1}^{(n)}+D_{2}^{(n)}, (3.4.17) where the processes U^{(n)},R_{1}^{(n)},R_{2}^{(n)},R_{3}^{(n)},D_{1}^{(n)} , and D_{2}^{(n)} are given by \displaystyle U^{(n)}_{t} \displaystyle=\frac{1}{\sqrt{|J_{n}|}}\sum_{j\in J_{n}}\int_{0}^{t}G_{j,s}\mathrm{d}\bm{M}_{j,s}, (3.4.18) \displaystyle R^{(n)}_{1,t} \displaystyle=\frac{1}{\sqrt{|J_{n}|}}\sum_{j\in J_{n}}\int_{0}^{t}G_{j,s}\left(\lambda_{j,s}-\widehat{\lambda}_{j,s}^{(n)}\right)\mathrm{d}s, (3.4.19) \displaystyle R^{(n)}_{2,t} \displaystyle=\frac{1}{\sqrt{|J_{n}|}}\sum_{j\in J_{n}}\int_{0}^{t}\left(\widehat{G}_{j,s}^{(n)}-G_{j,s}\right)\mathrm{d}\bm{M}_{j,s}, (3.4.20) \displaystyle R^{(n)}_{3,t} \displaystyle=\frac{1}{\sqrt{|J_{n}|}}\sum_{j\in J_{n}}\int_{0}^{t}\left(\widehat{G}_{j,s}^{(n)}-G_{j,s}\right)\left(\lambda_{j,s}-\widehat{\lambda}_{j,s}^{(n)}\right)\mathrm{d}s, (3.4.21) \displaystyle D^{(n)}_{1,t} \displaystyle=\frac{1}{\sqrt{|J_{n}|}}\sum_{j\in J_{n}}\int_{0}^{t}G_{j,s}(\bm{\lambda}_{j,s}-\lambda_{j,s})\mathrm{d}s, (3.4.22) \displaystyle D^{(n)}_{2,t} \displaystyle=\frac{1}{\sqrt{|J_{n}|}}\sum_{j\in J_{n}}\int_{0}^{t}(\widehat{G}_{j,s}^{(n)}-G_{j,s})(\bm{\lambda}_{j,s}-\lambda_{j,s})\mathrm{d}s. (3.4.23) Note that the processes D_{1} and D_{2} are (almost surely) the zero-process under H_{0} , since the null is equivalent to \lambda_{t} being a version of \bm{\lambda}_{t} . We proceed to show that: • the processes U^{(n)} and D_{1}^{(n)}-\sqrt{|J_{n}|}\gamma each converge in distribution, • and the processes R_{1},R_{2},R_{3},D_{2} converge to the zero-process. For the analysis of each of R_{1} , R_{2} , and D_{2} , sample splitting is used to render the summands conditionally independent. These asymptotic properties imply that \sqrt{|J_{n}|}(\widehat{\gamma}^{(n)}-\gamma) is stochastically bounded in general, so the LCM estimator will asymptotically detect if the LCM is non-zero. Moreover, it will follow that U^{(n)} drives the asymptotic limit of the LCM estimator under H_{0} . Based on these general asymptotic results we derive in Section 3.5 asymptotic error control for tests based on the LCM estimator. 3.4.1 Asymptotics of the LCM estimator Our asymptotic results are formulated in terms of uniform stochastic convergence, which has also been discussed extensively in the recent literature on hypothesis testing ( Shah and Peters, 2020 ; Lundborg et al., 2022b ; Lundborg et al., 2022a ; Scheidegger et al., 2022 ; Neykov et al., 2021 ) . Uniform convergence allows us to establish uniform asymptotic level of our proposed test, as well as power under local alternatives. We have collected key definitions and results related to uniform convergence in Section 3 in the supplement. To state uniform assumptions and asymptotic results we need to indicate a range of possible sampling distributions for which the assumptions apply and the results hold. For this purpose, we extend our setup and allow all data to be parametrized by a fixed parameter set \Theta . The set \Theta is not a priori assumed to have any structure, and \theta\in\Theta simply indicates that N^{\theta} , X^{\theta} , \lambda^{\theta} , G^{\theta} etc. have \theta -dependent distributions. We generally denote evaluation of processes or derived quantities for a specific \theta -value by a superscript, with the LCM, \gamma^{\theta} , in particular, depending on \theta . The LCM estimator is likewise written as \widehat{\gamma}^{(n),\theta}=(\widehat{\gamma}^{(n),\theta}_{t}) for \theta\in\Theta to denote its dependence on the sampling distribution. The superscript notation is, however, heavy and unnecessary in many cases and we will suppress the dependency on \theta\in\Theta whenever it is not needed. Any result that does not explicitly involve \Theta should be understood as a pointwise result for each \theta\in\Theta . The parametrization allows us to express convergence in distribution and probability uniformly over \Theta , which are denoted by \xrightarrow{\scalebox{0.6}{$\mathcal{D}/\Theta$}} and \xrightarrow{\scalebox{0.6}{$P/\Theta$}} , respectively. These concepts are defined rigorously in Definition 6 in the supplement. We note that uniform convergence reduces to classical (pointwise) convergence if \Theta is a singleton, which corresponds to fixing the sampling distribution. We also introduce the parameter subset \Theta_{0}\coloneqq\{\theta\in\Theta\mid H_{0}\text{ is valid}\}, (3.4.24) consisting of all parameter values for which the hypothesis of conditional local independence holds. Correspondingly, we will use \xrightarrow{\scalebox{0.6}{$\mathcal{D}/\Theta_{0}$}} and \xrightarrow{\scalebox{0.6}{$P/\Theta_{0}$}} to denote stochastic convergences uniformly over \Theta_{0} . We are now ready to formulate the underlying assumptions on the data required for our asymptotic results. These assumptions may appear strong, but we argue in the discussion in Section 7 that they are not unreasonable from a practical viewpoint. Assumption 3.4.1 . There exist constants C,C^{\prime}>0 , such that for any parameter value \theta\in\Theta: i) The \mathcal{G}_{t}^{\theta} -intensity \bm{\lambda}_{t}^{\theta} of N^{\theta} is càglàd with \sup_{0\leq t\leq 1}\bm{\lambda}_{t}^{\theta}\leq C almost surely. ii) The residual process G^{\theta} is càglàd with \sup_{0\leq t\leq 1}|G_{t}^{\theta}|\leq C^{\prime} almost surely. The estimator, \widehat{\lambda}^{(n)}_{t} , of \lambda_{t} and the estimator, \widehat{G}^{(n)}_{t} , of the residual process are assumed to satisfy the same bounds as \lambda_{t} and G_{t} . We note that Assumption 3.4.1 i) implies that \bm{M}_{t} is a true \mathcal{G}_{t} -martingale, and by the innovation theorem, \lambda_{t}=\mathbb{E}[\bm{\lambda}_{t}\mid\mathcal{F}_{t-}] . As a consequence, the \mathcal{F}_{t} -intensity \lambda_{t} inherits the boundedness from the \mathcal{G}_{t} -intensity \bm{\lambda}_{t} , and M_{t} is an \mathcal{F}_{t} -martingale. More generally, we have the following proposition ensuring that stochastic integrals are true martingales, e.g., that I_{t} is a martingale under H_{0} . Proposition 3.4.1 . Under Assumption 3.4.1 it holds that each of the processes \Big(\int_{0}^{t}f(G_{s})\mathrm{d}\bm{M}_{s} \Big)_{t\in[0,1]}\quad\text{ and }\quad\Big(\int_{0}^{t}f(\widehat{G}_{s}^{(n)})\mathrm{d}\bm{M}_{s} \Big)_{t\in[0,1]} are mean zero, square integrable \mathcal{G}_{t} -martingales for any f\in C(\mathbb{R}) . To express the asymptotic distribution of U^{(n)} we need its variance function . Definition 4 . We define the variance function \mathcal{V}\colon[0,1]\to[0,\infty] as \displaystyle\mathcal{V}(t)=\mathbb{E}\left(\int_{0}^{t}G_{s}^{2}\mathrm{d}N_{s}\right) (3.4.25) for t\in[0,1] . As everything else, the variance function, \mathcal{V}=\mathcal{V}^{\theta} , is also indexed by the parameter \theta , which we, for notational simplicity, suppress unless explicitly needed. By taking f(x)=x^{2} in Proposition 3.4.1 , Assumption 3.4.1 implies that for each t\in[0,1] , \mathcal{V}(t)=\mathbb{E}\left(\int_{0}^{t}G_{s}^{2}\bm{\lambda}_{s}\mathrm{d}s\right)<\infty. Moreover, \mathcal{V}(t) is the variance of \int_{0}^{t}G_{s}\mathrm{d}\bm{M}_{s} , which under H_{0} is the same as the variance of I_{t}=\int_{0}^{t}G_{s}\mathrm{d}M_{s} . With the assumptions above we can prove the following proposition about the uniform distributional limit of the process U^{(n)} in the Skorokhod space D[0,1] , the space of càdlàg functions from [0,1] to \mathbb{R} endowed with the Skorokhod topology. A corresponding pointwise result is an application of Rebolledo’s classical martingale CLT. Our generalization to uniform convergence is based on a uniform extension of Rebolledo’s theorem, see Theorem 3.C.3 in Section 3 in the supplement. Proposition 3.4.2 . Under Assumption 3.4.1 it holds that \displaystyle U^{(n),\theta}\xrightarrow{\scalebox{0.6}{$\mathcal{D}/\Theta$}}U^{\theta} in D[0,1] as n\to\infty , where for each \theta\in\Theta , U^{\theta} is a mean zero continuous Gaussian martingale on [0,1] with variance function \mathcal{V}^{\theta} . To control the remainder terms in ( 3.4.17 ) we will bound the estimation errors in terms of the 2-norm, {\left|\kern-1.07639pt\left|\kern-1.07639pt\left|\cdot\right|\kern-1.07639pt\right|\kern-1.07639pt\right|}_{2} , on L_{2}([0,1]\times\Omega) , i.e., \displaystyle{\left|\kern-1.07639pt\left|\kern-1.07639pt\left|W\right|\kern-1.07639pt\right|\kern-1.07639pt\right|}_{2}^{2}=\mathbb{E}\left(\int_{0}^{1}W_{s}^{2}\mathrm{d}s\right) for any process W\in L_{2}([0,1]\times\Omega) . We will make the following consistency assumptions on \widehat{\lambda}^{(n)} and \widehat{G}^{(n)} . Assumption 3.4.2 . Assume that |J_{n}|\to\infty when n\to\infty and let \displaystyle g^{\theta}(n)={\left|\kern-1.07639pt\left|\kern-1.07639pt\left|G^{\theta}-\widehat{G}^{(n),\theta}\right|\kern-1.07639pt\right|\kern-1.07639pt\right|}_{2}\qquad\text{and}\qquad h^{\theta}(n)={\left|\kern-1.07639pt\left|\kern-1.07639pt\left|\lambda^{\theta}-\widehat{\lambda}^{(n),\theta}\right|\kern-1.07639pt\right|\kern-1.07639pt\right|}_{2}. Then each of the sequences g^{\theta}(n) , h^{\theta}(n) , and \sqrt{|J_{n}|}g^{\theta}(n)h^{\theta}(n) converge to zero uniformly over \Theta as n\to\infty , i.e., \displaystyle\lim_{n\to\infty}\sup_{\theta\in\Theta}\max\{g^{\theta}(n),h^{\theta}(n),\sqrt{|J_{n}|}g^{\theta}(n)h^{\theta}(n)\}=0. With this assumption we can establish that the remainder terms also converge uniformly to the zero-process. Proposition 3.4.3 . Under Assumptions 3.4.1 and 3.4.2 , it holds that \sup_{t\in[0,1]}|R_{i,t}^{(n),\theta}|\xrightarrow{\scalebox{0.6}{$P/\Theta$}}0 as n\to\infty for i=1,2,3 . To control the asymptotic behavior of the LCM estimator in the alternative we need to control the two terms D_{1}^{(n)} and D_{2}^{(n)} . Proposition 3.4.4 . Let Assumptions 3.4.1 and 3.4.2 hold true. i) The stochastic process D_{1}^{(n),\theta}-\sqrt{|J_{n}|}\gamma^{\theta} converges in distribution in (C[0,1],\|\cdot\|_{\infty}) uniformly over \Theta as n\to\infty . ii) If G_{t}^{\theta}=X_{t}^{\theta}-\Pi_{t}^{\theta} is the additive residual process, then D_{2}^{(n),\theta}\xrightarrow{\scalebox{0.6}{$P/\Theta$}}0 in D[0,1] as n\to\infty . We note that D_{2}^{(n)} might not vanish without an assumption like G_{t} being the additive residual process, and it is not clear if D_{2}^{(n)} will even converge in general. We will not pursue an analysis of the asymptotic behavior of D_{2}^{(n)} in the general case. We note, however, that if we can estimate G with a parametric rate, that is, \sqrt{|J_{n}|}g(n)=O(1) , then it follows from the Cauchy-Schwarz inequality that D_{2}^{(n)} is stochastically bounded, and D_{1}^{(n)} still dominates in the alternative where \gamma\neq 0 . We can combine all of the propositions into a single theorem regarding the asymptotics of the LCM estimator, which we consider as our main result. Theorem 3.4.5 . Let Assumptions 3.4.1 and 3.4.2 hold true. i) It holds that \displaystyle\sqrt{|J_{n}|}\widehat{\gamma}^{(n),\theta}\xrightarrow{\scalebox{0.6}{$\mathcal{D}/\Theta_{0}$}}U^{\theta} in D[0,1] as n\to\infty , where for each \theta\in\Theta_{0} , U^{\theta} is a mean zero continuous Gaussian martingale on [0,1] with variance function \mathcal{V}^{\theta} . ii) For the additive residual process it holds that for every \varepsilon>0 there exists K>0 such that \displaystyle\limsup_{n\to\infty}\sup_{\theta\in\Theta}\mathbb{P}\left(\sqrt{|J_{n}|}\cdot\|\widehat{\gamma}^{(n),\theta}-\gamma^{\theta}\|_{\infty}>K\right)<\varepsilon. (3.4.26) Thus we have established the weak asymptotic limit of \sqrt{|J_{n}|}\widehat{\gamma}^{(n)} under H_{0} . However, the variance function \mathcal{V} of the limiting Gaussian martingale is unknown and must be estimated from data. We propose to use the empirical version of ( 3.4.25 ), \displaystyle\widehat{\mathcal{V}}_{n}(t)=\frac{1}{|J_{n}|}\sum_{j\in J_{n}}\int_{0}^{t}\left(\widehat{G}_{j,s}^{(n)}\right)^{2}\mathrm{d}N_{j,s}=\frac{1}{|J_{n}|}\sum_{j\in J_{n}}\sum_{\tau\leq t:\Delta N_{j,s}=1}\left(\widehat{G}_{j,\tau}^{(n)}\right)^{2}, (3.4.27) for which we have the following consistency result. Proposition 3.4.6 . Under Assumptions 3.4.1 and 3.4.2 it holds that \sup_{t\in[0,1]}|\widehat{\mathcal{V}}_{n}^{\theta}(t)-\mathcal{V}^{\theta}(t)|\xrightarrow{\scalebox{0.6}{$P/\Theta$}}0, as n\to\infty . We emphasize that \mathcal{V} is only the asymptotic variance function of the LCM estimator under H_{0} . It is always the asymptotic variance function of U^{(n)} , but in the alternative the asymptotic distribution of \widehat{\gamma}^{(n)} also involves the asymptotic distribution of D_{1}^{(n)} and is thus more complicated. Tests of conditional local independence can now be constructed in terms of univariate functionals of \widehat{\gamma}^{(n)} and \widehat{\mathcal{V}}_{n} that quantify the magnitude of the LCM. The asymptotics of such test statistics under H_{0} are described in the following corollary, which is essentially an application of the continuous mapping theorem. Corollary 3.4.7 . Let \mathcal{J}\colon D[0,1]\times D[0,1]\to\mathbb{R} be a functional that is continuous on the closed subset C[0,1]\times\overline{\{\mathcal{V}^{\theta}\colon\theta\in\Theta_{0}\}} with respect the uniform topology, i.e., the topology generated by the norm \|(f_{1},f_{2})\|=\max\{\|f_{1}\|_{\infty},\|f_{2}\|_{\infty}\} for f_{1},f_{2}\in D[0,1] . Define the test statistic \widehat{D}_{n}^{\theta}=\mathcal{J}\left(\sqrt{|J_{n}|}\widehat{\gamma}^{(n),\theta},\;\widehat{\mathcal{V}}_{n}^{\theta}\right). Under Assumptions 3.4.1 and 3.4.2 , it holds that \displaystyle\widehat{D}_{n}^{\theta}\xrightarrow{\scalebox{0.6}{$\mathcal{D}/\Theta_{0}$}}\mathcal{J}(U^{\theta},\mathcal{V}^{\theta}),\qquad n\to\infty, (3.4.28) where U^{\theta} is a mean zero continuous Gaussian martingale with variance function \mathcal{V}^{\theta} . 3.5 The Local Covariance Test In this section we introduce a practically applicable test based on the LCM estimator. Using the asymptotic distribution of the LCM estimator we show that the asymptotic distribution of our proposed test is independent of the sampling distribution under H_{0} and has an explicit representation. We show, in addition, uniform asymptotic level of the test, and we give a uniform power result for the additive residual process. Finally, we modify the test to be based on a cross-fitted estimator of the LCM instead of using sample splitting, and we show uniform level of that test. To construct a test statistic based on the LCM estimator it is beneficial that its distributional limit does not depend on the variance function. As a simple example, consider the endpoint test statistic: \displaystyle\big(\widehat{\mathcal{V}}_{n}(1)\big)^{-\frac{1}{2}}\sqrt{|J_{n}|}\widehat{\gamma}^{(n)}_{1}, (3.5.29) which under H_{0} converges in distribution to \mathcal{V}(1)^{-\frac{1}{2}}U_{1} by Corollary 3.4.7 . The distribution of the latter is the standard normal distribution, and in particular it does not depend on \mathcal{V} . Any test statistic constructed from \widehat{\gamma}^{(n)} should capture deviations of \gamma_{t} away from 0 . The test statistic in ( 3.5.29 ) does, however, only consider the endpoint of the process, and since \gamma is not necessarily monotone, \gamma_{t} may deviate more from 0 for other t\in[0,1] . Thus in order to increase power against such alternatives we consider the test statistic \displaystyle\widehat{T}_{n}=\frac{\sqrt{|J_{n}|}}{\sqrt{\widehat{\mathcal{V}}_{n}(1)}}\sup_{0\leq t\leq 1}\big|\widehat{\gamma}^{(n)}_{t}\big|. (3.5.30) We refer to \widehat{T}_{n} as the Local Covariance Test statistic (LCT statistic). We proceed to show that the LCT statistic can be turned into a test of H_{0} with asymptotic level \alpha , and which has asymptotic power against any alternative with a non-zero LCM. This is the best we can hope for of any test based on the LCM estimator. We note that it might be possible to establish similar results for other norms of the LCM, for example, a statistic based on a weighted L_{2} -norm. However, since other norms of the distributional limit U will generally have a distribution with a complicated dependency on \mathcal{V} , we believe that the LCT statistic is the simplest to construct. To establish uniform asymptotic level via Corollary 3.4.7 for tests based on test statistics such as ( 3.5.30 ) we need to assume that the asymptotic variances in t=1 are uniformly bounded away from zero. Assumption 3.5.1 . There exists \delta_{1}>0 such that for all \theta\in\Theta it holds that \mathcal{V}^{\theta}(1)\geq\delta_{1} . 3.5.1 Type I and type II error control We proceed to show that under H_{0} , the LCT statistic is distributed as \sup_{0\leq t\leq 1}|B_{t}| , where (B_{t}) is a standard Brownian motion. From this point onwards, we let S denote a random variable with such a distribution and note that its CDF can be written as: \displaystyle F_{S}(x)=\mathbb{P}(S\leq x)=\frac{4}{\pi}\sum_{k=0}^{\infty}\frac{(-1)^{k}}{2k+1}\exp\left(-\frac{\pi^{2}(2k+1)^{2}}{8x^{2}}\right),\qquad x>0. (3.5.31) See, for example, Section 12.2 in Schilling and Partzsch (2012) where the formula is derived from Lévy’s triple law. The p -value for a test of H_{0} equals 1-F_{S}(\widehat{T}_{n}) , and since the series in ( 3.5.31 ) converges at an exponential rate, the p -value can be computed with high numerical precision by truncating the series. Given a significance level \alpha\in(0,1) , we also let z_{1-\alpha} denote the (1-\alpha) -quantile of F_{S} , which exists and is unique since the right-hand side of ( 3.5.31 ) is strictly increasing and continuous. The Local Covariance Test (LCT) with significance level \alpha is then defined by \displaystyle\Psi_{n}=\Psi_{n}^{\alpha}=\mathbbl{1}(F_{S}(\widehat{T}_{n})>1-{\alpha})=\mathbbl{1}(\widehat{T}_{n}>z_{1-{\alpha}}). (3.5.32) From Theorem 3.4.5 we can now deduce the asymptotic properties of the LCT under the hypothesis of conditional local independence. Recall that \xrightarrow{\scalebox{0.6}{$\mathcal{D}/\Theta_{0}$}} denotes uniform convergence in distribution under H_{0} . Theorem 3.5.1 . Let Assumptions 3.4.1 , 3.4.2 and 3.5.1 hold true. Then it holds that \widehat{T}_{n}^{\theta}\xrightarrow{\scalebox{0.6}{$\mathcal{D}/\Theta_{0}$}}S as n\to\infty . As a consequence, for any \alpha\in(0,1) , \displaystyle\limsup_{n\to\infty}\sup_{\theta\in\Theta_{0}}\mathbb{P}(\Psi_{n}^{\alpha,\theta}=1)\leq\alpha. In other words, the Local Covariance Test defined in ( 3.5.32 ) has uniform asymptotic level \alpha . In general, we cannot expect that the test has power against alternatives to H_{0} for which the LCM is the zero-function. This is analogous to other types of conditional independence tests based on conditional covariances, e.g., GCM ( Shah and Peters, 2020 ) . However, we do have the following result that establishes power against local alternatives with \|\gamma\|_{\infty} decaying at an order of at most |J_{n}|^{-1/2} . Theorem 3.5.2 . Let Assumptions 3.4.1 and 3.4.2 hold true. Using the additive residual process it holds that for any 0<\alpha<\beta<1 there exists c>0 such that \displaystyle\liminf_{n\to\infty}\inf_{\theta\in\mathcal{A}_{c,n}}\mathbb{P}(\Psi_{n}^{\alpha,\theta}=1)\geq\beta, where \mathcal{A}_{c,n}=\{\theta\in\Theta\mid\|\gamma^{\theta}\|_{\infty}\geq c|J_{n}|^{-1/2}\} . 3.5.2 Extension to cross-fitting In Section 3.4 we considered sample splitting with observations indexed by J_{n}^{c} used to estimate the two models and with observations indexed by J_{n} used to estimate \gamma . Following Chernozhukov et al. (2018) , we can improve efficiency by cross-fitting, i.e., by flipping the roles of J_{n} and J_{n}^{c} to obtain a second equivalent estimator of \gamma . Heuristically, the two estimators are approximately independent, and thus their average should be a more efficient estimator. This procedure generalizes directly to a partition J_{n}^{1}\cup\cdots\cup J_{n}^{K}=\{1,\ldots,n\} of the indices into K disjoint folds. The partition is assumed to have a uniform asymptotic density, meaning that |J_{n}^{k}|/n\to\frac{1}{K} as n\to\infty for each k . We estimate G and \lambda using (J_{n}^{k})^{c}=\{1,\ldots,n\}\setminus J_{n}^{k} and subsequently estimate \gamma using J_{n}^{k} . Then the K -fold Cross-fitted LCM estimator , abbreviated as X-LCM, is defined as the average LCM estimator over the K folds, i.e., \displaystyle\check{\gamma}_{t}^{K,(n)}=\frac{1}{K}\sum_{k=1}^{K}\frac{1}{|J_{n}^{k}|}\sum_{j\in J_{n}^{k}}\int_{0}^{t}\widehat{G}_{j,s}^{k,(n)}\mathrm{d}\widehat{M}^{k,(n)}_{j,s}, (3.5.33) where for each j\in J_{n}^{k} , the processes \widehat{G}_{j}^{k,(n)} and \widehat{M}^{k,(n)}_{j} are the model predictions of G_{j} and M_{j} , respectively, based on training data indexed by (J_{n}^{k})^{c} . We also define a K -fold version of the variance estimator: \displaystyle\check{\mathcal{V}}_{n}^{K}(t)=\frac{1}{K}\sum_{k=1}^{K}\frac{1}{|J_{n}^{k}|}\sum_{j\in J_{n}^{k}}\int_{0}^{t}\left(\widehat{G}_{j,s}^{k,(n)}\right)^{2}\mathrm{d}N_{j,s}. (3.5.34) Now, similarly to the LCT statistic, the cross-fitted estimator can be used to construct a test statistic, \displaystyle\check{T}_{n}^{K}=\sqrt{\frac{n}{\check{\mathcal{V}}_{K,n}(1)}}\sup_{0\leq t\leq 1}\left|\check{\gamma}_{t}^{K,(n)}\right|, (3.5.35) from which we define the following test of conditional local independence. Definition 5 . Let \alpha\in(0,1) and let \check{T}_{n}^{K} be the test statistic from ( 3.5.35 ). The K -fold Cross-fitted Local Covariance Test (X-LCT) with significance level \alpha is defined by \displaystyle\check{\Psi}_{n}^{K}=\mathbbl{1}(F_{S}(\check{T}_{n}^{K})>1-\alpha)=\mathbbl{1}(\check{T}_{n}^{K}>z_{1-\alpha}), where z_{1-\alpha} is the (1-\alpha) -quantile of the distribution function F_{S} given in ( 3.5.31 ). We provide a summary of the computation of the X-LCT in Algorithm 2 . The asymptotic analysis of \widehat{\gamma}^{(n)} generalizes to \check{\gamma}^{K,(n)} , but we will refrain from restating all results for the K -fold cross-fitted estimator. For simplicity, we focus on the fact that the X-LCT has asymptotic level \alpha . Theorem 3.5.3 . Suppose that Assumption 3.4.2 is satisfied for every sample split J_{n}^{k}\cup(J_{n}^{k})^{c},k=1,\ldots,K . Under Assumptions 3.4.1 and 3.5.1 , the X-LCT statistic satisfies \check{T}_{n}^{K,\theta}\xrightarrow{\scalebox{0.6}{$\mathcal{D}/\Theta_{0}$}}S for n\to\infty . In particular, the X-LCT has uniform asymptotic level \alpha . Note that cross-fitting recovers full efficiency in the sense that the scaling factor is \sqrt{n} rather than \sqrt{|J_{n}|} , which leads to a more powerful test. Moreover, the asymptotic distribution of \check{T}_{n}^{K} does not depend on the number of folds K , and any difference between various choices of K can thus be attributed to finite sample errors. Larger values of K will allocate more data to estimation of G and \lambda , which intuitively should be the harder estimation problem. Following Remark 3.1 in Chernozhukov et al. (2018) , we believe that a default choice of K=4 or K=5 should be reasonable in practice. Algorithm 2 K -fold cross-fitted local covariance test (X-LCT) input : processes (N_{j},X_{j},Z_{j})_{j=1,\ldots,n} , partition J_{n}^{1}\cup\cdots\cup J_{n}^{K} of indices into K folds; 1 options : historical regression methods for estimation of \lambda and G given (N,Z) , 2 discrete time grid \mathbb{T}\subset[0,1] , significance level \alpha\in(0,1) ; 3 begin 4 for k=1,\ldots,K do 5 apply Algorithm 1 on sample split J_{n}^{k}\cup(J_{n}^{k})^{c} to compute \widetilde{\gamma}^{k,(n)} on the grid \mathbb{T} ; 6 use Equation ( 3.4.27 ) on sample split J_{n}^{k}\cup(J_{n}^{k})^{c} to compute \widetilde{\mathcal{V}}_{k,n}(1) ; 7 compute \check{\gamma}^{K,(n)}=\frac{1}{K}\sum_{k=1}^{K}\widetilde{\gamma}^{k,(n)} on grid \mathbb{T} ; 8 compute \check{\mathcal{V}}_{K,n}(1)=\frac{1}{K}\sum_{k=1}^{K}\widetilde{\mathcal{V}}_{k,n}(1) ; 9 compute the X-LCT statistic \check{T}_{n}^{K}=\sqrt{n}\cdot\max_{t\in\mathbb{T}}|\check{\gamma}_{t}^{K,(n)}|/\sqrt{\check{\mathcal{V}}_{K,n}(1)} ; 10 compute p -value \check{p}=1-F_{S}(\check{T}_{n}^{K}) by truncating the series in Equation ( 3.5.31 ). 11 output : the X-LCT \check{\Psi}_{n}^{K}=\mathbbl{1}(\check{p}<\alpha) , and optionally the p -value \check{p} ; 3.6 Simulation study In this section we present the results from a simulation study based on the Cox example introduced in Section 3.2.2 . We elaborate in Section 3.6.1 on the full model specification used for the simulation study – which will also illuminate how \Pi and \lambda can be modeled and estimated. The results from the simulation study focus on the distribution of the X-LCT statistic \check{T}_{n}^{K} and validate the asymptotic level and power of the X-LCT \check{\Psi}_{n}^{K} . The latter is also compared to a hazard ratio test based on the marginal Cox model ( 3.2.11 ). The simulations were implemented in Python and the code is available 3 3 3 https://github.com/AlexanderChristgau/nonparametric-cli-test . 3.6.1 Cox model continued Consider the same setup as in Section 3.2.2 . To fully specify the model we need to specify the distribution of the processes X , Y and Z . We suppose that X and Y can be written in terms of Z as \displaystyle X_{t}=\int_{0}^{t}Z_{s}\rho_{X}(s,t)\mathrm{d}s+V_{t},\qquad\text{and}\qquad Y_{t}=\int_{0}^{t}Z_{s}\rho_{Y}(s,t)\mathrm{d}s+W_{t}, (3.6.36) where \rho_{X} and \rho_{Y} are two functions defined on the triangle \{(s,t)\in[0,1]^{2}\mid s\leq t\} , and where V=(V_{t})_{0\leq t\leq 1} and W=(W_{t})_{0\leq t\leq 1} are two noise processes with mean zero. The processes Z , V and W are assumed independent, which implies ( 3.2.10 ) and thus that N is conditionally locally independent of X given \mathcal{F}_{t}=\mathcal{F}_{t}^{N,Z} . The specific dependency of X and Y on Z is known as the historical functional linear model in functional data analysis ( Malfait and Ramsay, 2003 ) . Within this model, \Pi_{t}=\mathbb{E}(X_{t}\mid\mathcal{F}_{t-})=\int_{0}^{t}Z_{s}\rho_{X}(s,t)\mathrm{d}s, (3.6.37) and on (T\geq t) \displaystyle\mathbb{E}(e^{Y_{t}}\mid\mathcal{F}_{t})=e^{\int_{0}^{t}Z_{s}\rho_{Y}(s,t)\mathrm{d}s}\mathbb{E}(e^{W_{t}}\mid T\geq t)=e^{\tilde{\beta}_{0}(t)+\int_{0}^{t}Z_{s}\rho_{Y}(s,t)\mathrm{d}s}, where \tilde{\beta}_{0}(t)=\log(\mathbb{E}(e^{W_{t}}\mid T\geq t)) . Since \lambda_{t}=\mathbbl{1}(T\geq t)\lambda_{t}^{0}e^{\beta Z_{t}}\mathbb{E}(e^{Y_{t}}\mid\mathcal{F}_{t}), it follows that on (T\geq t) , \displaystyle\log(\lambda_{t})=\beta_{0}(t)+\beta Z_{t}+\int_{0}^{t}Z_{s}\rho_{Y}(s,t)\mathrm{d}s, (3.6.38) where the two baseline terms depending only on time have been merged into \beta_{0} . The computations above suggest how the estimators \widehat{\lambda}^{(n)} and \widehat{\Pi}^{(n)} could be constructed. That is, \widehat{\lambda}^{(n)} could be based on estimates of \beta , \beta_{0} and \rho_{Y} from the observations (T_{j},Z_{j})_{j\in J_{n}^{c}} , and \widehat{\Pi}^{(n)} could be based on estimates of \rho_{X} from (X_{j},Z_{j})_{j\in J_{n}^{c}} . We would then have \widehat{\Pi}^{(n)}_{j,t}=\int_{0}^{t}Z_{j,s}\widehat{\rho}_{X}^{(n)}(s,t)\mathrm{d}s for j\in J_{n} where \widehat{\rho}_{X}^{(n)} denotes the estimate of \rho_{X} , and similarly for \widehat{\lambda}^{(n)}_{j,t} . Particular choices of estimators \widehat{\rho}_{X}^{(n)} and \widehat{\rho}_{Y}^{(n)} and their theoretical properties are reviewed in Section 3 in the supplement. Our conclusion from this review is that for the historical functional linear model, sufficient rate results should be possible but have not yet been established rigorously. 3.6.2 Sampling scheme The actual time-discretized simulations and computations were implemented using an equidistant grid \mathbb{T}=(t_{i})_{i=1}^{q} with q=128 time points 0=t_{1}<\cdots0 and a choice of \beta_{2}\in\{-1,1\} . To sample T we applied the inverse hazard method, which utilizes that \Lambda_{T}^{\text{full}} is standard exponentially distributed. That is, we sampled E\sim\mathrm{Exp}(1) and numerically computed T=\max\{t\in\mathbb{T}\mid\Lambda_{t}^{\text{full}}0 . From Assumption 3.4.1 , we note that for n sufficiently large such that |J_{n}|>(C^{\prime})^{2}/\epsilon^{2} , it holds that \mathbb{P}\left(\left|G_{j,s}\right|\geq\epsilon\sqrt{|J_{n}|}\right)=0 for all j\in J_{n} . As a consequence, the terms in ( 3.A.2 ) are almost surely zero for n sufficiently large uniformly over \Theta . It follows that \big\langle U_{\epsilon}^{(n)}\big\rangle(t)\xrightarrow{\scalebox{0.6}{$P/\Theta$}}0 , which establishes the second part of ( 3.C.2 ). We finally note that the collection of variance functions, (\mathcal{V}^{\theta})_{\theta\in\Theta} , is uniformly equicontinuous and bounded above under Assumption 3.4.1 . This is established in Lemma 3.A.2 below. We have thus verified all the conditions of Theorem 3.C.3 , so we conclude that \displaystyle U^{(n),\theta}\xrightarrow{\scalebox{0.6}{$\mathcal{D}/\Theta$}}U^{\theta} in D[0,1] as n\to\infty , where U^{\theta} is a mean zero continuous Gaussian martingale with variance function \mathcal{V}^{\theta} . ∎ Note that the convergence of ( 3.A.2 ) is established directly from the uniform bounds in Assumption 3.4.1 . However, the convergence could also be established under a milder conditions with alternative arguments. For example, under the weaker assumption of uniformly bounded variance functions, dominated convergence can be used to establish L_{1} -convergence. In the proof above we invoked the following lemma, which we will also use in several proofs in the sequel. Lemma 3.A.2 . Under Assumption 3.4.1 , the collections (\gamma^{\theta})_{\theta\in\Theta} and (\mathcal{V}^{\theta})_{\theta\in\Theta} are each uniformly Lipschitz and in particular uniformly equicontinuous. Moreover, it holds almost surely that \displaystyle\sup_{t\in[0,1]}|\gamma_{t}|\leq 2CC^{\prime}\qquad\text{and}\qquad\mathcal{V}(1)=\mathbb{E}\left(\int_{0}^{1}G_{s}^{2}\bm{\lambda}_{s}\mathrm{d}s\right)\leq C(C^{\prime})^{2}. Proof. For any 0\leq s0:\quad\lim_{n\to\infty}\sup_{\theta\in\Theta}\mathbb{P}\Big(\sup_{t\in[0,1]}|R_{i,t}^{\theta}|>\epsilon\Big)=0. For a general discussion of the relation between weak convergence and convergence in probability uniformly as a stochastic process, see Newey (1991) . For a general discussion of uniform stochastic convergence over a distribution parameter, see Section 3 and the references contained therein. In Section 3.B.3 , we discuss the combination of both convergences. As in the proof of Proposition 3.4.2 , \tilde{\mathcal{G}}_{t}^{n} denotes the smallest right continuous and complete filtration generated by the filtrations \{\mathcal{G}_{j,t}\mid j\in J_{n}\} . Analogously, we let \mathcal{\tilde{G}}_{t}^{n,c} be the smallest right continuous and complete filtration generated by the filtrations \{\mathcal{G}_{j,t}\mid j\in J_{n}^{c}\} . We start by considering R_{3}^{(n)} , since this is the easiest case. Lemma 3.A.3 . Under Assumption 3.4.2 it holds that \sup_{t\in[0,1]}|R_{3,t}^{(n)}|\xrightarrow{\scalebox{0.6}{$P/\Theta$}}0 . Proof. We will show the result by showing that \displaystyle\sup_{\theta\in\Theta}\mathbb{E}\left(\sup_{0\leq t\leq 1}|R_{3,t}^{(n),\theta}|\right)\to 0 as n\to\infty . Using that the random variables \displaystyle\sup_{0\leq t\leq 1}\left|G_{j,t}-\widehat{G}_{j,t}^{(n)}\right|\cdot\sup_{0\leq t\leq 1}\left|\lambda_{j,t}-\widehat{\lambda}_{j,t}^{(n)}\right| for j\in J_{n} are identically distributed for each fixed n\geq 2 , we have that \displaystyle\mathbb{E}\left(\sup_{0\leq t\leq 1}|R_{3,t}^{(n)}|\right) \displaystyle=\mathbb{E}\left(\sup_{0\leq t\leq 1}\left|\frac{1}{\sqrt{|J_{n}|}}\sum_{j\in J_{n}}\int_{0}^{t}\left(G_{j,s}-\widehat{G}_{j,s}^{(n)}\right)\left(\lambda_{j,s}-\widehat{\lambda}_{j,s}^{(n)}\right)\mathrm{d}s\right|\right) \displaystyle\leq\frac{1}{\sqrt{|J_{n}|}}\sum_{j\in J_{n}}\mathbb{E}\left(\sup_{0\leq t\leq 1}\int_{0}^{t}\left|G_{j,s}-\widehat{G}_{j,s}^{(n)}\right|\cdot\left|\lambda_{j,s}-\widehat{\lambda}_{j,s}^{(n)}\right|\mathrm{d}s\right) \displaystyle=\sqrt{|J_{n}|}\mathbb{E}\left(\int_{0}^{1}\left|G_{s}-\widehat{G}_{s}^{(n)}\right|\cdot\left|\lambda_{s}-\widehat{\lambda}_{s}^{(n)}\right|\mathrm{d}s\right) \displaystyle\leq\sqrt{|J_{n}|}\mathbb{E}\left(\sqrt{\int_{0}^{1}\left(G_{s}-\widehat{G}_{s}^{(n)}\right)^{2}\mathrm{d}s}\sqrt{\int_{0}^{1}\left(\lambda_{s}-\widehat{\lambda}_{s}^{(n)}\right)^{2}\mathrm{d}s}\right) \displaystyle\leq\sqrt{|J_{n}|}\sqrt{\mathbb{E}\left(\int_{0}^{1}\left(G_{s}-\widehat{G}_{s}^{(n)}\right)^{2}\mathrm{d}s\right)}\sqrt{\mathbb{E}\left(\int_{0}^{1}\left(\lambda_{s}-\widehat{\lambda}_{s}^{(n)}\right)^{2}\mathrm{d}s\right)} \displaystyle=\sqrt{|J_{n}|}g(n)h(n). By Assumption 3.4.2 , \sqrt{|J_{n}|}g(n)h(n)\to 0 uniformly over \Theta as n\to\infty , so the result follows. ∎ Next we proceed to the remainder process R_{2}^{(n)} . Lemma 3.A.4 . Under Assumptions 3.4.1 and 3.4.2 , it holds that \sup_{t\in[0,1]}|R_{2,t}^{(n)}|\xrightarrow{\scalebox{0.6}{$P/\Theta$}}0 . Proof. We first write \displaystyle R^{(n)}_{2,t} \displaystyle=\frac{1}{\sqrt{|J_{n}|}}\sum_{j\in J_{n}}\int_{0}^{t}\left(G_{j,s}-\widehat{G}_{j,s}^{(n)}\right)\mathrm{d}\bm{M}_{j,s}, and note that R^{(n)}_{2,t} is a square integrable, mean zero \tilde{\mathcal{G}}_{t}^{n} -martingale conditionally on \tilde{\mathcal{G}}_{1}^{n,c} . This follows by applying Lemma 3.4.1 to each of the terms, which are i.i.d. conditionally on \tilde{\mathcal{G}}_{1}^{n,c} . We conclude that the squared process (R_{2,t}^{(n)})^{2} is a \tilde{\mathcal{G}}_{t}^{n} -submartingale conditionally on \tilde{\mathcal{G}}_{1}^{n,c} . By Doob’s submartingale inequality we have that \displaystyle\mathbb{P}\left(\sup_{0\leq t\leq 1}|R_{2,t}^{(n)}|\geq\epsilon\right) \displaystyle=\mathbb{P}\left(\sup_{0\leq t\leq 1}\left(R_{2,t}^{(n)}\right)^{2}\geq\epsilon^{2}\right) \displaystyle=\mathbb{E}\left(\mathbb{P}\left(\sup_{0\leq t\leq 1}\left(R_{2,t}^{(n)}\right)^{2}\geq\epsilon^{2}\mid\tilde{\mathcal{G}}_{1}^{n,c}\right)\right) \displaystyle\leq\frac{\mathbb{E}\left(\var\left(R_{2,1}^{(n)}\mid\tilde{\mathcal{G}}_{1}^{n,c}\right)\right)}{\epsilon^{2}} for \epsilon>0 . The collection of random variables \displaystyle\left(\int_{0}^{1}\left(G_{j,s}-\widehat{G}_{j,s}^{(n)}\right)\mathrm{d}\bm{M}_{j,s}\right)_{j\in J_{n}} are i.i.d. conditionally on \tilde{\mathcal{G}}_{1}^{n,c} . Therefore, \displaystyle\var\left(R_{2,1}^{(n)}\mid\tilde{\mathcal{G}}_{1}^{n,c}\right) \displaystyle=\frac{1}{|J_{n}|}\sum_{j\in J_{n}}\var\left(\int_{0}^{1}\left(G_{j,s}-\widehat{G}_{j,s}^{(n)}\right)\mathrm{d}\bm{M}_{j,s}\mid\tilde{\mathcal{G}}_{1}^{n,c}\right) \displaystyle=\mathbb{E}\left(\int_{0}^{1}\left(G_{s}-\widehat{G}_{s}^{(n)}\right)^{2}\mathrm{d}\langle\bm{M}\rangle_{s}\mid\tilde{\mathcal{G}}_{1}^{n,c}\right) \displaystyle=\mathbb{E}\left(\int_{0}^{1}\left(G_{s}-\widehat{G}_{s}^{(n)}\right)^{2}\bm{\lambda}_{s}\mathrm{d}s\mid\tilde{\mathcal{G}}_{1}^{n,c}\right) \displaystyle\leq C\cdot\mathbb{E}\left(\int_{0}^{1}\left(G_{s}-\widehat{G}_{s}^{(n)}\right)^{2}\mathrm{d}s\mid\tilde{\mathcal{G}}_{1}^{n,c}\right) where we have used that \bm{\lambda}_{t} is bounded by Assumption 3.4.1 (i). Thus \displaystyle\mathbb{E}\left(\var\left(R_{2,1}^{(n)}\mid\tilde{\mathcal{G}}_{1}^{n,c}\right)\right)\leq C\cdot\mathbb{E}\left(\int_{0}^{1}\left(G_{s}-\widehat{G}_{s}^{(n)}\right)^{2}\mathrm{d}s\right)=C\cdot g(n)^{2}, and we conclude that \displaystyle\mathbb{P}\left(\sup_{0\leq t\leq 1}|R_{2,t}^{(n)}|\geq\epsilon\right)\leq\frac{C\cdot g(n)^{2}}{\epsilon^{2}}\to 0, as n\to\infty uniformly over \Theta by Assumption 3.4.2 . ∎ Before proving that R_{1}^{(n)} converges weakly to the zero-process, we will need two auxiliary lemmas. The first is a conditional version of Hoeffding’s lemma, which lets us conclude conditional sub-Gaussianity. Recall that a mean zero random variable A is sub-Gaussian with variance factor \nu>0 if \displaystyle\log\mathbb{E}(e^{xA})\leq\frac{x^{2}\nu}{2} for all x\in\mathbb{R} . See, for example, Boucheron et al. (2013) , Lemma 2.2, for the classical unconditional version. Lemma 3.A.5 (conditional Hoeffding’s lemma) . Let Y be a random variable taking values on a bounded interval [a,b] , satisfying \mathbb{E}[Y|\mathcal{G}]=0 for a \sigma -algebra \mathcal{G} . Then \log\mathbb{E}(e^{xY}\mid\mathcal{G})\leq(b-a)^{2}x^{2}/8 almost surely for all x\in\mathbb{R} . Proof. Fix x\in\mathbb{R} . By convexity of the exponential function we have \displaystyle e^{xy}\leq\frac{b-y}{b-a}e^{xa}+\frac{y-a}{b-a}e^{xb},\qquad y\in[a,b]. Inserting Y in place of y and taking the conditional expectation yields \displaystyle\mathbb{E}[e^{xY}\mid\mathcal{G}]\leq\frac{b}{b-a}e^{xa}-\frac{a}{b-a}e^{xb}=e^{L(x(b-a))} almost surely, where L(h)=\frac{ha}{b-a}+\log(1+\frac{a-e^{h}a}{b-a}) . Standard calculations show that L(0)=L^{\prime}(0)=0 , and the AM-GM inequality implies \displaystyle L^{\prime\prime}(h)=-\frac{abe^{h}}{(b-ae^{h})^{2}}\leq\frac{1}{4}. Thus, a second order Taylor expansion yields that L(h)\leq\frac{1}{8}h^{2} , and it follows that \log\mathbb{E}[e^{xY}\mid\mathcal{G}]\leq\frac{(b-a)^{2}}{8}x^{2} as desired. ∎ For the next lemma define for s,t\in[0,1] with s0 that \displaystyle\mathbb{P}(|R^{(n)}_{1,t}|>\epsilon)\leq\frac{\var(R^{(n)}_{1,t})}{\epsilon^{2}}\leq\frac{(C^{\prime})^{2}h(n)^{2}}{\epsilon^{2}}\longrightarrow 0 as n\to\infty uniformly over \Theta by Assumption 3.4.2 . This completes the first part of the proof. For the second part, we use a chaining argument based on the exponential inequality in Lemma 3.A.6 . We let \displaystyle W^{s,t}_{j}=\frac{1}{t-s}\int_{s}^{t}G_{j,u}\left(\lambda_{j,u}-\widehat{\lambda}_{j,u}^{(n)}\right)\mathrm{d}u and \displaystyle A=\frac{1}{\sqrt{|J_{n}|}}\sum_{j\in J_{n}}W_{j}^{s,t}=\frac{1}{t-s}(R_{1,t}^{(n)}-R_{1,s}^{(n)}). Using that (W_{j}^{s,t})_{j\in J_{n}} are i.i.d. conditionally on \tilde{\mathcal{G}}_{1}^{n,c} we have by Lemma 3.A.6 that \mathbb{E}(A)=0 and that \displaystyle\log\mathbb{E}\left(e^{xA}\right) \displaystyle=\log\mathbb{E}\left(\mathbb{E}\left(e^{xA}\mid\tilde{\mathcal{G}}_{1}^{n,c}\right)\right) \displaystyle=\log\mathbb{E}\left(\prod_{j\in J_{n}}\mathbb{E}\left(e^{\frac{x}{\sqrt{|J_{n}|}}W_{j}^{s,t}}\mid\tilde{\mathcal{G}}_{1}^{n,c}\right)\right) \displaystyle\leq\log\mathbb{E}\left(e^{\frac{x^{2}\nu}{2}}\right) \displaystyle=\frac{x^{2}\nu}{2}. Hence A is also sub-Gaussian with variance factor \nu . This implies that \displaystyle\mathbb{P}(|A|>\eta)\leq 2e^{-\frac{\eta^{2}\nu}{2}} for all \eta>0 . Rephrased in terms of R_{1}^{(n)} this bound reads \displaystyle\mathbb{P}\left(|R_{1,t}^{(n)}-R_{1,s}^{(n)}|>\eta(t-s)\right)\leq 2e^{-\frac{\eta^{2}\nu}{2}} for all \eta>0 and s0 . Proposition 3.4.3 now follows from combining the Lemmas 3.A.7 , 3.A.4 , and 3.A.3 . ∎ 3.A.6 Proof of Proposition 3.4.4 We separate the discussion of D_{1}^{(n)} and D_{2}^{(n)} into the Lemmas 3.A.8 and 3.A.10 , respectively, which together amount to Proposition 3.4.4 . Lemma 3.A.8 . Suppose that Assumptions 3.4.1 and 3.4.2 hold. Then the stochastic process \overline{D}^{(n)}\coloneqq D_{1}^{(n)}-\sqrt{|J_{n}|}\cdot\gamma converges in distribution in C[0,1] uniformly over \Theta . Proof. Let \overline{D}^{(n)}\coloneqq D_{1}^{(n)}-\sqrt{|J_{n}|}\cdot\gamma and note that \overline{D}^{(n)}=|J_{n}|^{-\frac{1}{2}}\sum_{j\in J_{n}}W_{j}, where W_{j} is given by W_{j,t}\coloneqq\int_{0}^{t}G_{j,s}(\bm{\lambda}_{j,s}-\lambda_{j,s})\mathrm{d}s-\gamma_{t} for each j\in J_{n} . By assumption, the variables \{W_{j}\colon j\in J_{n}\} are i.i.d. with the same distribution as the process W given by W_{t}\coloneqq\int_{0}^{t}G_{s}(\bm{\lambda}_{s}-\lambda_{s})\mathrm{d}s-\gamma_{t} . For each \theta\in\Theta , let \Gamma^{\theta} be a Gaussian process with mean zero and covariance function (s,t)\mapsto\cov(W_{s}^{\theta},W_{t}^{\theta}) , which is well-defined by computations shown below. We will show that \overline{D}^{(n),\theta}\xrightarrow{\scalebox{0.6}{$\mathcal{D}/\Theta$}}\Gamma^{\theta} in C[0,1] by applying Lemma 3.B.12 , which is an example of Prokhorov’s method of ”tightness + identification of limit”. We first prove that for any given k\in\mathbb{N} and 0\leq t_{1}0 there exists K>0 such that \displaystyle\limsup_{n\to\infty}\sup_{\theta\in\Theta}\mathbb{P}\left(\|\overline{D}^{(n),\theta}\|_{\infty}>K\right)<\varepsilon. Proof. We have established in the proof of Lemma 3.A.8 , under the same conditions, that \overline{D}^{(n),\theta}\xrightarrow{\scalebox{0.6}{$\mathcal{D}/\Theta$}}\Gamma^{\theta} weakly in C[0,1] . By the uniform continuous mapping theorem formulated in Proposition 3.B.5 , it follows that \|\overline{D}^{(n),\theta}\|_{\infty}\xrightarrow{\scalebox{0.6}{$\mathcal{D}/\Theta$}}\|\Gamma^{\theta}\|_{\infty} . From Bengs and Holzmann (2019) Theorem 4.1 we then obtain that \displaystyle\limsup_{n\to\infty}\sup_{\theta\in\Theta}\mathbb{P}(\|\overline{D}^{(n),\theta}\|_{\infty}>K)\leq\sup_{\theta\in\Theta}\mathbb{P}(\|\Gamma^{\theta}\|_{\infty}>K)\leq\frac{\mathbb{E}\|\Gamma^{\theta}\|_{\infty}}{K}. Hence it suffices to argue that \mathbb{E}\|\Gamma^{\theta}\|_{\infty} is uniformly bounded over \Theta . To this end, we note that Equation ( 3.A.4 ) shows that square means of the increments of \Gamma^{\theta} are smaller that those of a standard Brownian motion scaled by 2CC^{\prime} . Then the Sudakov–Fernique comparison inequality ( Adler and Taylor, 2007 , Theorem 2.2.3) allows us to leverage this relationship to the expected uniform norms, i.e., \mathbb{E}\|\Gamma^{\theta}\|_{\infty}\leq 2CC^{\prime}\mathbb{E}(\sup_{t\in[0,1]}|B_{t}|) . It can be verified that \mathbb{E}(\sup_{t\in[0,1]}|B_{t}|) is finite, and in fact, equal to \sqrt{\pi/2} as shown in saz (2019) . ∎ Lemma 3.A.10 . Suppose that Assumptions 3.4.1 and 3.4.2 hold, and that G_{t}=X_{t}-\Pi_{t} is the additive residual process. Then D_{2}^{(n)}\xrightarrow{\scalebox{0.6}{$P/\Theta$}}0 in D[0,1] as n\to\infty . Proof. Note first that the terms in D_{2}^{(n)} are i.i.d. conditionally on \tilde{\mathcal{G}}_{1}^{n,c} , with the same distribution as the process \xi given by \displaystyle\xi_{t}=\frac{1}{\sqrt{|J_{n}|}}\int_{0}^{t}(\widehat{G}_{s}^{(n)}-G_{s})(\bm{\lambda}_{s}-\lambda_{s})\mathrm{d}s. Since \bm{\lambda}_{t} is independent of \tilde{\mathcal{G}}_{1}^{n,c} , we have from the innovation theorem that \mathbb{E}(\bm{\lambda}_{t}\mid\mathcal{F}_{t-}\vee\tilde{\mathcal{G}}_{1}^{n,c})=\mathbb{E}(\bm{\lambda}_{t}\mid\mathcal{F}_{t-})=\lambda_{t}. For the additive residual process we also note that G_{t}-\widehat{G}_{t}^{(n)}=\widehat{\Pi}_{t}^{(n)}-\Pi_{t} is \mathcal{F}_{t} -predictable conditionally on \tilde{\mathcal{G}}_{1}^{n,c} . It now follows that \displaystyle\sqrt{|J_{n}|}\cdot\mathbb{E}[\xi_{t}\mid\tilde{\mathcal{G}}_{1}^{n,c}] \displaystyle=\int_{0}^{t}\mathbb{E}[(\widehat{G}_{s}^{(n)}-G_{s})(\bm{\lambda}_{s}-\lambda_{s})\mid\tilde{\mathcal{G}}^{n,c}]\mathrm{d}s \displaystyle=\int_{0}^{t}\mathbb{E}[(\widehat{G}_{s}^{(n)}-G_{s})(\mathbb{E}[\bm{\lambda}_{s}\mid\mathcal{F}_{s-}\vee\tilde{\mathcal{G}}^{n,c}]-\lambda_{s})\mid\tilde{\mathcal{G}}^{n,c}]\mathrm{d}s=0. We can therefore conclude that D_{2}^{(n)} is mean zero conditionally on \tilde{\mathcal{G}}^{n,c} . Using that the terms of D_{2}^{(n)} are i.i.d. conditionally on \tilde{\mathcal{G}}^{n,c} once more, we now obtain that \displaystyle\var(D_{2,t}^{(n)}\mid\tilde{\mathcal{G}}^{n,c})=|J_{n}|\cdot\var(\xi_{t}\mid\tilde{\mathcal{G}}^{n,c}) \displaystyle=\mathbb{E}\left[\left(\int_{0}^{t}(\widehat{G}_{s}^{(n)}-G_{s})(\bm{\lambda}_{s}-\lambda_{s})\mathrm{d}s\right)^{2}\Big|\tilde{\mathcal{G}}^{n,c}\right] \displaystyle\leq 4C^{2}\cdot\mathbb{E}\left(\int_{0}^{1}(\widehat{G}_{s}^{(n)}-G_{s})^{2}\mathrm{d}s\Big|\tilde{\mathcal{G}}^{n,c}\right). Taking expectation of the above we have \var(D_{2,t}^{(n)})=\mathbb{E}(\var(D_{2,t}^{(n)}\mid\tilde{\mathcal{G}}^{n,c}))\leq 4C^{2}g(n)^{2} . By Chebyshev’s inequality we get for all \epsilon>0 \displaystyle\mathbb{P}\left(|D_{2,t}^{(n)}|>\epsilon\right)\leq\frac{4C^{2}g(n)^{2}}{\epsilon^{2}}, and by Assumption 3.4.2 we conclude that D_{2,t}^{(n)}\xrightarrow{\scalebox{0.6}{$P/\Theta$}}0 for each t\in[0,1] . We now apply the same chaining argument used in the proofs of Lemma 3.A.7 and Lemma 3.A.8 . From Assumption 3.4.1 , we have for 0\leq s0 , \displaystyle\lim_{\delta\to 0^{+}}\sup_{\theta\in\Theta}\mathbb{P}\Big(\sup_{|t-s|<\delta}|U_{t}^{\theta}-U_{s}^{\theta}|>\epsilon\Big) \displaystyle=\lim_{\delta\to 0^{+}}\sup_{\theta\in\Theta}\mathbb{P}\Big(\sup_{|t-s|<\delta}|B_{\mathcal{V}^{\theta}(t)}-B_{\mathcal{V}^{\theta}(s)}|>\epsilon\Big) \displaystyle\leq\lim_{\delta\to 0^{+}}\sup_{\theta\in\Theta}\mathbb{P}\Big(K(\alpha)\sup_{|t-s|<\delta}|\mathcal{V}^{\theta}(t)-\mathcal{V}^{\theta}(s)|^{\alpha}>\epsilon\Big) \displaystyle=\lim_{\delta\to 0^{+}}\mathbb{P}\Big(K(\alpha)C_{0}^{\alpha}\delta^{\alpha}>\epsilon\Big)=0. This establishes the second condition of Theorem 7.3 in Billingsley (2013) , and we thus conclude that (U^{\theta})_{\theta\in\Theta} is uniformly tight in C[0,1] . ∎ We now return to the proof of Theorem 3.4.5 . For part i), we first note that under H_{0} we can take \bm{\lambda}_{t}=\lambda_{t} , which implies that both D_{1}^{(n)} and D_{2}^{(n)} equal the zero-process. Combining Propositions 3.4.2 and 3.4.3 with the uniform version of Slutsky’s theorem formulated in Lemma 3.B.4 , we conclude that \displaystyle\sqrt{|J_{n}|}\widehat{\gamma}^{(n)}=\underbrace{U^{(n)}}_{\xrightarrow{\scalebox{0.6}{$\mathcal{D}/\Theta_{0}$}}U^{\theta}}+\underbrace{R_{1}^{(n)}+R_{2}^{(n)}+R_{3}^{(n)}}_{\xrightarrow{\scalebox{0.6}{$P/\Theta$}}0}+\underbrace{D_{1}^{(n)}+D_{2}^{(n)}}_{=0\,\text{under }H_{0}}\xrightarrow{\scalebox{0.6}{$P/\Theta_{0}$}}U^{\theta}, in D[0,1] as n\to\infty , where U^{\theta} is the Gaussian martingale from Proposition 3.4.2 . For part ii) we can, in addition to Propositions 3.4.2 and 3.4.3 , apply Proposition 3.4.4 and Lemma 3.A.9 . Using the triangle inequality on the decomposition ( 3.4.17 ) yields that \displaystyle\sqrt{|J_{n}|}\cdot\|\widehat{\gamma}^{(n)}-\gamma\|_{\infty}\leq \displaystyle\|U^{(n)}\|_{\infty}+\|D_{1}^{(n)}-\sqrt{|J_{n}|}\gamma\|_{\infty} \displaystyle+\|R_{1}^{(n)}\|_{\infty}+\|R_{2}^{(n)}\|_{\infty}+\|R_{3}^{(n)}\|_{\infty}+\|D_{2}^{(n)}\|_{\infty}. All the terms in the second line converge in probability to zero uniformly over \Theta . Combined with the convergences established in Proposition 3.4.2 and Lemma 3.A.8 , we obtain that \displaystyle\limsup_{n\to\infty}\sup_{\theta\in\Theta}\mathbb{P}\left(\sqrt{|J_{n}|}\cdot\|\widehat{\gamma}^{(n),\theta}-\gamma^{\theta}\|_{\infty}>K\right) \displaystyle\qquad\leq\sup_{\theta\in\Theta}\mathbb{P}\left(\|U^{\theta}\|_{\infty}>K/6\right)+\sup_{\theta\in\Theta}\mathbb{P}\left(\|\Gamma^{\theta}\|_{\infty}>K/6\right), (3.A.5) where \Gamma^{\theta} is the limiting Gaussian process from (the proof of) Lemma 3.A.8 . The last term in ( 3.A.5 ) can be made arbitrarily small for K sufficiently large by Lemma 3.A.9 . Lemma 3.A.11 states that the family (U^{\theta})_{\theta\in\Theta} is tight in C[0,1] , and hence the family (\|U^{\theta}\|_{\infty})_{\theta\in\Theta} is tight in \mathbb{R}_{\geq 0} . This implies that the first term in ( 3.A.5 ) can also be made arbitrarily small for K sufficiently large. This establishes ( 3.4.26 ) and we are done. ∎ 3.A.8 Proof of Proposition 3.4.6 Consider the decomposition of the variance function estimator given by \displaystyle\widehat{\mathcal{V}}_{n}(t) \displaystyle=A^{(n)}_{t}+B^{(n)}_{t}+2C^{(n)}_{t} where \displaystyle A^{(n)}_{t} \displaystyle=\frac{1}{|J_{n}|}\sum_{j\in J_{n}}\int_{0}^{t}G_{j,s}^{2}\mathrm{d}N_{j,s}, \displaystyle B^{(n)}_{t} \displaystyle=\frac{1}{|J_{n}|}\sum_{j\in J_{n}}\int_{0}^{t}\left(G_{j,s}-\widehat{G}_{j,s}^{(n)}\right)^{2}\mathrm{d}N_{j,s}, \displaystyle C^{(n)}_{t} \displaystyle=\frac{1}{|J_{n}|}\sum_{j\in J_{n}}\int_{0}^{t}G_{j,s}\left(G_{j,s}-\widehat{G}_{j,s}^{(n)}\right)\mathrm{d}N_{j,s}. We first consider the asymptotic limit of A^{(n)} , which is the empirical mean of |J_{n}| i.i.d. samples of the process \int_{0}^{t}G_{s}^{2}\mathrm{d}N_{s} . Under Assumption 3.4.1 , we can apply the first part of Lemma 3.A.1 which states \bm{M}_{t}^{2}-\bm{\Lambda}_{t} is a martingale. We use this fact to note that \displaystyle\mathbb{E}(N_{1}^{2})=\mathbb{E}((\bm{M}_{1}+\bm{\Lambda}_{1})^{2})\leq 2\left(\mathbb{E}(\bm{M}_{1}^{2})+\mathbb{E}(\bm{\Lambda}_{1}^{2})\right)=4\,\mathbb{E}\left(\Big(\int_{0}^{1}\bm{\lambda}_{s}\mathrm{d}s\Big)^{2}\right)\leq 4C^{2}. Now, another use of Assumption 3.4.1 shows that \int_{0}^{t}G_{s}^{2}\mathrm{d}N_{s} has a second moment bounded by 4(CC^{\prime})^{2} . Thus we can apply the uniform law of large numbers ( Shah and Peters, 2020 , Lemma 19) to conclude for each t\in[0,1] , \displaystyle A_{t}^{(n)}=\frac{1}{|J_{n}|}\sum_{j\in J_{n}}\int_{0}^{t}G_{j,s}^{2}\mathrm{d}N_{j,s}\xrightarrow{\scalebox{0.6}{$P/\Theta$}}\mathbb{E}\left(\int_{0}^{t}G_{s}^{2}\mathrm{d}N_{s}\right)=\mathcal{V}(t). Note also that A^{(n)} and \mathcal{V} are non-decreasing and that the collection (\mathcal{V}^{\theta})_{\theta\in\Theta} is uniformly equicontinuous by Lemma 3.A.2 . These are exactly the conditions for Lemma 3.B.11 , so we can automatically conclude that \sup_{t\in[0,1]}|A_{t}^{(n)}-\mathcal{V}(t)|\xrightarrow{\scalebox{0.6}{$P/\Theta$}}0 . Next we show that the remainder terms B^{(n)} and C^{(n)} converge uniformly to zero in expectation. Similarly to the proof of Lemma 3.A.4 , we have under Assumptions 3.4.1 and 3.4.2 , \displaystyle\mathbb{E}\left(\sup_{0\leq t\leq 1}B_{t}^{(n)}\right)=\mathbb{E}(B_{1}^{(n)}) \displaystyle=\mathbb{E}\left(\frac{1}{|J_{n}|}\sum_{j\in J_{n}}\int_{0}^{1}\left(G_{j,s}-\widehat{G}_{j,s}^{(n)}\right)^{2}\bm{\lambda}_{j,s}\mathrm{d}s\right) \displaystyle=\mathbb{E}\left(\mathbb{E}\left(\frac{1}{|J_{n}|}\sum_{j\in J_{n}}\int_{0}^{1}\left(G_{j,s}-\widehat{G}_{j,s}^{(n)}\right)^{2}\bm{\lambda}_{j,s}\mathrm{d}s\mid\tilde{\mathcal{G}}_{1}^{c}\right)\right) \displaystyle=\mathbb{E}\left(\int_{0}^{1}\left(G_{s}-\widehat{G}_{s}^{(n)}\right)^{2}\bm{\lambda}_{s}\mathrm{d}s\right) \displaystyle\leq C\cdot g(n)^{2}\longrightarrow 0 as n\to\infty uniformly over \Theta . Lastly, we see that \displaystyle\mathbb{E}\left|\sup_{0\leq t\leq 1}C_{t}^{(n)}\right| \displaystyle\leq\mathbb{E}\left(\sup_{0\leq t\leq 1}|C_{t}^{(n)}|\right) \displaystyle\leq\mathbb{E}\left(\frac{1}{|J_{n}|}\sum_{j\in J_{n}}\sup_{0\leq t\leq 1}\int_{0}^{t}|G_{j,s}||G_{j,s}-\widehat{G}_{j,s}^{(n)}|\bm{\lambda}_{j,s}\mathrm{d}s\right) \displaystyle=\mathbb{E}\left(\frac{1}{|J_{n}|}\sum_{j\in J_{n}}\int_{0}^{1}|G_{j,s}||G_{j,s}-\widehat{G}_{j,s}^{(n)}|\bm{\lambda}_{j,s}\mathrm{d}s\right) \displaystyle=\mathbb{E}\left(\mathbb{E}\left(\frac{1}{|J_{n}|}\sum_{j\in J_{n}}\int_{0}^{1}|G_{j,s}||G_{j,s}-\widehat{G}_{j,s}^{(n)}|\bm{\lambda}_{j,s}\mathrm{d}s\mid\tilde{\mathcal{G}}_{1}^{c}\right)\right) \displaystyle=\mathbb{E}\left(\int_{0}^{1}|G_{s}||G_{s}-\widehat{G}_{s}^{(n)}|\bm{\lambda}_{s}\mathrm{d}s\right) \displaystyle\leq CC^{\prime}\mathbb{E}\left(\int_{0}^{1}|G_{s}-\widehat{G}_{s}^{(n)}|\mathrm{d}s\right) \displaystyle\leq CC^{\prime}\cdot g(n)\longrightarrow 0 as n\to\infty uniformly over \Theta by Assumption 3.4.2 . Combining the convergences established for A^{(n)} , B^{(n)} , and C^{(n)} , we get by a generalized Slutsky (Lemma 3.B.9 ) that \sup_{t\in[0,1]}|\widehat{\mathcal{V}}_{n}(t)-\mathcal{V}(t)|\xrightarrow{\scalebox{0.6}{$P/\Theta$}}0. ∎ 3.A.9 Proof of Corollary 3.4.7 Under Assumptions 3.4.1 and 3.4.2 we know by Theorem 3.4.5 and Proposition 3.4.6 that \displaystyle\sqrt{|J_{n}|}\widehat{\gamma}^{(n),\theta}\xrightarrow{\scalebox{0.6}{$\mathcal{D}/\Theta_{0}$}}U^{\theta}\qquad\text{and}\qquad\widehat{\mathcal{V}}_{n}^{\theta}\xrightarrow{\scalebox{0.6}{$P/\Theta_{0}$}}\mathcal{V}^{\theta} (3.A.6) in D[0,1] as n\to\infty . If we were to show pointwise convergence of the test statistic, this would now be a straightforward consequence of the continuous mapping theorem. However, to show uniform convergence, we will need an additional tightness argument. Let (\theta_{n})_{n\in\mathbb{N}}\subset\Theta_{0} be an arbitrary sequence. Proposition 3.B.2 then states that it suffices to show that there exists a subsequence (\theta_{k(n)})_{n\in\mathbb{N}}\subseteq(\theta_{n})_{n\in\mathbb{N}} , with k\colon\mathbb{N}\to\mathbb{N} strictly increasing, such that \lim_{n\to\infty}d_{BL}\big(\widehat{D}_{k(n)}^{\theta_{k(n)}},\mathcal{J}(U^{\theta_{k(n)}},\mathcal{V}^{\theta_{k(n)}})\big)=0. (3.A.7) Here d_{BL} denotes the bounded Lipschitz metric defined in Section 3 . By Lemma 3.A.11 , the collection (U^{\theta})_{\theta\in\Theta} is tight in C[0,1] under Assumption 3.4.1 . Therefore, Prokhorov’s theorem ( Kallenberg, 2021 , Theorem 23.2) asserts that there exists a subsequence (\theta_{a(n)})\subset(\theta_{n}) , and a C[0,1] -valued random variable \tilde{U} such that U^{\theta_{a(n)}}\xrightarrow{\mathcal{D}}\tilde{U} in C[0,1] . Likewise, Lemma 3.A.2 states that the collection (V^{\theta})_{\theta\in\Theta} is uniformly bounded and uniformly equicontinuous under Assumption 3.4.1 . Thus the Arzelà-Ascoli theorem yields that there exists a further subsequence (\theta_{b(n)})\subset(\theta_{a(n)}) and a function \tilde{\mathcal{V}}\in C[0,1] such that \|\mathcal{V}^{\theta_{b(n)}}-\tilde{\mathcal{V}}\|_{\infty}\to 0 . Combining the convergences of U^{\theta_{b(n)}} and \mathcal{V}^{\theta_{b(n)}} with those in Equation ( 3.A.6 ), it follows from the triangle inequality of the metric d_{BL} that also \displaystyle\sqrt{|J_{b(n)}|}\widehat{\gamma}^{(b(n)),{\theta_{b(n)}}}\xrightarrow{\mathcal{D}}\tilde{U}\qquad\text{and}\qquad\widehat{\mathcal{V}}_{b(n)}^{\theta_{b(n)}}\xrightarrow{P}\tilde{\mathcal{V}}, in D[0,1] as n\to\infty . Now we may use that convergence in Skorokhod topology is equivalent to convergence in uniform topology whenever the limit variable continuous, see e.g. Kallenberg (2021, Theorem 23.9) . Hence the convergences above also hold in (D[0,1],\|\cdot\|_{\infty}) . Since \mathcal{V} is deterministic, this implies the joint convergences \displaystyle(U^{\theta_{b(n)}},\mathcal{V}^{\theta_{b(n)}})\xrightarrow{\mathcal{D}}(\tilde{U},\tilde{\mathcal{V}})\qquad\text{and}\qquad\Big(\sqrt{|J_{b(n)}|}\widehat{\gamma}^{(b(n)),{\theta_{b(n)}}},\widehat{\mathcal{V}}_{b(n)}^{\theta_{b(n)}}\Big)\xrightarrow{\mathcal{D}}(\tilde{U},\tilde{\mathcal{V}}) in the product space D[0,1]\times D[0,1] endowed with the uniform topology. Since (\tilde{U},\tilde{\mathcal{V}})\in C[0,1]\times\overline{\{\mathcal{V}^{\theta}\colon\theta\in\Theta_{0}\}} takes values in the continuity set of \mathcal{J} by assumption, the classical continuous mapping theorem lets us conclude that \displaystyle\mathcal{J}(U^{\theta_{b(n)}},\mathcal{V}^{\theta_{b(n)}})\xrightarrow{\mathcal{D}}\mathcal{J}(\tilde{U},\tilde{\mathcal{V}})\quad\text{and}\quad\widehat{D}_{b(n)}^{\theta_{b(n)}}=\mathcal{J}\Big(\sqrt{|J_{b(n)}|}\widehat{\gamma}^{(b(n)),{\theta_{b(n)}}},\widehat{\mathcal{V}}_{b(n)}^{\theta_{b(n)}}\Big)\xrightarrow{\mathcal{D}}\mathcal{J}(\tilde{U},\tilde{\mathcal{V}}) as n\to\infty . Now another application of the triangle inequality with \mathcal{J}(\tilde{U},\tilde{\mathcal{V}}) as intermediate value shows that ( 3.A.7 ) holds with k(n)=b(n) , so we are done. ∎ 3.A.10 Proof of Theorem 3.5.1 We will apply Corollary 3.4.7 with the functional \mathcal{J} given by \mathcal{J}(f_{1},f_{2})=\mathbbl{1}(f_{2}\neq 0)\frac{\|f_{1}\|_{\infty}}{\sqrt{|f_{2}(1)|}},\qquad f_{1},f_{2}\in D[0,1]. Under Assumption 3.5.1 , it suffices to check continuity of \mathcal{J} on the set \Upsilon given by \Upsilon\coloneqq C[0,1]\times\{f\in C[0,1]\mid\delta_{1}\leq|f(1)|\}\supset C[0,1]\times\overline{\{\mathcal{V}^{\theta}\colon\theta\in\Theta_{0}\}}. To see that \mathcal{J} is continuous on \Upsilon in the uniform topology, we note that it can be written as a composition of the continuous maps \displaystyle\Upsilon\longrightarrow[0,\infty)\times[\delta_{1},\infty), \displaystyle\qquad(f_{1},f_{2})\mapsto(\|f_{1}\|_{\infty},|f_{2}(1)|), \displaystyle[0,\infty)\times[\delta_{1},\infty)\longrightarrow\mathbb{R}, \displaystyle\qquad(x_{1},x_{2})\mapsto\frac{x_{1}}{\sqrt{x_{2}}}. Thus it follows from Corollary 3.4.7 that \displaystyle\widehat{T}_{n}=\frac{\sqrt{|J_{n}|}\sup_{t\in[0,1]}|\widehat{\gamma}_{t}^{(n)}|}{\sqrt{\widehat{\mathcal{V}}_{n}(1)}}=\mathcal{J}\left(\sqrt{|J_{n}|}\widehat{\gamma}^{(n)},\;\widehat{\mathcal{V}}_{n}\right)\xrightarrow{\scalebox{0.6}{$\mathcal{D}/\Theta_{0}$}}\mathcal{J}(U,\mathcal{V})=\frac{\|U\|_{\infty}}{\mathcal{V}(1)}. With (B_{u}) a Brownian motion it follows by Proposition 3.C.1 that \displaystyle\dfrac{\|U\|_{\infty}}{\sqrt{\mathcal{V}(1)}}\overset{\mathcal{D}}{=}\dfrac{\sup_{0\leq t\leq 1}|B_{\mathcal{V}(t)}|}{\sqrt{\mathcal{V}(1)}}=\dfrac{\sup_{0\leq u\leq\mathcal{V}(1)}|B_{u}|}{\sqrt{\mathcal{V}(1)}}\stackrel{{\scriptstyle\mathcal{D}}}{{=}}\sup_{0\leq t\leq 1}|B_{t}|\stackrel{{\scriptstyle\mathcal{D}}}{{=}}S, (3.A.8) where we have used that \mathcal{V} is continuous and that Brownian motion is scale invariant. This establishes the first part of the theorem. For the second part, we first note that the distribution of S is absolutely continuous with respect to Lebesgue measure, which follows from Equation ( 3.5.31 ). Then we can use Theorem 4.1 of Bengs and Holzmann (2019) to conclude that \limsup_{n\to\infty}\sup_{\theta\in\Theta}|\mathbb{P}(\widehat{T}_{n}\leq z_{1-\alpha})-(1-\alpha)|=0. It follows from the triangle inequality that \displaystyle\limsup_{n\to\infty}\sup_{\theta\in\Theta}\mathbb{P}(\Psi_{n}^{\alpha}=1)=\limsup_{n\to\infty}\sup_{\theta\in\Theta}\mathbb{P}(\widehat{T}_{n}>z_{1-\alpha})\leq\alpha. ∎ 3.A.11 Proof of Theorem 3.5.2 Let 0<\alpha<\beta<1 be given. The second part of Theorem 3.4.5 permits us to choose K>0 sufficiently large such that \displaystyle\limsup_{n\to\infty}\sup_{\theta\in\Theta}\mathbb{P}\left((\sqrt{|J_{n}|}\|\widehat{\gamma}^{(n),\theta}-\gamma^{\theta}\|_{\infty})>K\right)<1-\beta. (3.A.9) We then choose c>K+z_{1-\alpha}\sqrt{1+C(C^{\prime})^{2}} such that for all \theta\in\mathcal{A}_{c,n} , it holds that \displaystyle\sqrt{|J_{n}|}\|\gamma^{\theta}\|_{\infty}-z_{1-\alpha}\sqrt{1+\mathcal{V}^{\theta}(1)}\geq c-z_{1-\alpha}\sqrt{1+C(C^{\prime})^{2}}>K, where we have used Lemma 3.A.2 in the first inequality. The (reverse) triangle inequality now yields that for any \theta\in\mathcal{A}_{c,n} \displaystyle(\Psi_{n}^{\theta}=0)=(\widehat{T}_{n}^{\theta}\leq z_{1-\alpha}) \displaystyle=\left(\|\widehat{\gamma}^{(n),\theta}\|_{\infty}\leq\sqrt{\widehat{\mathcal{V}}_{n}^{\theta}(1)}\frac{z_{1-\alpha}}{\sqrt{|J_{n}|}}\right) \displaystyle\subseteq\left(\|\gamma^{\theta}\|_{\infty}-\left\|\widehat{\gamma}^{(n),\theta}-\gamma^{\theta}\right\|_{\infty}\leq\sqrt{\widehat{\mathcal{V}}_{n}^{\theta}(1)}\frac{z_{1-\alpha}}{\sqrt{|J_{n}|}}\right) \displaystyle\subseteq E_{1}^{(n),\theta}\cup E_{2}^{(n),\theta}, where \displaystyle E_{1}^{(n),\theta} \displaystyle=\left(\sqrt{|J_{n}|}\left\|\widehat{\gamma}^{(n),\theta}-\gamma^{\theta}\right\|_{\infty}>K\right), \displaystyle E_{2}^{(n),\theta} \displaystyle=\left(\widehat{\mathcal{V}}_{n}^{\theta}(1)>1+\mathcal{V}^{\theta}(1)\right)\subseteq\left(|\widehat{\mathcal{V}}_{n}^{\theta}(1)-\mathcal{V}^{\theta}(1)|>1\right). From Proposition 3.4.6 we know that \limsup_{n\to\infty}\sup_{\theta\in\Theta}\mathbb{P}(E_{2}^{(n),\theta})=0 , so from the choice of K we conclude that \displaystyle\limsup_{n\to\infty}\sup_{\theta\in\Theta}\mathbb{P}(\Psi_{n}=0)\leq\limsup_{n\to\infty}\sup_{\theta\in\Theta}\mathbb{P}(E_{1}^{(n),\theta})<1-\beta. The desired statement follows from substituting \mathbb{P}(\Psi_{n}=0)=1-\mathbb{P}(\Psi_{n}=1) into the above equation and simplifying. ∎ 3.A.12 Proof of Theorem 3.5.3 Assume that H_{0} holds and note that Assumptions 3.4.1 and 3.4.2 are satisfied for every sample split J_{n}^{k}\cup(J_{n}^{k})^{c} , k=1,\ldots,K . We consider the decomposition in Equation ( 3.4.17 ) for each sample split J_{n}^{k}\cup(J_{n}^{k})^{c} , and denote the corresponding processes by U^{k,(n)} , R_{1}^{k,(n)} , R_{2}^{k,(n)} , R_{3}^{k,(n)} , D_{1}^{k,(n)} , and D_{2}^{k,(n)} . For each fold k\in\{1,\ldots,K\} , we can then apply the results in Section 3.4 for a single data split: • By Proposition 3.4.2 , we have that U^{k,(n)}\xrightarrow{\scalebox{0.6}{$\mathcal{D}/\Theta$}}U in D[0,1] , where U is a mean zero continuous Gaussian martingale with variance function \mathcal{V} . • By Proposition 3.4.3 , R_{\ell}^{k,(n)}\xrightarrow{\scalebox{0.6}{$P/\Theta$}}0 in (D[0,1],\|\cdot\|_{\infty}) as n\to\infty . • Under H_{0} , the processes D_{1}^{k,(n)} and D_{2}^{k,(n)} are equal to the zero process almost surely. Recall that the folds are assumed to have uniform asymptotic density, which is equivalent to \frac{\sqrt{n}}{\sqrt{K|J_{n}^{k}|}}\to 1 as n\to\infty . Thus we may also conclude that for each fixed k and \ell , \displaystyle\frac{\sqrt{n}}{\sqrt{K|J_{n}^{k}|}}U^{k,(n)}\xrightarrow{\scalebox{0.6}{$\mathcal{D}/\Theta$}}U\quad\text{and}\quad\frac{\sqrt{n}}{K\sqrt{|J_{n}^{k}|}}R_{\ell}^{k,(n)}\xrightarrow{\scalebox{0.6}{$P/\Theta$}}0, where the convergences hold in the Skorokhod and uniform topology, respectively. Now the key observation is that \displaystyle U^{1,(n)}\,\perp\!\!\!\perp\,\cdots\,\perp\!\!\!\perp\,U^{K,(n)}. To see this, note that U^{k,(n)} is constructed from (G_{j},M_{j})_{j\in J^{k}} only, and by the i.i.d. assumption of the data, the collections (G_{j},M_{j})_{j\in J^{1}},\ldots,(G_{j},M_{j})_{j\in J_{n}^{K}} are jointly independent. We can therefore apply Lemma 3.B.10 iteratively to the sequences \frac{\sqrt{n}}{\sqrt{K|J_{n}^{1}|}}U^{1,(n)},\ldots,\frac{\sqrt{n}}{\sqrt{K|J_{n}^{K}|}}U^{K,(n)} to conclude that their sum is uniformly convergent to the sum of K independent copies of U . Using the convolution property of the Gaussian distribution, it therefore follows that \displaystyle\check{U}^{K,(n)}\coloneqq\frac{1}{\sqrt{K}}\sum_{k=1}^{K}\frac{\sqrt{n}}{\sqrt{K|J_{n}^{k}|}}U^{k,(n)}\xrightarrow{\scalebox{0.6}{$\mathcal{D}/\Theta$}}U in D[0,1] as n\to\infty . By the uniform Slutsky theorem formulated in Lemma 3.B.9 , we can therefore conclude that \displaystyle\sqrt{n}\check{\gamma}^{K,(n)}=\check{U}^{K,(n)}+\sum_{k=1}^{K}\frac{\sqrt{n}}{K\sqrt{|J_{n}^{k}|}}\left(R_{1}^{k,(n)}+R_{2}^{k,(n)}+R_{3}^{k,(n)}+D_{1}^{k,(n)}+D_{2}^{k,(n)}\right)\xrightarrow{\scalebox{0.6}{$\mathcal{D}/\Theta_{0}$}}U in D[0,1] as n\to\infty . Note that we use \theta\in\Theta_{0} to ensure that D_{1}^{k,(n)}+D_{2}^{k,(n)} is equal to the zero process almost surely. Since the limit (U^{\theta})_{\theta\in\Theta_{0}} is tight in C[0,1] by Lemma 3.A.11 , Proposition 3.B.7 lets us conclude that \sqrt{n}\|\check{\gamma}^{K,(n)}\|_{\infty}\xrightarrow{\scalebox{0.6}{$\mathcal{D}/\Theta_{0}$}}\|U\|_{\infty} . Consider now the cross-fitted variance estimator at its endpoint \check{\mathcal{V}}_{K,n}(1)=\frac{1}{K}\sum_{k=1}^{K}\frac{1}{|J_{n}^{k}|}\sum_{j\in J_{n}^{k}}\int_{0}^{1}\left(\widehat{G}_{j,s}^{k,(n)}\right)^{2}\mathrm{d}N_{j,s}. From Proposition 3.4.6 , we see that \check{\mathcal{V}}_{K,n}(1) is an average of K variables converging uniformly in probability to \mathcal{V}(1) in the uniform topology. Hence \check{\mathcal{V}}_{K,n}(1) also converges uniformly in probability to \mathcal{V}(1) in the uniform topology. We can then apply Theorem 6.3 of Bengs and Holzmann (2019) , which is a uniform version of Slutsky’s theorem, to conclude that \displaystyle\check{T}_{n}^{K}=\frac{\sqrt{n}\|\check{\gamma}^{K,(n)}\|_{\infty}}{\check{\mathcal{V}}_{K,n}(1)}\xrightarrow{\scalebox{0.6}{$\mathcal{D}/\Theta_{0}$}}\frac{\|U\|_{\infty}}{\mathcal{V}(1)}\stackrel{{\scriptstyle\mathcal{D}}}{{=}}S, as n\to\infty , where last equality in distribution was established in ( 3.A.8 ). Following the second part of the proof of Theorem 3.5.1 , we conclude in the X-LCT has uniform asymptotic level. ∎ 3.B. Uniform stochastic convergence In this section, we discuss weak convergence of random variables with values in a metric space uniformly over a parameter set \Theta . The uniformity over the parameter set can be used, for example, to establish uniform asymptotic level as well as power under local alternatives. The content of this section extends the works of Bengs and Holzmann (2019) and Kasy (2019) , and we especially build upon Appendix B of Lundborg et al. (2022b) , in which uniform stochastic convergence is considered in separable Banach spaces and Hilbert spaces. The space space (D[0,1],\|\cdot\|_{\infty}) of càdlàg functions endowed with the uniform norm is a Banach space, but it is unfortunately not separable. Therefore we extend the notion of uniform stochastic convergence to random variables in metric spaces, with the condition that the limit is supported on a separable set. This allows to consider uniform weak convergence in two important special cases: i) convergence in (D[0,1],\|\cdot\|_{\infty}) towards variables in (C[0,1],\|\cdot\|_{\infty}) , and ii) convergence in D[0,1] endowed with the Skorokhod metric. The Skorokhod space D[0,1] is, if not specified otherwise, equipped with the complete Skorokhod metric d^{\circ} , which makes it a Polish space, i.e., a complete and separable metric space. See for example Section 12 in Billingsley (2013) for a discussion of the Skorokhod space and in particular Equation (12.16) for a definition of d^{\circ} . 3.B.1 Uniform stochastic convergence in metric spaces Throughout this section we consider a background probability space (\Omega,\mathbb{F},\mathbb{P}) and let (\mathbb{D},d_{\mathbb{D}}) denote a generic metric space. We define BL_{1}(\mathbb{D}) as the set of real-valued functions on \mathbb{D} with Lipschitz norm bounded by 1 , that is, functions f\colon\mathbb{D}\to\mathbb{R} with \|f\|_{\infty}\leq 1 and |f(x)-f(y)|\leq d_{\mathbb{D}}(x,y) for every x,y\in\mathbb{D} . Let \mathcal{M}_{1}(\mathbb{D}) denote the set of Borel probability measures on \mathbb{D} . We then define the bounded Lipschitz metric on \mathcal{M}_{1}(\mathbb{D}) by \displaystyle d_{BL}(\mu,\nu)\coloneqq\sup_{f\in BL_{1}(\mathbb{D})}\Big|\int f\mathrm{d}\mu-\int f\mathrm{d}\nu\Big|,\qquad\mu,\nu\in\mathcal{M}_{1}(\mathbb{D}). For any pair (X,Y) of \mathbb{D} -valued random variables we use the shorthand notation \displaystyle d_{BL}(X,Y)=d_{BL}(X(\mathbb{P}),Y(\mathbb{P}))=\sup_{f\in BL_{1}(\mathbb{D})}\lvert\mathbb{E}(f(X)-f(Y))\rvert. If the underlying metric space is ambiguous for d_{BL} , we will specify that it is the bounded Lipschitz metric on \mathcal{M}_{1}(\mathbb{D}) by writing d_{BL(\mathbb{D})} . Our interest in the bounded Lipschitz metric is due to its characterization of weak convergence. Proposition 3.B.1 . Let X,X_{1},X_{2},\ldots be a sequence of \mathbb{D} -valued random variables. Assume that there exists a separable subset \mathbb{D}_{0}\subseteq\mathbb{D} such that \mathbb{P}(X\in\mathbb{D}_{0})=1 . Then the following are equivalent: • The sequence (X_{n})_{n\geq 1} converges in distribution to X , i.e., for all f\in C_{b}(\mathbb{D}) it holds that \mathbb{E}[f(X_{n})]\to\mathbb{E}[f(X)] as n\to\infty . • It holds that d_{BL}(X_{n},X)\to 0 as n\to\infty . Proof. See Theorem 1.12.2, Addendum 1.12.3, and the following discussion in van der Vaart and Wellner (1996) . ∎ To discuss uniform stochastic convergence, we will for the remaining part of this section let \Theta be fixed set, which is used as a (possible) parameter set for every random variable. We say that a collection (X^{\theta})_{\theta\in\Theta} of \mathbb{D} -valued random variables is separable if there exists a separable subset \mathbb{D}_{0}\subseteq\mathbb{D} such that \mathbb{P}(X^{\theta}\in\mathbb{D}_{0})=1 for all \theta\in\Theta . If \mathbb{D} is a separable metric space, then any collection of \mathbb{D} -valued random variables is automatically separable. Now Lemma 3.B.1 justifies the following generalization of weak convergence uniformly over \Theta : Definition 6 . Let (X_{n}^{\theta})_{n\in\mathbb{N},\theta\in\Theta} and (X^{\theta})_{\theta\in\Theta} be collections of \mathbb{D} -valued random variables and assume that (X^{\theta})_{\theta\in\Theta} is separable. We say that: (i) X_{n}^{\theta} converges uniformly in distribution over \Theta to X^{\theta} in \mathbb{D} , and write X_{n}^{\theta}\xrightarrow{\scalebox{0.6}{$\mathcal{D}/\Theta$}}X^{\theta} , if \displaystyle\lim_{n\to\infty}\sup_{\theta\in\Theta}d_{BL(\mathbb{D})}(X_{n}^{\theta},X^{\theta})=0. (ii) X_{n}^{\theta} converges uniformly in probability over \Theta to X^{\theta} in \mathbb{D} , and write X_{n}^{\theta}\xrightarrow{\scalebox{0.6}{$P/\Theta$}}X^{\theta} , if \displaystyle\lim_{n\to\infty}\sup_{\theta\in\Theta}\mathbb{P}(d_{\mathbb{D}}(X_{n}^{\theta},X^{\theta})>\epsilon)=0 for every \epsilon>0 . If for some \mu\in\mathcal{M}_{1}(\mathbb{D}) , it holds that X_{n}^{\theta}\xrightarrow{\scalebox{0.6}{$\mathcal{D}/\Theta$}}X^{\theta} with X^{\theta}(\mathbb{P})=\mu for all \theta\in\Theta , we also write X_{n}^{\theta}\xrightarrow{\scalebox{0.6}{$\mathcal{D}/\Theta$}}\mu . Similarly, we may replace the limit random variable X^{\theta} by a point x\in\mathbb{D} by interpreting x as the constant map (\theta,\omega)\mapsto x for \theta\in\Theta and \omega\in\Omega . Note that if the parameter set \Theta=\{\theta_{0}\} is a singleton, then each type of uniform convergence reduces to the corresponding classical definition of convergence in distribution or probability. If \mathbb{D} is a separable Banach space, we note that Definition 6 coincides with Definition 3 in Lundborg et al. (2022b) . Proposition 3.B.2 . Let (X_{n}^{\theta})_{n\in\mathbb{N},\theta\in\Theta} and (X^{\theta})_{\theta\in\Theta} be collections of \mathbb{D} -valued random variables and assume (X^{\theta})_{\theta\in\Theta} is separable. Then the following are equivalent: a) X_{n}^{\theta}\xrightarrow{\scalebox{0.6}{$\mathcal{D}/\Theta$}}X^{\theta} as n\to\infty . b) For any sequence (\theta_{n})_{n\in\mathbb{N}}\subseteq\Theta it holds that d_{BL}(X_{n}^{\theta_{n}},X^{\theta_{n}})\to 0 as n\to 0 . c) For any sequence (\theta_{n})_{n\in\mathbb{N}}\subseteq\Theta there exists a subsequence (\theta_{k(n)})_{n\in\mathbb{N}} , with k\colon\mathbb{N}\to\mathbb{N} strictly increasing, such that \displaystyle\lim_{k\to\infty}d_{BL}(X_{k(n)}^{\theta_{k(n)}},X^{\theta_{k(n)}})=0. Moreover, X_{n}^{\theta}\xrightarrow{\scalebox{0.6}{$P/\Theta$}}X^{\theta} if and only if for any sequence (\theta_{n})_{n\in\mathbb{N}}\subseteq\Theta and any \epsilon>0 it holds that \displaystyle\lim_{n\to\infty}\mathbb{P}(d_{\mathbb{D}}(X_{n}^{\theta_{n}},X^{\theta_{n}})>\epsilon)=0. Proof. This is essentially Lemma 1 in Kasy (2019) for \mathbb{D} -valued random variables, except that we have added the equivalent condition c). The proof for the characterization of uniform convergence in probability is identical to the one given by Kasy (2019) , so we focus on the equivalence between a), b), and c). To this end, we to prove that a)\implies b)\implies c)\implies a) . The fact that a) implies b) follows directly from applying the bound d_{BL}(X_{n}^{\theta_{n}},X^{\theta_{n}})\leq\sup_{\theta\in\Theta}d_{BL}(X_{n}^{\theta},X^{\theta}) and taking the limit as n\to\infty . We also see that b) implies c) since any sequence is a subsequence of itself. We show that c) implies a) by contraposition. Assume the negation of a), that is, there exists an \epsilon>0 and a sequence (\theta_{n})_{n\in\mathbb{N}}\subseteq\Theta such that \displaystyle d_{BL}(X_{n}^{\theta_{n}},X^{\theta_{n}})>\epsilon for all n\in\mathbb{N} . Then, for all subsequences (\theta_{k(n)}) of (\theta_{n}) , it holds that d_{BL}(X_{k(n)}^{\theta_{k(n)}},X^{\theta_{k(n)}}) does not converge to zero. This implies the negation of c). ∎ Proposition 3.B.2 will allow us to extend many results for classical stochastic convergence to uniform stochastic convergence. Corollary 3.B.3 . Let (X_{n}^{\theta})_{n\in\mathbb{N},\theta\in\Theta} be a collection of \mathbb{D} -valued random variables and let x\in\mathbb{D} . Then X_{n}^{\theta}\xrightarrow{\scalebox{0.6}{$\mathcal{D}/\Theta$}}x if and only if X_{n}^{\theta}\xrightarrow{\scalebox{0.6}{$P/\Theta$}}x . Proof. For any sequence (\theta_{n})_{n\in\mathbb{N}}\subseteq\Theta , recall that X_{n}^{\theta_{n}}\xrightarrow{\mathcal{D}}x if and only if X_{n}^{\theta_{n}}\xrightarrow{P}x , see e.g. Lemma 5.1 in Kallenberg (2021) . Hence the statement follows directly from Proposition 3.B.2 (combined with Proposition 3.B.1 ). ∎ Our goal is to prove uniform versions of Slutsky’s theorem for D[0,1] , Rebolledo’s central limit theorem, and the chaining lemma for stochastic processes. To prove Slutsky’s lemma for D[0,1] , we first prove a general result for metric spaces. Lemma 3.B.4 . Let (X^{\theta},X_{n}^{\theta},Y_{n}^{\theta})_{n\in\mathbb{N},\theta\in\Theta} be a collection of \mathbb{D} -valued random variables and assume that (X^{\theta})_{\theta\in\Theta} is separable. If X_{n}^{\theta}\xrightarrow{\scalebox{0.6}{$\mathcal{D}/\Theta$}}X^{\theta} and d_{\mathbb{D}}(X_{n}^{\theta},Y_{n}^{\theta})\xrightarrow{\scalebox{0.6}{$P/\Theta$}}0 , then it also holds that Y_{n}^{\theta}\xrightarrow{\scalebox{0.6}{$\mathcal{D}/\Theta$}}X^{\theta} . Proof. By the triangle inequality of the bounded Lipschitz metric, we observe that \displaystyle\sup_{\theta\in\Theta}d_{BL}(Y_{n}^{\theta},X^{\theta})\leq\sup_{\theta\in\Theta}d_{BL}(Y_{n}^{\theta},X_{n}^{\theta})+\sup_{\theta\in\Theta}d_{BL}(X_{n}^{\theta},X^{\theta}). The last term converges to zero by the assumption of X_{n}^{\theta}\xrightarrow{\scalebox{0.6}{$\mathcal{D}/\Theta$}}X^{\theta} . For the other term, let \epsilon>0 and use the partition (d_{\mathbb{D}}(X_{n}^{\theta},Y_{n}^{\theta})\leq\epsilon)\cup(d_{\mathbb{D}}(X_{n}^{\theta},Y_{n}^{\theta})>\epsilon) to obtain that \displaystyle d_{BL}(X_{n}^{\theta},Y_{n}^{\theta}) \displaystyle=\sup_{f\in BL_{1}(\mathbb{D})}|\mathbb{E}[f(X_{n}^{\theta})-f(Y_{n}^{\theta})]| \displaystyle\leq\epsilon+\sup_{f\in BL_{1}(\mathbb{D})}\mathbb{E}[|f(X_{n}^{\theta})-f(Y_{n}^{\theta})|\mathbbl{1}(d_{\mathbb{D}}(X_{n}^{\theta},Y_{n}^{\theta})>\epsilon)] \displaystyle\leq\epsilon+\mathbb{P}(d_{\mathbb{D}}(X_{n}^{\theta},Y_{n}^{\theta})>\epsilon). Taking the supremum over \Theta and the limit superior for n\to\infty finishes the proof. ∎ The following formulation of the continuous mapping theorem is analogous to Theorem 1 in Kasy (2019) . The proof is almost identical, but we repeat it here for completeness. Proposition 3.B.5 . Let (\mathbb{D}_{1},d_{1}) and (\mathbb{D}_{2},d_{2}) be metric spaces, and let \Phi\colon\mathbb{D}_{1}\longrightarrow\mathbb{D}_{2} be a Lipschitz continuous map. Let (X_{n}^{\theta})_{n\in\mathbb{N},\theta\in\Theta} and (X^{\theta})_{\theta\in\Theta} be collections of \mathbb{D}_{1} -valued random variables, and assume (X^{\theta})_{\theta\in\Theta} is separable. If X_{n}^{\theta}\xrightarrow{\scalebox{0.6}{$\mathcal{D}/\Theta$}}X^{\theta} in \mathbb{D}_{1} , then \Phi(X_{n}^{\theta})\xrightarrow{\scalebox{0.6}{$\mathcal{D}/\Theta$}}\Phi(X^{\theta}) in \mathbb{D}_{2} . Proof. Note first that if X^{\theta} is in a separable subset \mathbb{D}_{0}\subseteq\mathbb{D}_{1} , then the variables \Phi(X_{\theta}) for \theta\in\Theta are all in the separable subset \Phi(\mathbb{D}_{0})\subseteq\mathbb{D}_{2} . Hence it is well-defined to consider uniform convergence in distribution towards (\Phi(X^{\theta}))_{\theta\in\Theta} . Let f\in BL_{1}(\mathbb{D}_{2}) and let K be the Lipschitz constant of \Phi . Consider the map g\colon\mathbb{D}_{1}\longrightarrow\mathbb{R},\qquad g(x)=\min(1,K^{-1})f(\Phi(x)). Then \|g\|_{\infty}\leq\|f\|_{\infty}\leq 1 and for all x,y\in\mathbb{D}_{1} , \displaystyle|g(x)-g(y)| \displaystyle\leq\min(1,K^{-1})d_{2}(\Phi(x),\Phi(y)) \displaystyle\leq\min(1,K^{-1})Kd_{1}(x,y)\leq d_{1}(x,y) Hence g\in BL_{1}(\mathbb{D}_{1}) . It follows that \displaystyle d_{BL_{1}(\mathbb{D}_{2})}(\Phi(X_{n}^{\theta}),\Phi(X^{\theta})) \displaystyle=\sup_{f\in BL_{1}(\mathbb{D}_{2})}|\mathbb{E}[f(\Phi(X_{n}^{\theta}))-f(\Phi(X^{\theta}))]| \displaystyle\leq\frac{1}{\min(1,K^{-1})}\sup_{g\in BL_{1}(\mathbb{D}_{1})}|\mathbb{E}[g(X_{n}^{\theta})-g(X^{\theta})]| \displaystyle\leq\max(1,K)\cdot d_{BL_{1}(\mathbb{D}_{1})}(X_{n}^{\theta},X^{\theta}) Taking the supremum over \Theta and the limit superior as n\to\infty finish the proof. ∎ We will also need the following two notions of tightness. Definition 7 . Let (\mu^{\theta})_{\theta\in\Theta} be a family of probability measures on \mathbb{D} , and let (X^{\theta})_{\theta\in\Theta} and (X_{n}^{\theta})_{n\in\mathbb{N},\theta\in\Theta} be collections of \mathbb{D} -valued random variables. i) We say that (\mu^{\theta})_{\theta\in\Theta} is tight if for any \varepsilon>0 , there exists a compact set K\subseteq\mathbb{D} such that \sup_{\theta\in\Theta}\mu^{\theta}(K^{c})<\varepsilon . We say that (X^{\theta})_{\theta\in\Theta} is uniformly tight if the collection of distributions (X^{\theta}(\mathbb{P}))_{\theta\in\Theta} is tight. ii) The sequence ((X_{n}^{\theta})_{\theta\in\Theta})_{n\in\mathbb{N}} of collections is said to be sequentially tight if for any sequence (\theta_{n})_{n\in\mathbb{N}}\subset\Theta , the sequence of distributions (X_{n}^{\theta_{n}}(\mathbb{P}))_{n\in\mathbb{N}} is tight. Definition 7 i) is a classical concept, whereas sequential tightness was introduced by Lundborg et al. (2022b) and relaxes uniform tightness for sequences of variables parametrized over an infinite set. The importance of tightness is mainly due to Prokhorov’s theorem ( Kallenberg, 2021 , Theorem 23.2) , which states that if \mathbb{D} is a Polish space 4 4 4 The ‘only if’ part does not require separability nor completeness. , then (\mu^{\theta})_{\theta\in\Theta} is tight if and only if all sequences in (\mu^{\theta})_{\theta\in\Theta} have a weakly convergent subsequence. The continuous mapping theorem in Proposition 3.B.5 is more restrictive than the classical theorem as it requires Lipschitz continuity. However, we also have an alternative version of uniform continuous mapping when the limit variable is tight. Proposition 3.B.6 . Let (\mathbb{D}_{1},d_{1}) and (\mathbb{D}_{2},d_{2}) be Polish spaces, and let (X_{n}^{\theta})_{n\in\mathbb{N},\theta\in\Theta} and (X^{\theta})_{\theta\in\Theta} be collections of \mathbb{D}_{1} -valued random variables. Assume (X^{\theta})_{\theta\in\Theta} is uniformly tight, and let \Phi\colon\mathbb{D}_{1}\longrightarrow\mathbb{D}_{2} be a map that is continuous on the support of (X^{\theta})_{\theta\in\Theta} . If X_{n}^{\theta}\xrightarrow{\scalebox{0.6}{$\mathcal{D}/\Theta$}}X^{\theta} in \mathbb{D}_{1} , then \Phi(X_{n}^{\theta})\xrightarrow{\scalebox{0.6}{$\mathcal{D}/\Theta$}}\Phi(X^{\theta}) in \mathbb{D}_{2} . Proof. Same as the proof of Proposition 10 in Lundborg et al. (2022b) , but with norms of differences replaced by metric distances. ∎ 3.B.2 Uniform stochastic convergence in Skorokhod space In this section we consider the special case where (\mathbb{D},d{D}) is the Skorokhod space (D[0,1],d^{\circ}) . We can also equip D[0,1] with the uniform norm, \|x\|_{\infty}=\sup_{t\in[0,1]}|x_{t}| , and it known that weak convergence based on either \|\cdot\|_{\infty} or d^{\circ} are equivalent when the limit is continuous. We now extend this result to stochastic convergence uniformly over \Theta . Proposition 3.B.7 (Skorokhod equivalence) . Let (X_{n}^{\theta})_{n\in\mathbb{N},\theta\in\Theta} be a collection of D[0,1] -valued random variables and let (X^{\theta})_{\theta\in\Theta} be a uniformly tight collection of C[0,1] -valued random variables. Then X_{n}^{\theta}\xrightarrow{\scalebox{0.6}{$\mathcal{D}/\Theta$}}X^{\theta} in (D[0,1],d^{\circ}) if and only if X_{n}^{\theta}\xrightarrow{\scalebox{0.6}{$\mathcal{D}/\Theta$}}X^{\theta} in (D[0,1],\|\cdot\|_{\infty}) . In the affirmative, \|X_{n}^{\theta}\|_{\infty}\xrightarrow{\scalebox{0.6}{$\mathcal{D}/\Theta$}}\|X\|_{\infty} . Proof. To avoid ambiguity in the topology on D[0,1] , we will throughout this proof use \mathbb{D}^{\circ} to denote the metric space (D[0,1],d^{\circ}) and we use \mathbb{D}_{\infty} to denote the Banach space (D[0,1],\|\cdot\|_{\infty}) . Note also that C[0,1] is separable within \mathbb{D}_{\infty} , so (X^{\theta})_{\theta\in\Theta} is separable, and hence the convergence X_{n}^{\theta}\xrightarrow{\scalebox{0.6}{$\mathcal{D}/\Theta$}}X^{\theta} is well-defined in the non-separable space \mathbb{D}_{\infty} . The ‘if’ part is clear since d^{\circ}(x,y)\leq\|x-y\|_{\infty} for all x,y\in D[0,1] . For the ‘only if’ part, assume that X_{n}^{\theta}\xrightarrow{\scalebox{0.6}{$\mathcal{D}/\Theta$}}X^{\theta} in \mathbb{D}^{\circ} and let (\theta_{n})\subseteq\Theta be an arbitrary sequence. Since (X^{\theta_{n}}(\mathbb{P})) is tight, Prokhorov’s Theorem asserts that there exists a subsequence (\theta_{k(n)}) and a probability distribution \mu on C[0,1] such that X^{\theta_{k(n)}}(\mathbb{P})\xrightarrow{wk}\mu in \mathbb{D}^{\circ} . By the triangle inequality \displaystyle d_{BL(\mathbb{D}^{\circ})}(X_{k(n)}^{\theta_{k(n)}},\mu)\leq d_{BL(\mathbb{D}^{\circ})}(X_{k(n)}^{\theta_{k(n)}},X^{\theta_{k(n)}})+d_{BL(\mathbb{D}^{\circ})}(X^{\theta_{k(n)}},\mu)\to 0,\quad n\to 0. This shows that also X_{k(n)}^{\theta_{k(n)}}(\mathbb{P})\xrightarrow{wk}\mu in \mathbb{D}^{\circ} . Now we can use that weak convergence in the Skorokhod topology and the uniform topology are equivalent when the limit is continuous ( Kallenberg, 2021 , Theorem 23.9 (iii)) . We therefore conclude that the convergences X^{\theta_{k(n)}}(\mathbb{P})\xrightarrow{wk}\mu and X_{k(n)}^{\theta_{k(n)}}(\mathbb{P})\xrightarrow{wk}\mu also hold in \mathbb{D}_{\infty} . But then another use of the triangle inequality shows that d_{BL(\mathbb{D}_{\infty})}(X_{k(n)}^{\theta_{k(n)}},X^{\theta_{k(n)}})\leq d_{BL(\mathbb{D}_{\infty})}(X_{k(n)}^{\theta_{k(n)}},\mu)+d_{BL(\mathbb{D}_{\infty})}(\mu,X^{\theta_{k(n)}})\to 0. Since (\theta_{k(n)}) is a subsequence of the arbitrarily chosen sequence (\theta_{n}) , we conclude that X_{n}^{\theta}\xrightarrow{\scalebox{0.6}{$\mathcal{D}/\Theta$}}X^{\theta} in \mathbb{D}_{\infty} by Proposition 3.B.2 . Finally, as the uniform norm is Lipschitz continuous as a map from \mathbb{D}_{\infty} to \mathbb{R} , the continuous mapping theorem formulated in Proposition 3.B.5 yields that \displaystyle X_{n}^{\theta}\xrightarrow{\scalebox{0.6}{$\mathcal{D}/\Theta$}}X^{\theta}\>\text{ in }\>\mathbb{D}_{\infty}\qquad\implies\qquad\|X_{n}^{\theta}\|_{\infty}\xrightarrow{\scalebox{0.6}{$\mathcal{D}/\Theta$}}\|X\|_{\infty}. This establishes the last part of the lemma. ∎ Using \|\mu\|_{\infty} to denote the pushforward measure for any \mu\in\mathcal{M}_{1}(D([0,1])) we restate the result above for a fixed limit distribution. Corollary 3.B.8 . Let (X_{n}^{\theta})_{n\in\mathbb{N},\theta\in\Theta} be a collection of D[0,1] -valued random variables and let \mu be a probability measure on C[0,1] . Then X_{n}^{\theta}\xrightarrow{\scalebox{0.6}{$\mathcal{D}/\Theta$}}\mu in (D[0,1],d^{\circ}) if and only if X_{n}^{\theta}\xrightarrow{\scalebox{0.6}{$\mathcal{D}/\Theta$}}\mu in (D[0,1],\|\cdot\|_{\infty}) . In the affirmative, \|X_{n}^{\theta}\|_{\infty}\xrightarrow{\scalebox{0.6}{$\mathcal{D}/\Theta$}}\|\mu\|_{\infty} . Proof. Since \mu is a probability measure on the Polish space C[0,1] , it is, in particular, tight ( Billingsley, 2013 , Theorem 1.3) . Hence the statement is a special case of Proposition 3.B.7 . ∎ Now we are ready to prove a uniform version of Slutsky’s theorem in the Skorokhod space. Lemma 3.B.9 (Uniform Slutsky in Skorokhod space) . Let (X^{\theta},X_{n}^{\theta},Y_{n}^{\theta})_{n\in\mathbb{N},\theta\in\Theta} be a collection of D[0,1] -valued random variables such that Y_{n}^{\theta}\xrightarrow{\scalebox{0.6}{$P/\Theta$}}0 and X_{n}^{\theta}\xrightarrow{\scalebox{0.6}{$\mathcal{D}/\Theta$}}X^{\theta} in D[0,1] . Then it holds that X_{n}^{\theta}+Y_{n}^{\theta}\xrightarrow{\scalebox{0.6}{$\mathcal{D}/\Theta$}}X^{\theta} . Proof. Since Y_{n}^{\theta}\xrightarrow{\scalebox{0.6}{$P/\Theta$}}0 , Corollary 3.B.8 implies that \|Y_{n}^{\theta}\|_{\infty}\xrightarrow{\scalebox{0.6}{$\mathcal{D}/\Theta$}}0 , and Corollary 3.B.3 implies that \|Y_{n}^{\theta}\|_{\infty}\xrightarrow{\scalebox{0.6}{$P/\Theta$}}0 . Using the trivial estimate d^{\circ}(x+y,x)\leq\|(x+y)-x\|_{\infty}=\|y\|_{\infty} for x,y\in D[0,1] , it follows that d^{\circ}(X_{n}^{\theta}+Y_{n}^{\theta},X_{n}^{\theta})\xrightarrow{\scalebox{0.6}{$P/\Theta$}}0 . Combining the latter with X_{n}^{\theta}\xrightarrow{\scalebox{0.6}{$\mathcal{D}/\Theta$}}X^{\theta} , the desired conclusion now follows from Lemma 3.B.4 . ∎ We also have a related result for sums of independent sequences. Lemma 3.B.10 . Let (X_{n}^{\theta},Y_{n}^{\theta})_{n\in\mathbb{N},\theta\in\Theta} be a collection of D[0,1] -valued random variables and let (X^{\theta})_{\theta\in\Theta} and (Y^{\theta})_{\theta\in\Theta} be uniformly tight collections of C[0,1] -valued random variables. Assume that X_{n}^{\theta}\xrightarrow{\scalebox{0.6}{$\mathcal{D}/\Theta$}}X^{\theta} and Y_{n}^{\theta}\xrightarrow{\scalebox{0.6}{$\mathcal{D}/\Theta$}}Y^{\theta} in D[0,1] , and that for each \theta\in\Theta and n\in\mathbb{N} , it holds that X_{n}^{\theta}\,\perp\!\!\!\perp\,Y_{n}^{\theta} . Let Z^{\theta} have distribution X^{\theta}(\mathbb{P})*Y^{\theta}(\mathbb{P}) , that is, the same distribution as the sum of two independent copies of each of X^{\theta} and Y^{\theta} . Then it also holds that X_{n}^{\theta}+Y_{n}^{\theta}\xrightarrow{\scalebox{0.6}{$\mathcal{D}/\Theta$}}Z^{\theta} in (D[0,1],\|\cdot\|_{\infty}) . Proof. We may assume without loss of generality that X^{\theta}\,\perp\!\!\!\perp\,Y^{\theta} and that Z^{\theta}=X^{\theta}+Y^{\theta} . Let (\theta_{n})\subseteq\Theta be an arbitrary sequence. By tightness of (X^{\theta})_{\theta\in\Theta} and (Y^{\theta})_{\theta\in\Theta} , we can apply Prokhorov’s theorem twice to obtain probability measures \mu and \nu on C[0,1] , and a subsequence (\theta_{k(n)}) , such that X^{\theta_{k(n)}}(\mathbb{P})\xrightarrow{wk}\mu and Y^{\theta_{k(n)}}(\mathbb{P})\xrightarrow{wk}\nu . Hence the product measures converge, X^{\theta_{k(n)}}(\mathbb{P})\otimes Y^{\theta_{k(n)}}(\mathbb{P})\xrightarrow{wk}\mu\otimes\nu, in C[0,1] as n\to\infty , see, for example, Theorem 2.8 (ii) in Billingsley (2013) . Since X_{n}^{\theta}\xrightarrow{\scalebox{0.6}{$\mathcal{D}/\Theta$}}X^{\theta} in D[0,1] by assumption and (X^{\theta}) is uniformly tight in C[0,1] , Proposition 3.B.7 implies that the convergence also holds in (D[0,1],\|\cdot\|_{\infty}) . The triangle inequality now yields \displaystyle d_{BL}(X_{k(n)}^{\theta_{k(n)}},\mu)\leq d_{BL}(X_{k(n)}^{\theta_{k(n)}},X^{\theta_{k(n)}})+d_{BL}(X^{\theta_{k(n)}},\mu)\to 0, so also X_{k(n)}^{\theta_{k(n)}}(\mathbb{P})\xrightarrow{wk}\mu in (D[0,1],\|\cdot\|_{\infty}) . An analogous computation shows that Y_{k(n)}^{\theta_{k(n)}}(\mathbb{P})\xrightarrow{wk}\nu , and hence also \displaystyle X_{k(n)}^{\theta_{k(n)}}(\mathbb{P})\otimes Y_{k(n)}^{\theta_{k(n)}}(\mathbb{P})\xrightarrow{wk}\mu\otimes\nu in the product space D[0,1]\times D[0,1] endowed with the uniform product topology. From the independence statements X^{\theta}\,\perp\!\!\!\perp\,Y^{\theta} and X_{n}^{\theta}\,\perp\!\!\!\perp\,Y_{n}^{\theta} , we have thus shown that (X^{\theta_{k(n)}},Y^{\theta_{k(n)}})\xrightarrow{\mathcal{D}}\mu\otimes\nu\quad\text{and}\quad(X_{k(n)}^{\theta_{k(n)}},Y_{k(n)}^{\theta_{k(n)}})\xrightarrow{\mathcal{D}}\mu\otimes\nu in the uniform product topology. Since addition +\colon D[0,1]\times D[0,1]\to D[0,1] is continuous with respect to this topology, we conclude by the classical continuous mapping theorem that \displaystyle Z^{\theta_{k(n)}}=X^{\theta_{k(n)}}+Y^{\theta_{k(n)}}\xrightarrow{\mathcal{D}}\mu*\nu\quad\text{and}\quad X_{k(n)}^{\theta_{k(n)}}+Y_{k(n)}^{\theta_{k(n)}}\xrightarrow{\mathcal{D}}\mu*\nu. It now follows that \displaystyle d_{BL} \displaystyle(X_{k(n)}^{\theta_{k(n)}}+Y_{k(n)}^{\theta_{k(n)}},Z^{\theta_{k(n)}}) \displaystyle\leq d_{BL}(X_{k(n)}^{\theta_{k(n)}}+Y_{k(n)}^{\theta_{k(n)}},\mu*\nu)+d_{BL}(\mu*\nu,Z^{\theta_{k(n)}})\to 0. Since (\theta_{k(n)}) is a subsequence of the arbitrarily chosen sequence (\theta_{n}) , we conclude that X_{n}^{\theta}+Y_{n}^{\theta}\xrightarrow{\scalebox{0.6}{$\mathcal{D}/\Theta$}}Z^{\theta} in (D[0,1],\|\cdot\|_{\infty}) by Proposition 3.B.2 . ∎ We also need the following lemma, which is a generalization of the classical result: pointwise convergence of a sequence of monotone functions towards a continuous limit is in fact uniform over compact intervals. Lemma 3.B.11 . Let (X_{n}^{\theta})_{n\in\mathbb{N},\theta\in\Theta} be a collection of D[0,1] -valued random variables with non-decreasing sample paths. Let (f^{\theta})_{\theta\in\Theta}\subset C[0,1] be a uniformly equicontinuous collection of non-decreasing functions. If X_{n}^{\theta}(t)\xrightarrow{\scalebox{0.6}{$P/\Theta$}}f^{\theta}(t) for each t\in[0,1] , then it also holds that \displaystyle\sup_{t\in[0,1]}|X_{n}^{\theta}(t)-f^{\theta}(t)|\xrightarrow{\scalebox{0.6}{$P/\Theta$}}0. Proof. Let \epsilon>0 . By uniform equicontinuity we can find 0=t_{1}<\cdots\epsilon\Big)\leq\sup_{\theta\in\Theta}\mathbb{P}\Big(\max_{i=0,\ldots,k}|X_{n}^{\theta}(t_{i})-f^{\theta}(t_{i})|>\epsilon/2\Big)\longrightarrow 0 as n\to\infty . ∎ The last auxiliary result of this section is an example of Prokhorov’s method of “tightness + identification of limit”. Lemma 3.B.12 . Let (\mathbb{D},d{D}) be either (C[0,1],\|\cdot\|_{\infty}) or (D[0,1],d^{\circ}) , and let (X^{\theta},X_{n}^{\theta})_{n\in\mathbb{N},\theta\in\Theta} be a collection of \mathbb{D} -valued random variables with (X^{\theta})_{\theta\in\Theta} separable. Suppose that • The finite dimensional marginals converge uniformly: for any 0\leq t_{1}<\cdots0 there exists \delta>0 such that \displaystyle\limsup_{n\to\infty}\sup_{\theta\in\Theta}\mathbb{P}\Big(\sup_{s,t\in T\colon d(s,t)\leq\delta}\big|Z_{s}^{(n),\theta}-Z_{t}^{(n),\theta}\big|>\epsilon\Big)<\eta. In Section 2.8.2 of van der Vaart and Wellner (1996) , the same definition is given in the context of empirical processes. Recall that we write, e.g., Z^{(n)} as a shorthand for Z^{(n),\theta} and let the dependency on \theta be implicit for notational ease. We also write \sup_{d(s,t)\leq\delta} as a shorthand for \sup_{s,t\in T\colon d(s,t)\leq\delta} . Definition 8 is a direct extension of pointwise stochastic equicontinuity. Accordingly, Theorem 2.1 from Newey (1991) generalizes as follows: Lemma 3.B.13 . Let (Z_{t}^{(n)})_{t\in T,n\in\mathbb{N}} be a sequence of stochastic processes indexed by a compact metric space T . Assume that (Z_{t}^{(n)}) is stochastically equicontinuous uniformly over \Theta and that for each t\in T it holds that Z_{t}^{(n)}\xrightarrow{\scalebox{0.6}{$P/\Theta$}}0 . Then \sup_{t\in T}|Z_{t}^{(n)}|\xrightarrow{\scalebox{0.6}{$P/\Theta$}}0 as n\to\infty . Proof. Let \varepsilon,\eta>0 be given, and let \delta>0 be the corresponding distance obtained from the uniform stochastic equicontinuity of (Z^{(n)}) . By compactness of T there exists a finite set T^{*}\subseteq T such that T=\bigcup_{t\in T^{*}}B(t,\delta) . By the triangle inequality we get that \displaystyle\sup_{t\in T}|Z_{t}^{(n)}|=\sup_{t\in T^{*}}\sup_{s\in B(t,\delta)}|Z_{s}^{(n)}|\leq\sup_{t\in T^{*}}|Z_{t}^{(n)}|+\sup_{t\in T^{*}}\sup_{s\in B(t,\delta)}|Z_{s}^{(n)}-Z_{t}^{(n)}|. Since T^{*} is finite, it follows that \sup_{t\in T^{*}}|Z_{t}^{(n)}|\xrightarrow{\scalebox{0.6}{$P/\Theta$}}0 , which combined with the inequality implies that \displaystyle\limsup_{n\to\infty}\sup_{\theta\in\Theta}\mathbb{P}\big(\sup_{t\in T}|Z_{t}^{(n)}|>2\varepsilon\big) \displaystyle\leq 0+\limsup_{n\to\infty}\sup_{\theta\in\Theta}\mathbb{P}\Big(\sup_{t\in T^{*}}\sup_{s\in B(t,\delta)}|Z_{t}^{(n)}-Z_{t}^{(n)}|>\varepsilon\Big)\leq\eta. As \varepsilon,\eta>0 were chosen arbitrarily, we conclude that \sup_{t\in T}|Z_{t}^{(n)}|\xrightarrow{\scalebox{0.6}{$P/\Theta$}}0 . ∎ To establish uniform stochastic equicontinuity we extend the chaining lemma to a uniform setting. To formulate the theorem we first need some classical definitions related to chaining. Definition 9 . Let T be a compact metric space. A subset T^{*}\subseteq T is called a \delta -net if \bigcup_{t\in T^{*}}B(t,\delta)=T . The covering number N(\delta)=N(\delta,T)\coloneqq\min\{\,|T^{*}|\colon T^{*}\subseteq T,T^{*}\text{ is a }\delta\text{-net}\,\} is the smallest possible cardinality of a \delta -net, which is finite by compactness. The associated covering integral is \displaystyle J(\delta)=\int_{0}^{\delta}\left(2\log(N(\epsilon)/\epsilon)\right)^{\frac{1}{2}}\mathrm{d}\epsilon,\qquad 0\leq\delta\leq 1. Lemma 3.B.14 . Let (T,d) be a metric space with finite covering integral J(\cdot) and let (Z_{t}^{\theta})_{t\in T,\theta\in\Theta} be a collection of stochastic processes indexed by T with continuous sample paths. Assume there is a uniform constant \varsigma>0 such that, for all s,t\in T and \eta>0 , \displaystyle\sup_{\theta\in\Theta}\mathbb{P}\left(|Z_{s}^{\theta}-Z_{t}^{\theta}|>\eta\cdot d(s,t)\right)\leq 2e^{-\frac{\eta^{2}}{2\varsigma^{2}}}. Then, for all 0<\epsilon<1 , \displaystyle\sup_{\theta\in\Theta}\mathbb{P}\Big(\sup_{d(s,t)\leq\epsilon}|Z_{s}^{\theta}-Z_{t}^{\theta}|>26\varsigma J(\epsilon)\Big)\leq 2\epsilon. Proof. The lemma is a direct consequence of classical chaining lemma ( Pollard, 1984 , page 144) . For each \theta\in\Theta , the conditions of the chaining lemma are met for (Z_{t}^{\theta})_{t\in T} with sub-exponential factor \varsigma . This implies, in particular, that for any \theta\in\Theta and 0<\epsilon<1 , \displaystyle\mathbb{P}\Big(\sup_{d(s,t)\leq\epsilon}|Z_{s}^{\theta}-Z_{t}^{\theta}|>26\varsigma J(\epsilon)\Big)\leq 2\epsilon, which is equivalent to the conclusion of the lemma. ∎ This immediately implies the following corollary. Corollary 3.B.15 . Let (T,d) be a metric space with finite covering integral J(\cdot) and let (Z^{(n),\theta}) be a sequence of stochastic processes on T with continuous sample paths. Assume there exists a constant \varsigma>0 such that, for all s,t\in T and \eta>0 and n\in\mathbb{N} , \displaystyle\sup_{\theta\in\Theta}\mathbb{P}\left(|Z_{s}^{(n),\theta}-Z_{t}^{(n),\theta}|>\eta\cdot d(s,t)\right)\leq 2e^{-\frac{\eta^{2}}{2\varsigma^{2}}}. Then (Z^{(n)}) is stochastically equicontinuous uniformly over \Theta . For stochastic processes with continuous sample paths, stochastic equicontinuity turns out to be equivalent to sequential tightness (Definition 7 ii)). Proposition 3.B.16 . Let (Z^{(n),\theta})_{n\in\mathbb{N},\theta\in\Theta} be a collection of C[0,1] -valued random variables such that \mathbb{P}(Z_{0}^{(n),\theta}=0)=1 all n\in\mathbb{N} and \theta\in\Theta . The following are equivalent: 1. (Z^{(n),\theta}) is stochastically equicontinuous uniformly over \Theta . 2. (Z^{(n),\theta}) is sequentially tight. Proof. The equivalence is a straightforward application of Theorem 7.3 in Billingsley (2013) . Condition (i) of the aforementioned theorem is satisfied for any sequence of measures from the collection (Z^{(n),\theta}(\mathbb{P}))_{n\in\mathbb{N},\theta\in\Theta} , since Z_{0}^{(n),\theta}=0 almost surely for all n and \theta . For any sequence (\theta_{n})\subseteq\Theta , stochastic equicontinuity uniformly over \Theta implies condition (ii) of Theorem 7.3 in Billingsley (2013) for the measures ((Z^{(n),\theta_{n}})(\mathbb{P})) . We therefore conclude that stochastic equicontinuity uniformly over \Theta implies sequential tightness. On the contrary, assume that (Z^{(n),\theta}) is sequentially tight and let \epsilon,\eta>0 be given. For each n , choose \theta_{n} such that \displaystyle\sup_{\theta\in\Theta}\mathbb{P}\Big(\sup_{|s-t|\leq\delta}\big|Z_{s}^{(n),\theta}-Z_{t}^{(n),\theta}\big|\geq\epsilon\Big)\leq\mathbb{P}\Big(\sup_{|s-t|\leq\delta}\big|Z_{s}^{(n),\theta_{n}}-Z_{t}^{(n),\theta_{n}}\big|\geq\epsilon\Big)+\frac{1}{n}. Since ((Z^{(n),\theta_{n}})(\mathbb{P})) is tight by assumption, condition (ii) of Theorem 7.3 asserts that there exists \delta,N>0 such that \mathbb{P}\Big(\sup_{|s-t|\leq\delta}\big|Z_{s}^{(n),\theta_{n}}-Z_{t}^{(n),\theta_{n}}\big|\geq\epsilon\Big)<\eta for n\geq N . Combining both inequalities and taking the limit superior finish the proof. ∎ 3.C. The Functional Martingale CLT In this section we state Rebolledo’s martingale CLT ( Rebolledo, 1980 ) based on its formulation in Andersen et al. (1993) , and then we extend the result to a uniform version without fixed variance functions. The one-dimensional case suffices for our purpose, so for simplicity, every local martingale in the following is a real-valued stochastic process. For a local square integrable martingale (M_{t}) , we let \langle M\rangle(t) denote its quadratic characteristic. The theorem requires a condition on the jumps of the local martingales, for which we will need the following definition. Definition 10 . Let M_{t} be a local square integrable \mathcal{F}_{t} -martingale. For any \varepsilon>0 , we define \langle M_{\varepsilon}\rangle(t) to be the quadratic characteristic of the pure jump-process given by t\mapsto\sum_{0\leq s\leq t}M_{s}\mathbbl{1}(|\Delta M_{s}|>\varepsilon). We also need a representation of Gaussian martingales, which ensures their continuity. Proposition 3.C.1 . Let (B_{t})_{t\in[0,\infty)} be a Brownian motion on [0,\infty) with continuous sample paths. For every non-decreasing f\in C[0,1] , the process (B_{f(t)})_{t\in[0,1]} is a continuous mean zero Gaussian martingale on [0,1] with variance function f . Consequently, if U=(U_{t})_{t\in[0,1]} is a mean zero Gaussian martingale with a continuous variance function V , then U has the distributional representation (U_{t})_{t\in[0,1]}\stackrel{{\scriptstyle\mathcal{D}}}{{=}}(B_{V(t)})_{t\in[0,1]}. (3.C.1) Proof. Let f\in C[0,1] be non-decreasing. From the properties of Brownian motion, it follows directly that the time-transformed process (B_{f(t)})_{t\in[0,1]} is a mean zero Gaussian process with variance function f . Since f is continuous, each sample path t\mapsto B_{f(t)} is a composition of continuous functions and thus continuous itself. Since f is non-decreasing, the time-transformation also preserves the martingale property. This establishes the first part. For the second part, recall that the covariance function of a martingale is determined by its variance function. Hence the first part implies that the right-hand side in ( 3.C.1 ) is a Gaussian process with the same mean and covariance structure as the left-hand side. Since the distribution of a Gaussian processes is uniquely determined by its mean and covariance structure, the equality in distribution follows. ∎ Proposition 3.C.1 is a simple, distributional variant of the Dubins-Schwarz theorem, see Revuz and Yor (2013) , Chapter V, Theorems 1.6 and 1.7. The Dubins-Schwarz theorem implies that, in fact, U_{t}=B_{V(t)} for t\in[0,1] , where B is a Brownian motion on [0,V(1)] . For the purpose of this work we only need the simpler, distributional equality ( 3.C.1 ). We can now formulate Rebolledo’s CLT for local martingales. To this end, note that Proposition 3.C.1 ensures the existence of the continuous Gaussian limit martingale U when the variance function V is continuous. Theorem 3.C.2 (Rebolledo’s CLT) . Let (U^{(n)})_{n\in\mathbb{N}} be a sequence a local square integrable martingales in D[0,1] , possibly defined on different sample spaces and with different filtrations for each n\in\mathbb{N} . Let U be a continuous Gaussian martingale with continuous variance function V\colon[0,1]\to[0,\infty) , and assume that U^{(n)}_{0}=U_{0}=0 . Suppose that for every t\in[0,1] and \varepsilon>0 , \displaystyle\langle U^{(n)}\rangle(t)\xrightarrow{P}V(t)\qquad\text{ and }\qquad\langle U_{\varepsilon}^{(n)}\rangle(t)\xrightarrow{P}0, as n\to\infty . Then it holds that U^{(n)}\xrightarrow{\mathcal{D}}U in D[0,1] as n\to\infty . Proof. This is a special case of Theorem \mathrm{II}.5.2 in Andersen et al. (1993) . ∎ The general formulation of Rebolledo’s CLT above, which allows for n -dependent sample spaces and filtrations, can now be leveraged to obtain a uniform version via the sequential characterization of uniform stochastic convergence. Theorem 3.C.3 (Uniform Rebolledo CLT) . For each n\in\mathbb{N} and \theta\in\Theta : • Let \mathcal{F}^{(n),\theta}=(\mathcal{F}_{t}^{(n),\theta})_{t\in[0,1]} be a filtration satisfying the usual conditions. • Let U_{t}^{(n),\theta} be a local square integrable \mathcal{F}_{t}^{(n),\theta} -martingale in D[0,1] with U_{0}^{(n),\theta}=0 . • Let V^{\theta}\colon[0,1]\to[0,\infty) be a non-decreasing function with V^{\theta}(0)=0 . Assume that (V^{\theta})_{\theta\in\Theta} is uniformly equicontinuous and that \sup_{\theta\in\Theta}V^{\theta}(1)<\infty . Assume further that for every \varepsilon>0 and t\in[0,1] , \displaystyle\langle U^{(n),\theta}\rangle(t)\xrightarrow{\scalebox{0.6}{$P/\Theta$}}V^{\theta}(t)\qquad\text{ and }\qquad\langle U_{\varepsilon}^{(n),\theta}\rangle(t)\xrightarrow{\scalebox{0.6}{$P/\Theta$}}0, (3.C.2) as n\to\infty . Then it holds that \displaystyle U^{(n),\theta}\xrightarrow{\scalebox{0.6}{$\mathcal{D}/\Theta$}}U^{\theta},\qquad n\to\infty, in D[0,1] uniformly over \Theta , where for each \theta\in\Theta , U^{\theta} is a mean zero continuous Gaussian martingale on [0,1] with variance function V^{\theta} . Proof. We will use the characterization of uniform convergence as stated in Proposition 3.B.2 c). To this end, let (\theta_{n})\subseteq\Theta be an arbitrary sequence. By assumption (V_{\theta_{n}})_{n\in\mathbb{N}} is a uniformly equicontinuous and bounded sequence of functions on a compact interval, so the Arzelà–Ascoli theorem states that there exists a subsequence \theta_{k(n)} , with k\colon\mathbb{N}\to\mathbb{N} strictly increasing, and a function \tilde{V}\in C[0,1] such that \sup_{t\in[0,1]}|V^{\theta_{k(n)}}(t)-\tilde{V}(t)|\longrightarrow 0,\qquad n\to\infty. Since each function V^{\theta_{k(n)}} is non-decreasing, it follows that \tilde{V} is non-decreasing. It also holds that \tilde{V}(0)=\lim_{n\to\infty}V^{\theta_{k(n)}}(0)=0 , and therefore \tilde{V} is the variance function of a continuous Gaussian martingale \tilde{U} with \tilde{U}_{0}=0 . By assumption of the convergences in ( 3.C.2 ), we may conclude that \displaystyle|\langle U^{(k(n)),\theta_{k(n)}}\rangle(t)-\tilde{V}(t)|\leq\underbrace{|\langle U^{(k(n)),\theta_{k(n)}}\rangle(t)-V^{\theta_{k(n)}}(t)|}_{\xrightarrow{P}0}+\underbrace{|V^{\theta_{k(n)}}(t)-\tilde{V}(t)|}_{\to 0}\xrightarrow{P}0 and that \langle U_{\epsilon}^{(k(n)),\theta_{k(n)}}\rangle(t)\to 0 as n\to\infty . Thus we have established the conditions of the classical Rebolledo CLT – Theorem 3.C.2 – for the sequence U^{(k(n)),\theta_{k(n)}} and the Gaussian martingale \tilde{U} with variance function \tilde{V} . We therefore conclude that \displaystyle U^{(k(n)),\theta_{k(n)}}\xrightarrow{\mathcal{D}}\tilde{U} in D[0,1] as n\to\infty . We now establish that the sequence (U^{\theta_{k(n)}}) also converges in distribution to \tilde{U} in C[0,1] , and in particular also in D[0,1] . To this end, we use the characterization of convergence in distribution in C[0,1] from Theorem 7.5 in Billingsley (2013) , which states that we need to show that 1. For all 0\leq t_{1}<\cdots0 \displaystyle\lim_{\delta\to 0^{+}}\limsup_{n\to\infty}\mathbb{P}\Big(\sup_{|t-s|<\delta}|U_{t}^{\theta_{k(n)}}-U_{s}^{\theta_{k(n)}}|>\epsilon\Big)=0. The first condition is clear since all the marginals are multivariate Gaussian, and the mean and variance of the sequence converges to the mean and variance of the limit distribution. The second condition follows from the same computation as in the proof of Lemma 3.A.11 . By Theorem 7.5 in Billingsley (2013) we therefore conclude that \displaystyle U^{\theta_{k(n)}}\xrightarrow{\mathcal{D}}\tilde{U},\qquad\text{for}\>\>n\to\infty, in C[0,1] , and hence also in D[0,1] . We can now apply the triangle inequality for the bounded Lipschitz metric to conclude that \displaystyle d_{BL}(U^{(k(n)),\theta_{k(n)}},U^{\theta_{k(n)}})\leq d_{BL}(U^{(k(n)),\theta_{k(n)}},\tilde{U})+d_{BL}(\tilde{U},U^{\theta_{k(n)}})\longrightarrow 0. Since (\theta_{n})\subseteq\Theta was an arbitrary sequence, we conclude that U^{(n),\theta}\xrightarrow{\scalebox{0.6}{$\mathcal{D}/\Theta$}}U^{\theta} by Proposition 3.B.2 . ∎ The following proposition gives explicit expressions for the quadratic characteristics that appear in Rebolledo’s CLT in the special case where the local martingales are given as stochastic integrals with respect to a compensated counting processes. Proposition 3.C.4 . Let N_{1},\ldots,N_{n} be counting processes and assume that for each j=1,\ldots,n , N_{j} has an absolutely continuous \mathcal{F}_{t}^{(n)} -compensator \Lambda_{j,t} such that M_{j,t}=N_{j,t}-\Lambda_{j,t} is a locally square integrable \mathcal{F}_{t}^{(n)} -martingale. Let H_{1},\ldots,H_{n} be locally bounded \mathcal{F}_{t}^{(n)} -predictable processes, and define the process U_{t}^{(n)}=\sum_{j=1}^{n}\int_{0}^{t}H_{j,s}\mathrm{d}M_{j,s} . Then U_{t}^{(n)} is a local square integrable \mathcal{F}_{t}^{(n)} -martingale, and for any t,\epsilon>0 it holds that \displaystyle\langle U^{(n)}\rangle(t) \displaystyle=\sum_{j=1}^{n}\int_{0}^{t}H_{j,s}^{2}\mathrm{d}\Lambda_{j,s}, \displaystyle\langle U_{\epsilon}^{(n)}\rangle(t) \displaystyle=\sum_{j=1}^{n}\int_{0}^{t}H_{j,s}^{2}\mathbbl{1}(|H_{j,s}|\geq\epsilon)\mathrm{d}\Lambda_{j,s}. Proof. See the discussion following Theorem \mathrm{II}.5.2 in Andersen et al. (1993) , in particular equations (2.5.6) and (2.5.8) . ∎ 3.D. Estimation of \lambda and G The asymptotic theory for estimation of the LCM crucially relies on \widehat{\lambda}^{(n)} and \widehat{G}^{(n)} being consistent, and more importantly, having a product error decaying at an n^{-1/2} -rate. Therefore, a central question when applying the test, is how to model \lambda and G . In principle, we could use parametric models to learn \widehat{\lambda}^{(n)} and \widehat{G}^{(n)} , and under such models it should be possible to achieve n^{-1/2} -rates. For example, if we consider a parametrization (t,\theta)\mapsto\lambda_{t}(\theta) which is \kappa(t) -Lipschitz in \theta\in\Theta\subseteq\mathbb{R}^{p} for each t , then \displaystyle h(n)^{2}=E\left(\int_{0}^{1}(\lambda_{t}(\theta_{0})-\lambda_{t}(\widehat{\theta}^{(n)}))^{2}\mathrm{d}t\right)\leq\|\kappa\|_{L_{2}([0,1])}^{2}E\|\theta_{0}-\widehat{\theta}^{(n)}\|_{\mathbb{R}^{p}}^{2}. Thus the rates from parametric asymptotic theory can be converted to rates for g and h . However, it is of greater interest if sufficient rates can be achieved with nonparametric estimators. Below we give concrete examples of nonparametric models and discuss which rates are achievable. For simplicity, we focus on the case where \mathcal{F}_{t}=\mathcal{F}_{t}^{N,Z} and where G_{t}=X_{t}-\Pi_{t} as in the introductory example. 3.D.1 Nonparametric functional estimation of \Pi As seen in Section 3.6.1 , assumptions on the form of \Pi turn the general estimation problem into a concrete problem of estimating a function. If the system is Markovian, it can be reasonable to assume a functional concurrent model . The model asserts that \Pi_{t}=\mu(t,Z_{t}) for a bivariate function \mu , and a survey of methods for estimating \mu is given by Maity (2017) . Notably, Jiang and Wang (2011) achieve an n^{-1/3} -rate of g(n) under certain regularity and moment assumptions, see their Theorem 3.3. That result also holds if Z is replaced by a linear predictor \beta^{T}\mathbf{Z} of several covariates. Consider again the historical linear regression model from Section 3.6.1 , and assume that the effect of Z on X is homogeneous over time. That is, \rho_{X}(s,t)=\tilde{\rho}_{X}(t-s) for some function \tilde{\rho}_{X} . This submodel is known as the functional convolution model , since \Pi can be written as the convolution of Z and \tilde{\rho}_{X} . Applying the Fourier transform converts it into a (complex) linear concurrent model, so by Plancherel’s theorem one can leverage the convergence rates from the concurrent model. Manrique (2016, Theorem 16) uses this idea to transfer the n^{-1/4} -rate of the functional ridge regression estimator ( Manrique et al., 2018 ) to the convolution model, which holds under modest moment conditions on the data. With additional distributional assumptions, we conjecture that faster rate results for the linear concurrent model can also be leveraged to the convolution model. Şentürk and Müller (2010) consider a similar model under the assumption that \rho_{X}(s,t)=\mathbbl{1}(t-\Delta\leq s\leq t)\tilde{\rho}_{X}^{1}(t)\tilde{\rho}_{X}^{2}(t-s), for two functions \tilde{\rho}_{X}^{1} and \tilde{\rho}_{X}^{2} and a lag \Delta>0 . They establish a pointwise rate result for the response curve, but it is not obvious how to cast their result as a polynomial rate for g(n) . For the full historical functional linear model we are not aware of any published rate results. Yuan and Cai (2010) ; Cai and Yuan (2012) establish rates on the prediction error for scalar-on-function regression, and Yao et al. (2005) establish various rates for function-on-function regression, but in a non-historical setting. Based on the former, we give a heuristic for which rates are achievable for g(n) in this model. If \widehat{\Pi} is based on a kernel estimate \widehat{\rho}_{X}^{(n)} of \rho_{X} , then Tonelli’s theorem yields \displaystyle g(n)^{2}={\left|\kern-1.07639pt\left|\kern-1.07639pt\left|\Pi-\widehat{\Pi}^{(n)}\right|\kern-1.07639pt\right|\kern-1.07639pt\right|}_{2}^{2} \displaystyle=\mathbb{E}\left(\int_{0}^{1}\left(\int_{0}^{t}(\rho_{X}(s,t)-\widehat{\rho}_{X}^{(n)}(s,t))Z_{s}\mathrm{d}s\right)^{2}\mathrm{d}t\right) \displaystyle=\int_{0}^{1}\mathbb{E}\left(\left(\int_{0}^{t}(\rho_{X}(s,t)-\widehat{\rho}_{X}^{(n)}(s,t))Z_{s}\mathrm{d}s\right)^{2}\right)\mathrm{d}t. Theorem 4 in Cai and Yuan (2012) asserts that we, under certain regularity conditions, can estimate \rho_{X}(\cdot,t) such that \mathbb{E}\left(\left(\int_{0}^{t}(\rho_{X}(s,t)-\widehat{\rho}_{X}^{(n)}(s,t))Z_{s}\mathrm{d}s\right)^{2}\right) decays at a n^{-2r_{t}/(2r_{t}+1)} -rate for a fixed t . Here r_{t} is a constant describing the eigenvalue decay of a certain operator related to the autocovariance of Z and the regularity of \rho_{X} . As a concrete example, if Z is a Wiener process and \rho_{X}(\cdot,t)\in\mathcal{W}_{2}^{m}([0,t]) is in the m -th Sobolev space for each t>0 , then r_{t}=1+m and g(n) will converge at an n^{-(1+m)/(2m+3)} -rate, see the discussion after Corollary 8 in Yuan and Cai (2010) . Based on these arguments, we believe that the desired n^{-(1/4+\varepsilon)} -rate for g(n) is achievable with suitable regularity assumptions on Z and \rho_{X} . 3.D.2 Estimation of \lambda Within the framework of the Cox model, Wells (1994) demonstrate that the baseline intensity can be estimated with rate n^{-2/5} using a standard kernel smoothing technique. With the parametric n^{-1/2} -rate on the remaining parameters, this translates readily into h(n)=O(n^{-2/5}) . We suspect that the same rate should also be attainable in a sparse setting with high-dimensional covariates, for example by applying the smoothing approach of Wells (1994) to the baseline hazard estimators of e.g. Fang et al. (2017) and Hou et al. (2023) . Hiabu et al. (2021) consider the more general multiplicative intensity model with \lambda_{t}=\mathbbl{1}(T\geq t)f(t,Z_{t})) , where f has a multiplicative structure over its arguments. They introduce an estimator with optimal rate h(n)=n^{-2/(5+d)} , where d is the dimension of Z . For d>3 , we therefore need faster rates on g(n) in order for the LCT to maintain type I error control. Omitting the multiplicative structure on f , Bender et al. (2020) propose a general framework for nonparametric estimation of Markovian intensities. They survey existing methods such as gradient boosted trees and neural networks and relate them to this setting. Based on real and synthetic data, they find that both gradient boosted trees and neural networks outperform the Cox model in terms of predictive performance as measured by the Brier score. In essence, the framework relies on discretizing time and approximating the intensity with successive Poisson regressions. Using the same idea, Rytgaard et al. (2021) argue that h(n)=o(n^{-1/4}) can be achieved for time-independent covariates. Similarly, Rytgaard et al. (2022) mention that h(n)=o(n^{-1/4}) can be achieved for estimation of intensities in a multivariate point process with a uniformly bounded number of events, which we place into a general modeling framework below. 3.D.3 Estimation of \lambda and \Pi for counting processes In Sections 3.2 and 3.4 we considered the setup where N was a counting process adapted to a filtration \mathcal{F}_{t} , which could contain information on baseline covariates and covariate processes that were not necessarily counting processes. In this section we explore how our testing framework can be applied when all stochastic processes of interest are counting processes. More specifically, let (N_{t}^{d})_{d\in[p]} be a p -dimensional counting process. For a,b\in[p] and C\subset[p]\setminus\{b\} with a\neq b and a\in C we are interested in testing the hypothesis that N^{a} is conditionally locally independent of N^{b} given the filtration, \mathcal{F}^{C}_{t} , generated by N^{C}=(N^{d})_{d\in C} . We can cast this setup in the framework of Section 3.2 as follows. Naturally, we let N=N^{a} and \mathcal{F}_{t}=\mathcal{F}^{C}_{t} . The auxiliary process X is chosen to be càglàd and predictable with respect to the filtration, \mathcal{F}^{b}_{t} , generated by N^{b} . For example, we could choose X_{t}=N^{b}_{t-} . But X_{t} could be any functional of N^{b} such as X_{t}=f(N_{t-}^{b}) for a suitable function f or a linear filter of N^{b} , \displaystyle X_{t}=\int_{0}^{t-}\kappa(t-s)\mathrm{d}N_{s}^{b}, where \kappa is a suitable kernel function, see also Section 3.3.1 . In principle, the process X could also depend on the process N^{C} , but it is important that the filtration, \mathcal{G}_{t} , generated by \mathcal{F}_{t} and X_{t} is strictly larger than \mathcal{F}_{t} , i.e., X_{t} should depend on N^{b} , in order to get a non-trivial test as explained in Section 3.2 . In the framework of counting processes, we can approach the estimation of both \lambda and \Pi in a unified and general way as follows: Let (\tau_{j},z_{j})_{j\geq 1} be the marked point process associated with the counting process N^{C} , i.e., (\tau_{j})_{j\geq 1} is a sequence of almost surely strictly increasing event times located at the jumps of N^{C} , and (z_{j})_{j\geq 1} for z_{j}\in C are the corresponding event types. Since both \lambda_{t} and \Pi_{t} are real-valued and \mathcal{F}^{C}_{t-} -measurable for each fixed t\geq 0 , they can be represented as measurable functions of \{(\tau_{j},z_{j})\mid\tau_{j}\Big|\> \displaystyle t\mapsto h_{t}((z_{s})_{s0.4), \displaystyle A_{\text{cos}}\colon \displaystyle\rho_{0}(t)=7\cdot\cos(4\pi\cdot t). The idea behind the alternative A_{\text{step}} is that the LCM should be increasing on [0,0.4] and decreasing on (0.4,1] . Figure 3.G.2 shows sample paths of \check{\gamma}^{K,(n)} for data simulated under each of the alternatives \rho_{0}=5 , A_{\text{step}} and A_{\text{cos}} . The figure illustrates that t\mapsto|\check{\gamma}_{t}^{K,(n)}| is, indeed, mostly maximal towards t=1 for the alternative \rho_{0}=5 , but not for the time-varying alternatives A_{\text{step}} and A_{\text{cos}} . With the same sampling scheme for (X,Y,Z) as in Section 3.6.2 , we conducted an analogous experiment with 400 runs for each setting. Figure 3.G.4 shows the rejection rates for the two tests. Under the hypothesis of conditional local independence, the left plot in Figure 3.G.4 shows that the endpoint test behaves similarly to \check{\Psi}_{n}^{K} as expected. Both tests have power against the local alternatives, but for A_{\text{step}} the power does not seem to stabilize before n=2000 . This is different from the previous settings, and can be explained by a slower convergence of the intensity estimator due to the more complex dependency on X . For both of the local alternatives, we observe that \check{\Psi}_{n}^{K} is more powerful than the endpoint test, with the difference being largest for A_{\text{step}} . In conclusion, these results show that the supremum test dominates the endpoint test in certain situations. Figure 3.G.4 : The plots show the average rejection rate of the double machine learning tests based on the supremum statistic (blue) and the endpoint statistic (red). Chapter 4 Efficient adjustment for complex covariates: Gaining efficiency with DOPE Alexander Mangulad Christgau and Niels Richard Hansen 4.1 Introduction Estimating the population average treatment effect (ATE) of a treatment on an outcome variable is a fundamental statistical task. A naive approach is to contrast the mean outcome of a treated population with the mean outcome of an untreated population. Using observational data this is, however, generally a flawed approach due to confounding. If the underlying confounding mechanisms are captured by a set of pre-treatment covariates \mathbf{W} , it is possible to adjust for confounding by conditioning on \mathbf{W} in a certain manner. Given that multiple subsets of \mathbf{W} may be valid for this adjustment, it is natural to ask if there is an ‘optimal adjustment subset’ that enables the most efficient estimation of the ATE. Assuming a causal linear graphical model, Henckel et al. (2022) established the existence of – and gave graphical criteria for – an optimal adjustment set for the OLS estimator. Rotnitzky and Smucler (2020) extended the results of Henckel et al. (2022) , by proving that the optimality was valid within general causal graphical models and for all regular and asymptotically linear estimators. Critically, this line of research assumes knowledge of the underlying graphical structure. To accommodate the assumption of no unmeasured confounding , observational data is often collected with as many covariates as possible, which means that \mathbf{W} can be high-dimensional. In such cases, assumptions of a known graph are unrealistic, and graphical estimation methods are statistically unreliable ( Uhler et al., 2013 ; Shah and Peters, 2020 ; Chickering et al., 2004 ) . Furthermore, for non-Euclidean data such as images or texts, it is not clear how to impose any graphical structure pertaining to causal relations. Nevertheless, we can in these cases still imagine that the information that \mathbf{W} represents can be separated into distinct components that affect treatment and outcome directly, as illustrated in Figure 4.1.1 . T Treatment Y Outcome \mathbf{W} \mathbf{C}_{1} \mathbf{C}_{2} \mathbf{C}_{3} Figure 4.1.1 : The covariate \mathbf{W} can have a complex data structure, even if the information it represents is structured and can be categorized into components that influence treatment and outcome separately. In this paper, we formalize this idea and formulate a novel and general adjustment theory with a focus on efficiency bounds for the estimation of the average treatment effect. Based on the adjustment theory, we propose a general estimation procedure and analyze its asymptotic behavior. 4.1.1 Setup Throughout we consider a discrete treatment variable T\in\mathbb{T} , a square-integrable outcome variable Y\in\real , and pre-treatment covariates \mathbf{W}\in\mathbb{W} . For now we only require that \mathbb{T} is a finite set and that \mathbb{W} is a measurable space. The joint distribution of (T,\mathbf{W},Y) is denoted by P and it is assumed to belong to a collection of probability measures \mathcal{P} . If we need to make the joint distribution explicit, we denote expectations and probabilities with \mathbb{E}_{P} and \mathbb{P}_{P} , respectively, but usually the P is omitted for ease of notation. Our model-free target parameters of interest are of the form \displaystyle\chi_{t}\coloneq\mathbb{E}[\mathbb{E}[Y\,|\,T=t,\mathbf{W}]]=\mathbb{E}\left[\frac{\mathbbl{1}(T=t)Y}{\mathbb{P}(T=t\,|\,\mathbf{W})}\right],\qquad t\in\mathbb{T}. (4.1.1) In words, these are treatment specific means of the outcome when adjusting for the covariate \mathbf{W} . To ensure that this quantity is well-defined, we assume the following condition, commonly known as positivity . Assumption 4.1.1 (Positivity) . It holds that 0<\mathbb{P}(T=t\,|\,\mathbf{W})<1 almost surely for each t\in\mathbb{T} . Under additional assumptions common in causal inference literature – which informally entail that \mathbf{W} captures all confounding – the target parameter \chi_{t} has the interpretation as the interventional mean , which is expressed by \mathbb{E}[Y\,|\,\mathrm{do}(T=t)] in do-notation or by \mathbb{E}[Y^{t}] using potential outcome notation ( Peters et al., 2017 ; van der Laan and Rose, 2011 ) . Under such causal assumptions, the average treatment effect is identified, and when \mathbb{T}=\{0,1\} it is typically expressed as the contrast \chi_{1}-\chi_{0} . The theory in this paper is agnostic with regards to whether or not \chi_{t} has this causal interpretation, although it is the primary motivation for considering \chi_{t} as a target parameter. Given n i.i.d. observations of (T,\mathbf{W},Y) , one may proceed to estimate \chi_{t} by estimating either of the equivalent expressions for \chi_{t} in Equation ( 4.1.1 ). Within parametric models, the outcome regression function g(t,\mathbf{w})=\mathbb{E}[Y\,|\,T=t,\mathbf{W}=\mathbf{w}] can typically be estimated with a \sqrt{n} -rate. In this case, the sample mean of the estimated regression function yields a \sqrt{n} -consistent estimator of \chi_{t} under Donsker class conditions or sample splitting. However, many contemporary datasets indicate that parametric model-based regression methods get outperformed by nonparametric methods such as boosting and neural networks ( Bojer and Meldgaard, 2021 ) . Nonparametric estimators of the regression function typically converge at rates slower than \sqrt{n} , and likewise for estimators of the propensity score m(t\mid\mathbf{w})=\mathbb{P}(T=t\,|\,\mathbf{W}=\mathbf{w}). Even if both nonparametric estimators have rates slower than \sqrt{n} , it is in some cases possible to achieve a \sqrt{n} -rate of \chi_{t} by modeling both m and g , and then combining their estimates in a way that achieves ‘rate double robustness’ ( Smucler et al., 2019 ) . That is, an estimation error of the same order as the product of the errors for m and g . Two prominent estimators that have this property are the Augmented Inverse Probability Weighted estimator (AIPW) and the Targeted Minimum Loss-based Estimator (TMLE) ( Robins and Rotnitzky, 1995 ; Chernozhukov et al., 2018 ; van der Laan and Rose, 2011 ) . In what follows, the premise is that even with a \sqrt{n} -rate estimator of \chi_{t} , it might still be intractable to model m – and possibly also g – as a function of \mathbf{W} directly. This can happen for primarily two reasons: (i) the sample space \mathbb{W} is high-dimensional or has a complex structure, or (ii) the covariate is highly predictive of treatment, leading to unstable predictions of the inverse propensity score \mathbb{P}(T=t\,|\,\mathbf{W})^{-1} . In either of these cases, which are not exclusive, we can try to manage these difficulties by instead working with a representation \mathbf{Z}=\varphi(\mathbf{W}) , given by a measurable mapping \varphi from \mathbb{W} into a more tractable space such as d . In the first case above, such a representation might be a pre-trained word embedding, e.g., the celebrated BERT and its offsprings ( Devlin et al., 2018 ) . The second case has been well-studied in the special case where \mathbb{W}=\real^{k} and where \mathcal{P} contains the distributions that are consistent with respect to a fixed DAG (or CPDAG). We develop a general theory that subsumes both cases, and we discuss how to represent the original covariates to efficiently estimate the adjusted mean \chi_{t} . 4.1.2 Relations to existing literature Various studies have explored the adjustment for complex data structures by utilizing a (deep) representation of the covariates, as demonstrated in works such as Shi et al. (2019) ; Veitch et al. (2020) . In a different research direction, the Collaborative TMLE ( van der Laan and Gruber, 2010 ) has emerged as a robust method for estimating average treatment effects by collaboratively learning the outcome regression and propensity score, particularly in scenarios where covariates are highly predictive of treatment ( Ju et al., 2019 ) . Our overall estimation approach shares similarities with the mentioned strategies; for instance, our proof-of-concept estimator in the experimental section employs neural networks with shared layers. However, unlike the cited works, it incorporates the concept of efficiently tuning the representation specifically for predicting outcomes, rather than treatment. Related to this idea is another interesting line of research, which builds upon the outcome adapted lasso proposed by Shortreed and Ertefaie (2017) . Such works include Ju et al. (2020) ; Benkeser et al. (2020) ; Greenewald et al. (2021) ; Baldé et al. (2023) . These works all share the common theme of proposing estimation procedures that select covariates based on L_{1} -penalized regression onto the outcome, and then subsequently estimate the propensity score based on the selected covariates adapted to the outcome. The theory of this paper generalizes the particular estimators proposed in the previous works, and also allows for other feature selection methods than L_{1} -penalization. Moreover, our generalization of (parts of) the efficient adjustment theory from Rotnitzky and Smucler (2020) allows us to theoretically quantify the efficiency gains from these estimation methods. Finally, our asymptotic theory considers a novel regime, which, according to the simulations, seems more adequate for describing the finite sample behavior than the asymptotic results of Benkeser et al. (2020) and Ju et al. (2020) . Our general adjustment results in Section 4.3 draw on the vast literature on classical adjustment and confounder selection, for example Rosenbaum and Rubin (1983) ; Hahn (1998) ; Henckel et al. (2022) ; Rotnitzky and Smucler (2020) ; Guo et al. (2022) ; Perković et al. (2018) ; Peters et al. (2017) ; Forré and Mooij (2023) . In particular, two of our results are direct extensions of results from Rotnitzky and Smucler (2020) ; Henckel et al. (2022) . 4.1.3 Organization of the paper In Section 4.2 we discuss generalizations of classical adjustment concepts to abstract conditioning on information. In Section 4.3 we discuss information bounds in the framework of Section 4.2 . In Section 4.4 we propose a novel method, the DOPE, for efficient estimation of adjusted means, and we discuss the asymptotic behavior of the resulting estimator. In Section 4.5 we implement the DOPE and demonstrate its performance on synthetic and real data. The paper is concluded by a discussion in Section 4.6 . 4.2 Generalized adjustment concepts In this section we discuss generalizations of classical adjustment concepts. These generalizations are motivated by the premise from the introduction: it might be intractable to model the propensity score directly as a function of \mathbf{W} , so instead we consider adjusting for a representation \mathbf{Z}=\varphi(\mathbf{W}) . This is, in theory, confined to statements about conditioning on \mathbf{Z} , and is therefore equivalent to adjusting for any representation of the form \widetilde{\mathbf{Z}}=\psi\circ\varphi(\mathbf{W}) , where \psi is a bijective and bimeasureable mapping. The equivalence class of such representations is characterized by the \sigma -algebra generated by \mathbf{Z} , denoted by \sigma(\mathbf{Z}) , which informally describes the information contained in \mathbf{Z} . In view of this, we define adjustment with respect to sub- \sigma -algebras contained in \sigma(\mathbf{W}) . Remark 1 . Conditional expectations and probabilities are, unless otherwise indicated, defined conditionally on \sigma -algebras as in Kolmogoroff (1933) , see also Kallenberg (2021, Ch. 8) . Equalities between conditional expectations are understood to hold almost surely. When conditioning on the random variable T and a \sigma -algebra \mathcal{Z} we write ‘ \,|\,T,\mathcal{Z} ’ as a shorthand for ‘ \,|\,\sigma(T)\vee\mathcal{Z} ’. Finally, we define conditioning on both the event (T=t) and on a \sigma -algebra \mathcal{Z}\subseteq\sigma(\mathbf{W}) by \mathbb{E}[Y\,|\,T=t,\mathcal{Z}]\coloneq\frac{\mathbb{E}[Y\mathbbl{1}(T=t)\,|\,\mathcal{Z}]}{\mathbb{P}(T=t\,|\,\mathcal{Z})}, which is well-defined under Assumption 4.1.1 . Definition 1 . A sub- \sigma -algebra \mathcal{Z}\subseteq\sigma(\mathbf{W}) is called a description of \mathbf{W} . For each t\in\mathbb{T} and P\in\mathcal{P} , and with \mathcal{Z} a description of \mathbf{W} , we define \displaystyle\pi_{t}(\mathcal{Z};P) \displaystyle\coloneq\mathbb{P}_{P}(T=t\,|\,\mathcal{Z}), \displaystyle b_{t}(\mathcal{Z};P) \displaystyle\coloneq\mathbb{E}_{P}[Y\,|\,T=t,\mathcal{Z}], \displaystyle\chi_{t}(\mathcal{Z};P) \displaystyle\coloneq\mathbb{E}_{P}[b_{t}(\mathcal{Z};P)]=\mathbb{E}_{P}[\pi_{t}(\mathcal{Z};P)^{-1}\mathbbl{1}(T=t)Y]. If a description \mathcal{Z} of \mathbf{W} is given as \mathcal{Z}=\sigma(\mathbf{Z}) for a representation \mathbf{Z}=\varphi(\mathbf{W}) , we may write \chi_{t}(\mathbf{Z};P) instead of \chi_{t}(\sigma(\mathbf{Z});P) etc. We say that \mathcal{Z} is P -valid if: \displaystyle\qquad\chi_{t}(\mathcal{Z};P)=\chi_{t}(\mathbf{W};P), \displaystyle\text{ for all }t\in\mathbb{T}, \mathcal{Z} is P -OMS if: \displaystyle\qquad b_{t}(\mathcal{Z};P)=b_{t}(\mathbf{W};P), \displaystyle\text{ for all }t\in\mathbb{T}, \mathcal{Z} is P -ODS if: \displaystyle\qquad Y\,{\perp\!\!\!\perp}_{P}\,\mathbf{W}\,|\,T,\mathcal{Z}. Here OMS means Outcome Mean Sufficient and ODS means Outcome Distribution Sufficient . If \mathcal{Z} is P -valid for all P\in\mathcal{P} , we say that it is \mathcal{P} -valid. We define \mathcal{P} -OMS and \mathcal{P} -ODS analogously. A few remarks are in order. • We have implicitly extended the shorthand notation described in Remark 1 to the quantities in Definition 1 . • The quantity \chi_{t}(\mathcal{Z};P) is deterministic, whereas \pi_{t}(\mathcal{Z};P) and b_{t}(\mathcal{Z};P) are \mathcal{Z} -measurable real valued random variables. Thus, if \mathcal{Z} is generated by a representation \mathbf{Z} , then by the Doob-Dynkin lemma ( Kallenberg, 2021 , Lemma 1.14) these random variables can be expressed as functions of \mathbf{Z} . This fact does not play a role until the discussion of estimation in Section 4.4 . • There are examples of descriptions \mathcal{Z}\subseteq\sigma(\mathbf{W}) that are not given by representations. Such descriptions might be of little practical importance, but our results do not require \mathcal{Z} to be given by a representation. We view the \sigma -algebraic framework as a convenient abstraction that generalizes equivalence classes of representations. • We have the following hierarchy of the properties in Definition 1 : \displaystyle P\textnormal{-ODS}\Longrightarrow P\textnormal{-OMS}\Longrightarrow P\textnormal{-valid}, and the relations also hold if P is replaced by \mathcal{P} . • The P -ODS condition relates to existing concepts in statistics. The condition can be viewed as a \sigma -algebraic analogue of prognostic scores ( Hansen, 2008 ) , and it holds that any prognostic score generates a P -ODS description. Moreover, if a description \mathcal{Z}=\sigma(\mathbf{Z}) is P -ODS, then its generator \mathbf{Z} is c -equivalent to \mathbf{W} in the sense of Pearl (2009) , see in particular the claim following his Equation (11.8). In Remark 5 we discuss the relations between \mathcal{P} -ODS descriptions and classical statistical sufficiency. The notion of \mathcal{P} -valid descriptions can be viewed as a generalization of valid adjustment sets, where subsets are replaced with sub- \sigma -algebras. Example 1 (Comparison with adjustment sets in causal DAGs) . Suppose \mathbf{W}\in\real^{k} and let \mathcal{D} be a DAG on the nodes \mathbf{V}=(T,\mathbf{W},Y) . Let \mathcal{P}=\mathcal{M}(\mathcal{D}) be the collection of continuous distributions (on k+2 ) that are Markovian with respect to \mathcal{D} and with \mathbb{E}|Y|<\infty . Any subset \mathbf{Z}\subseteq\mathbf{W} is a representation of \mathbf{W} given by a coordinate projection, and the corresponding \sigma -algebra \sigma(\mathbf{Z}) is a description of \mathbf{W} . In this framework, a subset \mathbf{Z}\subseteq\mathbf{W} is called a valid adjustment set for (T,Y) if for all P\in\mathcal{P} , t\in\mathbb{T} , and y\in\real \displaystyle\mathbb{E}_{P}\left[\frac{\mathbbl{1}(T=t)\mathbbl{1}(Y\leq y)}{\mathbb{P}_{P}(T=t\,|\,\mathrm{pa}_{\mathcal{D}}(T))}\right]=\mathbb{E}_{P}[\mathbb{P}_{P}(Y\leq y\,|\,T=t,\mathbf{Z})], where \mathrm{pa}_{\mathcal{D}} denotes the parents T in \mathcal{D} , see for example Definition 2 in Rotnitzky and Smucler (2020) . It turns out that \mathbf{Z} is a valid adjustment set if and only if \displaystyle\mathbb{E}_{P}\left[\frac{\mathbbl{1}(T=t)Y}{\mathbb{P}_{P}(T=t\,|\,\mathrm{pa}_{\mathcal{D}}(T))}\right]=\mathbb{E}_{P}[\mathbb{E}_{P}[Y\,|\,T=t,\mathbf{Z}]]=\chi_{t}(\mathcal{Z};P) for all P\in\mathcal{P} and t\in\mathbb{T} . This follows 5 5 5 We thank Leonard Henckel for pointing this out. from results of Perković et al. (2018) , which we discuss for completeness in Proposition 4.A.1 in the supplement. Thus, if we assume that \mathbf{W} is a valid adjustment set, then any subset \mathbf{Z}\subseteq\mathbf{W} is a valid adjustment set if and only if the corresponding description \sigma(\mathbf{Z}) is \mathcal{P} -valid. In general, \mathcal{P} -valid descriptions are not necessarily generated from valid adjustment sets. This can happen if structural assumptions are imposed on the conditional mean, which is illustrated in the following example. Example 2 . Suppose that the outcome regression is known to be invariant under rotations of \mathbf{W}\in\real^{k} such that for any P\in\mathcal{P} , \displaystyle\mathbb{E}_{P}[Y\,|\,T,\mathbf{W}]=\mathbb{E}_{P}[Y\,|\,T,\|\mathbf{W}\|\,]\eqcolon g_{P}(T,\|\mathbf{W}\|). Without further graphical assumptions, we cannot deduce that any proper subset of \mathbf{W} is a valid adjustment set. In contrast, the magnitude \|\mathbf{W}\| generates a \mathcal{P} -OMS – and hence also \mathcal{P} -valid – description of \mathbf{W} by definition. Suppose that there is a distribution \tilde{P}\in\mathcal{P} for which g_{\tilde{P}}(t,\cdot) is bijective. Then \sigma(\|\mathbf{W}\|) is also the smallest \mathcal{P} -OMS description up to \mathbb{P}_{\tilde{P}} -negligible sets: if \mathcal{Z} is another \mathcal{P} -OMS description, we see that b_{t}(\mathcal{Z};\tilde{P})=b_{t}(\mathbf{W};\tilde{P})=g_{\tilde{P}}(t,\|\mathbf{W}\|) almost surely. Hence \sigma(\|\mathbf{W}\|)=\sigma(g_{\tilde{P}}(t,\|\mathbf{W}\|))\subseteq\mkern 2.0mu\overline{\mkern-2.0mu\sigma(b_{t}(\mathcal{Z};\tilde{P}))\mkern 0.0mu}\mkern 0.0mu\subseteq\mkern 2.0mu\overline{\mkern-2.0mu\mathcal{Z}\mkern 0.0mu}\mkern 0.0mu, where overline denotes the \mathbb{P}_{\tilde{P}} -completion of a \sigma -algebra. That is, \mkern 2.0mu\overline{\mkern-2.0mu\mathcal{Z}\mkern 0.0mu}\mkern 0.0mu is the smallest \sigma -algebra containing \mathcal{Z} and all its \mathbb{P}_{\tilde{P}} -negligible sets. Even in the above example, where the regression function is known to depend on a one-dimensional function of \mathbf{W} , it is generally not possible to estimate the regression function at a \sqrt{n} -rate without restrictive assumptions. Thus, modeling of the propensity score is required in order to obtain a \sqrt{n} -rate estimator of the adjusted mean. If \mathbf{W} is highly predictive of treatment, then naively applying a doubly robust estimator (AIPW, TMLE) can be statistically unstable due to large inverse propensity weights. Alternatively, since \sigma(\|\mathbf{W}\|) is a \mathcal{P} -valid description, we could also base our estimator on the pruned propensity \mathbb{P}(T=t\,|\,\|\mathbf{W}\|) . This approach should intuitively provide more stable weights, as we expect \|\mathbf{W}\| to be less predictive of treatment. We proceed to analyze the difference between the asymptotic efficiencies of the two approaches and we show that, under reasonable conditions, the latter approach is never worse asymptotically. 4.3 Efficiency bounds for adjusted means We now discuss efficiency bounds based on the concepts introduced in Section 4.2 . To this end, let \mathbf{Z}=\varphi(\mathbf{W}) be a representation of \mathbf{W} . Under a sufficiently dense model \mathcal{P} , the influence function for \chi_{t}(\mathbf{Z};P) is given by \psi_{t}(\mathbf{Z};P)=b_{t}(\mathbf{Z};P)+\frac{\mathbbl{1}(T=t)}{\pi_{t}(\mathbf{Z};P)}(Y-b_{t}(\mathbf{Z};P))-\chi_{t}(\mathbf{Z};P). (4.3.2) The condition that \mathcal{P} is sufficiently dense entails that no ‘structural assumptions’ are imposed on the functional forms of \pi_{t} and b_{t} , see also Robins et al. (1994) ; Robins and Rotnitzky (1995) ; Hahn (1998) . Structural assumptions do not include smoothness conditions, but do include, for example, parametric model assumptions on the outcome regression. Using the formalism of Section 4.2 , we define \psi_{t}(\mathcal{Z};P) analogously to ( 4.3.2 ) for any description \mathcal{Z} of \mathbf{W} . We denote the variance of the influence function by \displaystyle\mathbb{V}_{t}(\mathcal{Z};P) \displaystyle\coloneq\var_{P}[\psi_{t}(\mathcal{Z};P)] \displaystyle=\mathbb{E}_{P}\left[\frac{\var_{P}(Y\,|\,T=t,\mathcal{Z})}{\pi_{t}(\mathcal{Z};P)}\right]+\var_{P}(b_{t}(\mathcal{Z};P)). (4.3.3) The importance of this variance was highlighted by Hahn (1998) , who computed \mathbb{V}_{t}(\mathbf{W};P) as the semiparametric efficiency bound for regular asymptotically linear (RAL) estimators of \chi_{t}(\mathbf{W};P) . That is, for any \mathcal{P} -consistent RAL estimator \widehat{\chi}_{t}(\mathbf{W};P) based on n i.i.d. observations, the asymptotic variance of \sqrt{n}(\widehat{\chi}_{t}(\mathbf{W};P)-\chi_{t}(\mathbf{W};P)) is bounded below by \mathbb{V}_{t}(\mathbf{W};P) , provided that \mathcal{P} does not impose structural assumptions on \pi_{t}(\mathbf{W}) and b_{t}(\mathbf{W}) . Moreover, the asymptotic variance of both the TMLE and AIPW estimators achieve this lower bound when the propensity score and outcome regression can be estimated with sufficiently fast rates ( Chernozhukov et al., 2018 ; van der Laan and Rose, 2011 ) . Since the same result can be applied for the representation \mathbf{Z}=\varphi(\mathbf{W}) , we see that estimation of \chi_{t}(\mathbf{Z};P) has a semiparametric efficiency bound of \mathbb{V}_{t}(\mathbf{Z};P) . Now suppose that \sigma(\mathbf{Z}) is a \mathcal{P} -valid description of \mathbf{W} , which means that \chi_{t}\coloneq\chi_{t}(\mathbf{W};P)=\chi_{t}(\mathbf{Z};P) for all P . It is then natural to ask if we should estimate \chi_{t} based on \mathbf{W} or the representation \mathbf{Z} ? We proceed to investigate this question based on which of the efficiency bounds \mathbb{V}_{t}(\mathbf{Z};P) or \mathbb{V}_{t}(\mathbf{W};P) is smallest. If \mathbb{V}_{t}(\mathbf{Z};P) is smaller than \mathbb{V}_{t}(\mathbf{W};P) , then \mathbb{V}_{t}(\mathbf{W};P) is not an actual efficiency bound for \chi_{t}(\mathbf{W};P) . This does not contradict the result of Hahn (1998) , as we have assumed the existence of a non-trivial \mathcal{P} -valid description of \mathbf{W} , which implicitly imposes structural assumptions on the functional form of b_{t}(\mathbf{W}) . Nevertheless, it is sensible to compare the variances \mathbb{V}_{t}(\mathbf{Z};P) and \mathbb{V}_{t}(\mathbf{W};P) , as these are the asymptotic variances of the AIPW when using either \mathbf{Z} or \mathbf{W} , respectively, as a basis for the nuisance functions. We formulate our efficiency bounds in terms of the more general contrast parameter \Delta=\Delta(\mathbf{W};P)=\sum_{t\in\mathbb{T}}c_{t}\chi_{t}(\mathbf{W};P), (4.3.4) where \mathbf{c}\coloneq(c_{t})_{t\in\mathbb{T}} are fixed real-valued coefficients. The prototypical example, when \mathbb{T}=\{0,1\} , is \Delta=\chi_{1}-\chi_{0} , which is the average treatment effect under causal assumptions, cf. the discussion following Assumption 4.1.1 . Note that the family of \Delta -parameters includes the adjusted mean \chi_{t} as a special case. To estimate \Delta , we consider estimators of the form \widehat{\Delta}(\mathcal{Z};P)=\sum_{t\in\mathbb{T}}c_{t}\widehat{\chi}_{t}(\mathcal{Z};P), (4.3.5) where \widehat{\chi}_{t}(\mathcal{Z};P) denotes a consistent RAL estimator of \chi_{t}(\mathcal{Z};P) . Correspondingly, the efficiency bound for such an estimator is \mathbb{V}_{\!\Delta}(\mathcal{Z};P)\coloneq\var_{P}\Big(\sum_{t\in\mathbb{T}}c_{t}\psi_{t}(\mathcal{Z};P)\Big). (4.3.6) It turns out that two central results by Rotnitzky and Smucler (2020) , specifically their Lemmas 4 and 5, can be generalized from covariate subsets to descriptions. One conceptual difference is that there is a priori no natural generalization of precision variables and overadjustment (instrumental) variables . To wit, if \mathcal{Z}_{1} and \mathcal{Z}_{2} are descriptions, there is no canonical way 6 6 6 equivalent conditions to the existence of an independent complement are given in Proposition 4 in Émery and Schachermayer (2001) . to subtract \mathcal{Z}_{2} from \mathcal{Z}_{1} in a way that maintains their join \mathcal{Z}_{1}\vee\mathcal{Z}_{2}\coloneq\sigma(\mathcal{Z}_{1},\mathcal{Z}_{2}) . Apart from this technical detail, the proofs translate more or less directly. The following lemma is a direct extension of Rotnitzky and Smucler (2020, Lemma 4) . Lemma 4.3.1 (Deletion of overadjustment) . Fix a distribution P\in\mathcal{P} and let \mathcal{Z}_{1}\subseteq\mathcal{Z}_{2} be \sigma -algebras such that Y\,{\perp\!\!\!\perp}_{P}\,\mathcal{Z}_{2}\,|\,T,\mathcal{Z}_{1} . Then it always holds that \mathbb{V}_{\!\Delta}(\mathcal{Z}_{2};P)-\mathbb{V}_{\!\Delta}(\mathcal{Z}_{1};P)=\sum_{t\in\mathbb{T}}c_{t}^{2}D_{t}(\mathcal{Z}_{1},\mathcal{Z}_{2};P)\geq 0, where for each t\in\mathbb{T} , \displaystyle D_{t} \displaystyle(\mathcal{Z}_{1},\mathcal{Z}_{2};P)\coloneq\mathbb{V}_{t}(\mathcal{Z}_{2};P)-\mathbb{V}_{t}(\mathcal{Z}_{1};P) \displaystyle=\mathbb{E}_{P}\,\Big[\pi_{t}(\mathcal{Z}_{1};P)\var(Y\,|\,T=t,\mathcal{Z}_{1})\var\big(\pi_{t}(\mathcal{Z}_{2};P)^{-1}\big|\;T=t,\mathcal{Z}_{1}\big)\Big]. Moreover, if \mathcal{Z}_{2} is a description of \mathbf{W} then \mathcal{Z}_{1} is P -valid if and only if \mathcal{Z}_{2} is P -valid. The lemma quantifies the efficiency lost in adjustment when adding information that is irrelevant for the outcome. We proceed to apply this lemma to the minimal information in \mathbf{W} that is predictive of Y conditionally on T . To define this information, we use the regular conditional distribution function of Y given T=t,\mathbf{W}=\mathbf{w} , which we denote by \displaystyle F(y\,|\,t,\mathbf{w};P)\coloneq\mathbb{P}_{P}(Y\leq y\,|\,T=t,\mathbf{W}=\mathbf{w}),\qquad y\in\real,t\in\mathbb{T},\mathbf{w}\in\mathbb{W}. See Kallenberg (2021, Sec. 8) for a rigorous treatment of regular conditional distributions. We will in the following, by convention, take b_{t}(\mathbf{w};P)=\int y\,\mathrm{d}F(y\,|\,t,\mathbf{w};P), (4.3.7) so that b_{t}(\mathbf{W};P) is given in terms of the regular conditional distribution. Definition 2 . Define the \sigma -algebras \displaystyle\mathcal{Q} \displaystyle\coloneq\bigvee_{P\in\mathcal{P}}\mathcal{Q}_{P},\qquad\mathcal{Q}_{P}\coloneq\sigma(F(y\,|\,t,\mathbf{W};P);\,y\in\real,t\in\mathbb{T}), \displaystyle\mathcal{R} \displaystyle\coloneq\bigvee_{P\in\mathcal{P}}\mathcal{R}_{P},\qquad\mathcal{R}_{P}\coloneq\sigma(b_{t}(\mathbf{W};P);\,t\in\mathbb{T}). T Treatment \mathcal{Q} \mathbf{W} Y Outcome Figure 4.3.2 : The \sigma -algebra \mathcal{Q} given in Definition 2 as a description of \mathbf{W} . Note that \mathcal{Q}_{P} , \mathcal{Q} , \mathcal{R}_{P} and \mathcal{R} are all descriptions of \mathbf{W} , see Figure 4.3.2 for a depiction of the information contained in \mathcal{Q} . Note also that \mathcal{R}_{P}\subseteq\mathcal{Q}_{P} by the convention ( 4.3.7 ). We now state one of the main results of this section. Theorem 4.3.2 . Fix P\in\mathcal{P} . Then, under Assumption 4.1.1 , it holds that (i) If \mathcal{Z} is a description of \mathbf{W} and \mathcal{Q}_{P}\subseteq\mkern 2.0mu\overline{\mkern-2.0mu\mathcal{Z}\mkern 0.0mu}\mkern 0.0mu , then \mathcal{Z} is P -ODS. In particular, \mathcal{Q}_{P} is a P -ODS description of \mathbf{W} . (ii) If \mathcal{Z} is P -ODS description, then \mathcal{Q}_{P}\subseteq\mkern 2.0mu\overline{\mkern-2.0mu\mathcal{Z}\mkern 0.0mu}\mkern 0.0mu . (iii) For any P -ODS description \mathcal{Z} it holds that \mathbb{V}_{\!\Delta}(\mathcal{Z};P)-\mathbb{V}_{\!\Delta}(\mathcal{Q}_{P};P)=\sum_{t\in\mathbb{T}}c_{t}^{2}D_{t}(\mathcal{Q}_{P},\mathcal{Z};P)\geq 0, (4.3.8) where D_{t} is given as in Lemma 4.3.1 . Together parts (i) and (ii) state that a description of \mathbf{W} is P -ODS if and only if its \mathbb{P}_{P} -completion contains \mathcal{Q}_{P} . Part (iii) states that, under P\in\mathcal{P} , \mathcal{Q}_{P} leads to the optimal efficiency bound among all P -ODS descriptions. In the following corollary we use \mkern 2.0mu\overline{\mkern-2.0mu\mathcal{Z}\mkern 0.0mu}\mkern 0.0mu^{P} to denote the \mathbb{P}_{P} -completion of a \sigma -algebra \mathcal{Z} . Corollary 4.3.3 . Let \mathcal{Z} be a description of \mathbf{W} . Then \mathcal{Z} is \mathcal{P} -ODS if and only if \mathcal{Q}_{P}\subseteq\mkern 2.0mu\overline{\mkern-2.0mu\mathcal{Z}\mkern 0.0mu}\mkern 0.0mu^{P} for all P\in\mathcal{P} . A sufficient condition for \mathcal{Z} to be \mathcal{P} -ODS is that \mathcal{Q}\subseteq\mkern 2.0mu\overline{\mkern-2.0mu\mathcal{Z}\mkern 0.0mu}\mkern 0.0mu^{P} for all P\in\mathcal{P} , in which case \mathbb{V}_{\!\Delta}(\mathcal{Z};P)-\mathbb{V}_{\!\Delta}(\mathcal{Q};P)=\sum_{t\in\mathbb{T}}c_{t}^{2}D_{t}(\mathcal{Q},\mathcal{Z};P)\geq 0,\qquad P\in\mathcal{P}. (4.3.9) In particular, \mathcal{Q} is a \mathcal{P} -ODS description of \mathbf{W} , and ( 4.3.9 ) holds with \mathcal{Z}=\sigma(\mathbf{W}) . Remark 2 . It is a priori not obvious if \mathcal{Q} is given by a representation, i.e., if \mathcal{Q}=\sigma(\varphi(\mathbf{W})) for some measurable mapping \varphi . In Example 2 it is, since the arguments can be reformulated to conclude that \mathcal{Q}=\sigma(\|\mathbf{W}\|) . Instead of working with the entire conditional distribution, it suffices to work with the conditional mean when assuming, e.g., independent additive noise on the outcome. Proposition 4.3.4 . For fixed P\in\mathcal{P} , then \mathcal{Q}_{P}=\mathcal{R}_{P} if any of the following statements are true: • F(y\,|\,t,\mathbf{W};P) is \sigma(b_{t}(\mathbf{W};P)) -measurable for each t\in\mathbb{T},y\in\real . • Y is a binary outcome. • Y has independent additive noise, i.e., Y=b_{T}(\mathbf{W})+\varepsilon_{Y} with \varepsilon_{Y}\,{\perp\!\!\!\perp}_{P}\,T,\mathbf{W} . If \mathcal{Q}_{P}=\mathcal{R}_{P} holds, then ( 4.3.8 ) also holds for any P -OMS description. Remark 3 . When \mathcal{Q}_{P}=\mathcal{R}_{P} for all P\in\mathcal{P} we have \mathcal{Q}=\mathcal{R} . There is thus the same information in the \sigma -algebra \mathcal{R} generated by the conditional means of the outcome as there is in the \sigma -algebra \mathcal{Q} generated by the entire conditional distribution of the outcome. The three conditions in Proposition 4.3.4 are sufficient but not necessary to ensure this. We also have a result analogous to Lemma 4 of Rotnitzky and Smucler (2020) : Lemma 4.3.5 (Supplementation with precision) . Fix P\in\mathcal{P} and let \mathcal{Z}_{1}\subseteq\mathcal{Z}_{2} be descriptions of \mathbf{W} such that T\,{\perp\!\!\!\perp}_{P}\,\mathcal{Z}_{2}\,|\,\mathcal{Z}_{1} . Then \mathcal{Z}_{1} is P -valid if and only if \mathcal{Z}_{2} is P -valid. Irrespectively, it always holds that \displaystyle\mathbb{V}_{\!\Delta}(\mathcal{Z}_{1};P)-\mathbb{V}_{\!\Delta}(\mathcal{Z}_{2};P)=\mathbf{c}^{\top}\var_{P}[\mathbf{R}(\mathcal{Z}_{1},\mathcal{Z}_{2};P)]\mathbf{c}\geq 0 where \mathbf{R}(\mathcal{Z}_{1},\mathcal{Z}_{2};P)\coloneq(R_{t}(\mathcal{Z}_{1},\mathcal{Z}_{2};P))_{t\in\mathbb{T}} with \displaystyle R_{t}(\mathcal{Z}_{1},\mathcal{Z}_{2};P) \displaystyle\coloneq\left(\frac{\mathbbl{1}(T=t)}{\pi_{t}(\mathcal{Z}_{2};P)}-1\right)\left(b_{t}(\mathcal{Z}_{2};P)-b_{t}(\mathcal{Z}_{1};P)\right). Writing R_{t}=R_{t}(\mathcal{Z}_{1},\mathcal{Z}_{2};P) , the components of the covariance matrix of \mathbf{R} are given by \displaystyle\var_{P}(R_{t}) \displaystyle=\mathbb{E}_{P}\left[\left(\frac{1}{\pi_{t}(\mathcal{Z}_{1};P)}-1\right)\var_{P}[b_{t}(\mathcal{Z}_{2};P)\,|\,\mathcal{Z}_{1}]\right], \displaystyle\cov_{P}(R_{s},R_{t}) \displaystyle=-\mathbb{E}_{P}[\cov_{P}(b_{s}(\mathcal{Z}_{2};P)b_{t}(\mathcal{Z}_{2};P)\,|\,\mathcal{Z}_{1})]. As a consequence, we obtain the well-known fact that the propensity score is a valid adjustment if \mathbf{W} is, cf. Theorems 1–3 in Rosenbaum and Rubin (1983) . Corollary 4.3.6 . Let \Pi_{P}=\sigma(\pi_{t}(\mathbf{W};P)\colon\,t\in\mathbb{T}) . If \mathcal{Z} is a description of \mathbf{W} containing \Pi_{P} , then \mathcal{Z} is P -valid and \mathbb{V}_{\!\Delta}(\Pi_{P};P)-\mathbb{V}_{\!\Delta}(\mathcal{Z};P)=\mathbf{c}^{\top}\var_{P}[\mathbf{R}(\mathcal{R}_{P},\mathcal{Z};P)]\mathbf{c}\geq 0. The corollary asserts that while the information contained in the propensity score is valid, it is asymptotically inefficient to adjust for in contrast to all the information of \mathbf{W} . This is in similar spirit to Theorem 2 of Hahn (1998) , which states that the efficiency bound \mathbb{V}_{\!\Delta}(\mathbf{W};P) remains unaltered if the propensity is considered as known. However, the corollary also quantifies the difference of the asymptotic efficiencies. Corollary 4.3.3 asserts that \mathcal{Q} is maximally efficient over all \mathcal{P} -ODS descriptions \mathcal{Z} satisfying \mathcal{Q}\subseteq\mkern 2.0mu\overline{\mkern-2.0mu\mathcal{Z}\mkern 0.0mu}\mkern 0.0mu^{P} , and Proposition 4.3.4 asserts that in special cases, \mathcal{Q} reduces to \mathcal{R} . Since \mathcal{R} is \mathcal{P} -OMS, hence \mathcal{P} -valid, it is natural to ask if \mathcal{R} is generally more efficient than \mathcal{Q} . The following example shows that their efficiency bounds may be incomparable uniformly over \mathcal{P} . Example 3 . Let 0<\delta<\frac{1}{2} be fixed and let \mathcal{P} be the collection of data generating distributions that satisfy: • \mathbf{W}\in[\delta,1-\delta] with a symmetric distribution, i.e., \mathbf{W}\stackrel{{\scriptstyle\mathcal{D}}}{{=}}1-\mathbf{W} . • T\in\{0,1\} with \mathbb{E}(T\,|\,\mathbf{W})=\mathbf{W} . • Y=T+g(|\mathbf{W}-\frac{1}{2}|)+v(\mathbf{W})\varepsilon_{Y} , where \varepsilon_{Y}\,\perp\!\!\!\perp\,{}(T,\mathbf{W}) , \mathbb{E}[\varepsilon_{Y}^{2}]<\infty , \mathbb{E}[\varepsilon_{Y}]=0 , and where g\colon[0,\frac{1}{2}-\delta]\to\real and v\colon[\delta,1-\delta]\to[0,\infty) are continuous functions. Letting \mathbf{Z}=|\mathbf{W}-\frac{1}{2}| , it is easy to verify directly from Definition 2 that \mathcal{Q}=\sigma(\mathbf{W})\neq\sigma(\mathbf{Z})=\mathcal{R}. It follows that \mathbf{Z} is \mathcal{P} -OMS but not \mathcal{P} -ODS. However, \mathbf{Z} is \mathcal{P}_{1} -ODS in the homoscedastic submodel \mathcal{P}_{1}=\{P\in\mathcal{P}\,|\,v\equiv 1\} . In fact, it generates the \sigma -algebra \mathcal{Q} within this submodel, i.e., \sigma(\mathbf{Z})=\vee_{P\in\mathcal{P}_{1}}\mathcal{Q}_{P} . Thus \mathbb{V}_{\!\Delta}(\mathbf{Z};P)\leq\mathbb{V}_{\!\Delta}(\mathbf{W};P) for all P\in\mathcal{P}_{1} . We refer to the supplementary Section 4.A.6 for complete calculations of the subsequent formulas. From symmetry it follows that \pi_{1}(\mathbf{Z})=0.5 and hence we conclude that T\,\perp\!\!\!\perp\,\mathbf{Z} . By Lemma 4.3.5 , it follows that 0 (the trivial adjustment) is \mathcal{P} -valid, but with \mathbb{V}_{\!\Delta}(\mathbf{Z};P)\leq\mathbb{V}_{\!\Delta}(0;P) for all P\in\mathcal{P} . Alternatively, direct computation yields that \displaystyle\mathbb{V}_{t}(0) \displaystyle=2\var(g(\mathbf{Z}))+2\,\mathbb{E}[v(\mathbf{W})^{2}]\mathbb{E}[\varepsilon_{Y}^{2}] \displaystyle\mathbb{V}_{t}(\mathbf{Z}) \displaystyle=\var\left(g(\mathbf{Z})\right)+2\,\mathbb{E}[v(\mathbf{W})^{2}]\mathbb{E}[\varepsilon_{Y}^{2}] \displaystyle\mathbb{V}_{t}(\mathbf{W}) \displaystyle=\var\left(g(\mathbf{Z})\right)+\mathbb{E}\left[v(\mathbf{W})^{2}/\mathbf{W}\right]\mathbb{E}[\varepsilon_{Y}^{2}]. With \Delta=\chi_{t} , the first two equalities confirm that \mathbb{V}_{\!\Delta}(\mathbf{Z};P)\leq\mathbb{V}_{\!\Delta}(0;P) , P\in\mathcal{P} , and the last two yield that indeed \mathbb{V}_{\!\Delta}(\mathbf{Z};P)\leq\mathbb{V}_{\!\Delta}(\mathbf{W};P) for P\in\mathcal{P}_{1} by applying Jensen’s inequality. In fact, these are strict inequalities whenever g(\mathbf{Z}) and \varepsilon_{Y} are non-degenerate. Finally, we show that it is possible for \mathbb{V}_{\!\Delta}(\mathbf{Z};P)>\mathbb{V}_{\!\Delta}(\mathbf{W};P) for P\notin\mathcal{P}_{1} . Let \tilde{P}\in\mathcal{P} be a data generating distribution with \mathbb{E}_{\tilde{P}}[\varepsilon_{Y}^{2}]>0 , v(\mathbf{W})=\mathbf{W}^{2} , and with \mathbf{W} uniformly distributed on [\delta,1-\delta] . Then \displaystyle 2\,\mathbb{E}_{\tilde{P}}[v(\mathbf{W})^{2}] \displaystyle=\,2\mathbb{E}_{\tilde{P}}[\mathbf{W}^{4}]=2\frac{(1-\delta)^{5}-\delta^{5}}{5(1-2\delta)}\xrightarrow{\delta\to 0}\frac{2}{5} \displaystyle\mathbb{E}_{\tilde{P}}\left[\frac{v(\mathbf{W})^{2}}{\mathbf{W}}\right] \displaystyle=\mathbb{E}_{\tilde{P}}[\mathbf{W}^{3}]=\frac{(1-\delta)^{4}-\delta^{4}}{4(1-2\delta)}\xrightarrow{\delta\to 0}\frac{1}{4}. So for sufficiently small \delta , it holds that \mathbb{V}_{\!\Delta}(\mathbf{Z};\tilde{P})>\mathbb{V}_{\!\Delta}(\mathbf{W};\tilde{P}) . The example can also be modified to work for other \delta>0 by taking v to be a sufficiently large power of \mathbf{W} . Remark 4 . Following Theorem 1 of Benkeser et al. (2020) , it is stated that the asymptotic variance \mathbb{V}_{\!\Delta}(\mathcal{R}_{P};P) is generally smaller than \mathbb{V}_{\!\Delta}(\mathbf{W};P) . The example demonstrates that this requires some assumptions on the outcome distribution, such as the conditions in Proposition 4.3.4 . Remark 5 . Suppose that \mathcal{P}=\{f_{\theta}\cdot\mu\colon\theta\in\Theta\} is a parametrized family of measures with densities \{f_{\theta}\}_{\theta\in\Theta} with respect to a \sigma -finite measure \mu . Then informally, a sufficient sub- \sigma -algebra is any subset of the observed information for which the remaining information is independent of \theta\in\Theta , see Billingsley (2017) for a formal definition. Superficially, this concept seems similar to that of a \mathcal{P} -ODS description. In contrast however, the latter is a subset of the covariate information \sigma(\mathbf{W}) rather than the observed information \sigma(T,\mathbf{W},Y) , and it concerns sufficiency for the outcome distribution rather than the entire data distribution. Moreover, the Rao-Blackwell theorem asserts that conditioning an estimator of \theta on a sufficient sub- \sigma -algebra leads to an estimator that is never worse. Example 3 demonstrates that the situation is more delicate when considering statistical efficiency for adjustment. 4.4 Estimation based on outcome-adapted representations In this section we develop a general estimation method based on the insights of Section 4.3 , and we provide an asymptotic analysis of this methodology under general conditions. Our method modifies the AIPW estimator, which we proceed to discuss in more detail. We have worked with the propensity score, \pi_{t} , and the outcome regression, b_{t} , as random variables. We now consider, for each P\in\mathcal{P} , their function counterparts obtained as regular conditional expectations: \displaystyle m_{P} \displaystyle\colon\mathbb{T}\times\mathbb{W}\to\real, \displaystyle m_{P}(t\,|\,\mathbf{w})\coloneq\mathbb{P}_{P}(T=t\,|\,\mathbf{W}=\mathbf{w}), \displaystyle g_{P} \displaystyle\colon\mathbb{T}\times\mathbb{W}\to\real, \displaystyle g_{P}(t,\mathbf{w})\coloneq\mathbb{E}_{P}[Y\,|\,T=t,\mathbf{W}=\mathbf{w}]. To target the adjusted mean, \chi_{t} , the AIPW estimator utilizes the influence function – given by ( 4.3.2 ) – as a score equation. To be more precise, given estimates (\widehat{m},\widehat{g}) of the nuisance functions (m_{P},g_{P}) , the AIPW estimator of \chi_{t} is given by \widehat{\chi}_{t}^{\mathrm{aipw}}(\widehat{m},\widehat{g})\coloneq\mathbb{P}_{n}\Big[\widehat{g}(t,\mathbf{W})+\frac{\mathbbl{1}(T=t)(Y-\widehat{g}(t,\mathbf{W}))}{\widehat{m}(t\,|\,\mathbf{W})}\Big], (4.4.10) where \mathbb{P}_{n}[\cdot] is defined as the empirical mean over n i.i.d. observations from P . The natural AIPW estimator of \Delta given by ( 4.3.5 ) is then \widehat{\Delta}^{\mathrm{aipw}}(\widehat{m},\widehat{g})=\sum_{t\in\mathbb{T}}c_{t}\widehat{\chi}_{t}^{\mathrm{aipw}}(\widehat{m},\widehat{g}) . Roughly speaking, the AIPW estimator \widehat{\chi}_{t}^{\mathrm{aipw}} converges to \chi_{t} with a \sqrt{n} -rate if n\cdot\mathbb{P}_{n}\big[(\widehat{m}(t\,|\,\mathbf{W})-m_{P}(t\,|\,\mathbf{W}))^{2}\big]\cdot\mathbb{P}_{n}\big[(\widehat{g}(t,\mathbf{W})-g_{P}(t,\mathbf{W}))^{2}\big]\longrightarrow 0. (4.4.11) If (\widehat{m},\widehat{g}) are estimated using the same data as \mathbb{P}_{n} , then the above asymptotic result relies on Donsker class conditions on the spaces containing \widehat{m} and \widehat{g} . Among others, Chernozhukov et al. (2018) propose circumventing Donsker class conditions by sample splitting techniques such as K -fold cross-fitting. 4.4.1 Representation adjustment and the DOPE Suppose that the outcome regression function factors through an intermediate representation: \displaystyle g_{P}(t,\mathbf{w})=h_{P}(t,\varphi(\theta_{P},\mathbf{w})),\qquad t\in\mathbb{T},\mathbf{w}\in\mathbb{W}, (4.4.12) where \varphi\colon\Theta\times\mathbb{W}\to\real^{d} is a known measurable mapping with unknown parameter \theta\in\Theta , and where h_{P}\colon\mathbb{T}\times\real^{d}\to\real is an unknown function. We use \mathbf{Z}_{\theta}=\varphi(\theta,\mathbf{W}) to denote the corresponding representation parametrized by \theta\in\Theta . If a particular covariate value \mathbf{w}\in\mathbb{W} is clear from the context, we also use the implicit notation \mathbf{z}_{\theta}=\varphi(\theta,\mathbf{w}) . Example 4 (Single-index model) . The (partial) single-index model applies to \mathbf{W}\in\real^{k} and assumes that ( 4.4.12 ) holds with \varphi(\theta,\mathbf{w})=\mathbf{w}^{\top}\theta , where \theta\in\Theta\subseteq\real^{k} . In other words, it assumes that the outcome regression factors through the linear predictor \mathbf{Z}_{\theta}=\mathbf{W}^{\top}\theta such that \displaystyle\forall P\in\mathcal{P}:\qquad Y=h_{P}(T,\mathbf{Z}_{\theta_{P}})+\varepsilon_{Y},\qquad\mathbb{E}_{P}[\varepsilon_{Y}\,|\,T,\mathbf{W}]=0. (4.4.13) For each treatment T=t , the model extends the generalized linear model (GLM) by assuming that the (inverse) link function h_{P}(t,\cdot) is unknown. The semiparametric least squares (SLS) estimator proposed by Ichimura (1993) estimates \theta_{P} and h_{P} by performing a two-step regression procedure. Alternative estimation procedures are given in Powell et al. (1989) ; Delecroix et al. (2003) . Given an estimator \hat{\theta} of \theta_{P} , independent of (T,\mathbf{W},Y) , we use the following notation for various functions and estimators thereof: \displaystyle g_{\hat{\theta}}(t,\mathbf{w}) \displaystyle\coloneq\mathbb{E}_{P}[Y\,|\,T=t,\mathbf{Z}_{\hat{\theta}}=\mathbf{z}_{\hat{\theta}},\hat{\theta}\,], \displaystyle m_{\hat{\theta}}(t\,|\,\mathbf{w}) \displaystyle\coloneq\mathbb{P}_{P}(T=t\,|\,\mathbf{Z}_{\hat{\theta}}=\mathbf{z}_{\hat{\theta}},\hat{\theta}\,), \displaystyle\widehat{g}(t,\mathbf{w}) \displaystyle\colon\text{an estimator of }g_{P}(t,\mathbf{w}), \displaystyle\widehat{g}_{\hat{\theta}}(t,\mathbf{w}) \displaystyle\colon\text{an estimator of }g_{\hat{\theta}}(t,\mathbf{w})\text{ of the form }\widehat{h}(t,\mathbf{z}_{\hat{\theta}}), (4.4.14a) \displaystyle\widehat{m}_{\hat{\theta}}(t\,|\,\mathbf{w}) \displaystyle\colon\text{an estimator of }m_{\hat{\theta}}(t\,|\,\mathbf{w})\text{ of the form }\widehat{f}(t,\mathbf{z}_{\hat{\theta}}). (4.4.14b) In other words, g_{\hat{\theta}} and m_{\hat{\theta}} are the theoretical propensity score and outcome regression, respectively, when using the estimated representation \mathbf{Z}_{\hat{\theta}}=\varphi(\hat{\theta},\mathbf{W}) . Note that we have suppressed P from the notation on the left-hand side, as we will be working under a fixed P in this section. Sufficient conditions are well known that ensure \displaystyle\sqrt{n}(\widehat{\chi}_{t}^{\mathrm{aipw}}(\widehat{m},\widehat{g})-\chi_{t})\xrightarrow{d}\mathrm{N}(0,\mathbb{V}_{t}(\mathbf{W};P)). Such conditions, e.g., Assumption 5.1 in Chernozhukov et al. (2018) , primarily entail the condition in ( 4.4.11 ). We will leverage ( 4.4.12 ) to derive more efficient estimators under similar conditions. Suppose for a moment that \theta_{P} is known. Since \mathbf{Z}_{\theta_{P}} is P -OMS under ( 4.4.13 ), it holds that \chi_{t}(\mathbf{Z}_{\theta_{P}};P)=\chi_{t} . Then under analogous conditions for the estimators (\widehat{m}_{\theta_{P}},\widehat{g}_{\theta_{P}}) , we therefore have \displaystyle\sqrt{n}(\widehat{\chi}_{t}^{\mathrm{aipw}}(\widehat{m}_{\theta_{P}},\widehat{g}_{\theta_{P}})-\chi_{t})\xrightarrow{d}\mathrm{N}(0,\mathbb{V}_{t}(\mathbf{Z}_{\theta_{P}};P)). Under the conditions of Proposition 4.3.4 , it holds that \mathbb{V}_{t}(\mathbf{Z}_{\theta_{P}};P)\leq\mathbb{V}_{t}(\mathbf{W};P) . In other words, \widehat{\chi}_{t}^{\mathrm{aipw}}(\widehat{m}_{\theta_{P}},\widehat{g}_{\theta_{P}}) is asymptotically at least as efficient as \widehat{\chi}_{t}^{\mathrm{aipw}}(\widehat{m},\widehat{g}) . In general, the parameter \theta_{P} is, of course, unknown, and we therefore consider adjusting for an estimated representation \mathbf{Z}_{\hat{\theta}} . For simplicity, we present the special case \Delta=\chi_{t} , but the results are easily extended to general contrasts \Delta . Our generic estimation procedure is described in Algorithm 1 , where \mathbf{Z}_{\hat{\theta},i}\coloneq\varphi(\hat{\theta},\mathbf{W}_{i}) denotes the estimated representation of the i -th observed covariate. We refer to the resulting estimator as the Debiased Outcome-adapted Propensity Estimator (DOPE), and it is denoted by \widehat{\chi}_{t}^{\mathrm{dope}} . Algorithm 1 Debiased Outcome-adapted Propensity Estimator input : observations (T_{i},\mathbf{W}_{i},Y_{i})_{i\in[n]} , index sets \mathcal{I}_{1},\mathcal{I}_{2},\mathcal{I}_{3}\subseteq[n] ; 1 options : method for computing \hat{\theta} , regression methods for propensity score and outcome regression of the form ( 4.4.14 ); 2 begin 3 compute estimate \hat{\theta} based on data (T_{i},\mathbf{W}_{i},Y_{i})_{i\in\mathcal{I}_{1}} ; 4 regress outcomes (Y_{i})_{i\in\mathcal{I}_{2}} onto (T_{i},\mathbf{Z}_{\hat{\theta},i})_{i\in\mathcal{I}_{2}} to obtain \widehat{g}_{\hat{\theta}}(\cdot,\cdot) ; 5 regress treatments (T_{i})_{i\in\mathcal{I}_{2}} onto (\mathbf{Z}_{\hat{\theta},i})_{i\in\mathcal{I}_{2}} to obtain \widehat{m}_{\hat{\theta}}(\cdot\,|\,\cdot) ; 6 compute AIPW based on data (T_{i},\mathbf{W}_{i},Y_{i})_{i\in\mathcal{I}_{3}} and nuisance estimates (\widehat{m}_{\hat{\theta}},\widehat{g}_{\hat{\theta}}) : \displaystyle\widehat{\chi}_{t}^{\mathrm{dope}}=\frac{1}{|\mathcal{I}_{3}|}\sum_{i\in\mathcal{I}_{3}}\left(\widehat{g}_{\hat{\theta}}(t,\mathbf{W}_{i})+\frac{\mathbbl{1}(T_{i}=t)(Y_{i}-\widehat{g}_{\hat{\theta}}(t,\mathbf{W}_{i}))}{\widehat{m}_{\hat{\theta}}(t\,|\,\mathbf{W}_{i})}\right) 7 return DOPE: \widehat{\chi}_{t}^{\mathrm{dope}} . Algorithm 1 is formulated such that \mathcal{I}_{1} , \mathcal{I}_{2} , and \mathcal{I}_{3} can be arbitrary subsets of [n] , and for the asymptotic theory we assume that they are disjoint. However, in practical applications it might be reasonable to use the full sample for every estimation step, i.e., employing the algorithm with \mathcal{I}_{1}=\mathcal{I}_{2}=\mathcal{I}_{3}=[n] . In this case, we also imagine that line 4 and line 5 are run simultaneously given that \hat{\theta} may be derived from an outcome regression, cf. the SLS estimator in the single-index model (Example 4 ). In the supplementary Section 4 , we also describe a more advanced cross-fitting scheme for Algorithm 1 Remark 6 . Benkeser et al. (2020) use a similar idea as the DOPE, but their propensity factors through the final outcome regression function instead of a general intermediate representation. That our general formulation of Algorithm 1 contains their collaborative one-step estimator as a special case is seen as follows. Suppose T\in\{0,1\} is binary and let \Theta=\{\theta=(g_{P}(0,\cdot),g_{P}(1,\cdot))\colon P\in\mathcal{P}\} be the collection of outcome regression functions. Define the intermediate representation as the canonical pairing \varphi(\theta,\mathbf{W})=(\theta_{1}(\mathbf{W}),\theta_{2}(\mathbf{W})) . Then, for any outcome regression estimate \hat{\theta} , we may set \hat{g}_{\hat{\theta}}(t,\mathbf{w})=(1-t)\hat{\theta}_{1}(\mathbf{w})+t\hat{\theta}_{2}(\mathbf{w}) , and the propensity score \hat{m}_{\hat{\theta}}(t\mid\mathbf{w}) factors through the outcome regressions. In this case and with \mathcal{I}_{1}=\mathcal{I}_{2}=\mathcal{I}_{3} , Algorithm 1 yields the collaborative one-step estimator of Benkeser et al. (2020, Appendix D) . Accordingly, we refer to this special case as DOPE-BCL (Benkeser, Cai and van der Laan). 4.4.2 Asymptotics of the DOPE We proceed to discuss the asymptotics of the DOPE. For our theoretical analysis, we assume that the index sets in Algorithm 1 are disjoint. That is, the theoretical analysis relies on sample splitting. Assumption 4.4.1 . The observations (T_{i},\mathbf{W}_{i},Y_{i})_{i\in[n]} used to compute \widehat{\chi}_{t}^{\mathrm{dope}} are i.i.d. with the same distribution as (T,\mathbf{W},Y) , and [n]=\mathcal{I}_{1}\cup\mathcal{I}_{2}\cup\mathcal{I}_{3} is a partition such that |\mathcal{I}_{3}|\to\infty as n\to\infty . In our simulations, employing sample splitting did not seem to enhance performance, and hence we regard Assumption 4.4.1 as a theoretical convenience rather than a practical necessity in all cases. Our results can likely also be established under alternative assumptions that avoid sample splitting, in particular Donsker class conditions. We also henceforth use the convention that each of the quantities \pi_{t},b_{t},\chi_{t} , and \mathbb{V}_{t} are defined conditionally on \hat{\theta} , e.g., \chi_{t}(\mathbf{Z}_{\hat{\theta}})=\mathbb{E}[b_{t}(\mathbf{Z}_{\hat{\theta}})\,|\,\hat{\theta}\,]=\mathbb{E}[\mathbb{E}[Y\,|\,T=t,\mathbf{Z}_{\hat{\theta}},\hat{\theta}\,]\,|\,\hat{\theta}\,]. The error of the DOPE estimator can then be decomposed as \widehat{\chi}_{t}^{\mathrm{dope}}-\chi_{t}=(\widehat{\chi}_{t}^{\mathrm{dope}}-\chi_{t}(\mathbf{Z}_{\hat{\theta}}))+(\chi_{t}(\mathbf{Z}_{\hat{\theta}})-\chi_{t}). (4.4.15) The first term is the error had our target been the adjusted mean when adjusting for the estimated representation \mathbf{Z}_{\hat{\theta}} , whereas the second term is the adjustment bias that arises from adjusting for \mathbf{Z}_{\hat{\theta}} rather than \mathbf{W} (or \mathbf{Z}_{\theta} ). 4.4.2.1 Estimation error conditionally on representation To describe the asymptotics of the first term of ( 4.4.15 ), we consider the decomposition \displaystyle\sqrt{|\mathcal{I}_{3}|}\widehat{\chi}_{t}^{\mathrm{dope}} \displaystyle=U_{\hat{\theta}}^{(n)}+R_{1}+R_{2}+R_{3}, (4.4.16) where \displaystyle U_{\hat{\theta}}^{(n)} \displaystyle\coloneq\frac{1}{\sqrt{|\mathcal{I}_{3}|}}\sum_{i\in\mathcal{I}_{3}}u_{i}(\hat{\theta}), \displaystyle u_{i}(\hat{\theta})\coloneq g_{\hat{\theta}}(t,\mathbf{W}_{i})+\frac{\mathbbl{1}(T_{i}=t)(Y_{i}-g_{\hat{\theta}}(t,\mathbf{W}_{i}))}{m_{\hat{\theta}}(t\,|\,\mathbf{W}_{i})}, \displaystyle R_{1} \displaystyle\coloneq\frac{1}{\sqrt{|\mathcal{I}_{3}|}}\sum_{i\in\mathcal{I}_{3}}r_{i}^{1}, \displaystyle r_{i}^{1}\coloneq\left(\widehat{g}_{\hat{\theta}}(t,\mathbf{W}_{i})-g_{\hat{\theta}}(t,\mathbf{W}_{i})\right)\left(1-\frac{\mathbbl{1}(T_{i}=t)}{m_{\hat{\theta}}(t\,|\,\mathbf{W}_{i})}\right), \displaystyle R_{2} \displaystyle\coloneq\frac{1}{\sqrt{|\mathcal{I}_{3}|}}\sum_{i\in\mathcal{I}_{3}}r_{i}^{2}, \displaystyle r_{i}^{2}\coloneq(Y_{i}-g_{\hat{\theta}}(t,\mathbf{W}_{i}))\left(\frac{\mathbbl{1}(T_{i}=t)}{\widehat{m}_{\hat{\theta}}(t\,|\,\mathbf{W}_{i})}-\frac{\mathbbl{1}(T_{i}=t)}{m_{\hat{\theta}}(t\,|\,\mathbf{W}_{i})}\right), \displaystyle R_{3} \displaystyle\coloneq\frac{1}{\sqrt{|\mathcal{I}_{3}|}}\sum_{i\in\mathcal{I}_{3}}r_{i}^{3}, \displaystyle r_{i}^{3}\coloneq\big(\widehat{g}_{\hat{\theta}}(t,\mathbf{W}_{i})-g_{\hat{\theta}}(t,\mathbf{W}_{i})\big)\left(\frac{\mathbbl{1}(T_{i}=t)}{\widehat{m}_{\hat{\theta}}(t\,|\,\mathbf{W}_{i})}-\frac{\mathbbl{1}(T_{i}=t)}{m_{\hat{\theta}}(t\,|\,\mathbf{W}_{i})}\right). We show that the oracle term, U_{\hat{\theta}}^{(n)} , drives the asymptotic limit, and that the terms R_{1},R_{2},R_{3} are remainder terms, subject to the conditions stated below. Assumption 4.4.2 . For (T,\mathbf{W},Y)\sim P satisfying the representation model ( 4.4.12 ), it holds that: (i) There exists c>0 such that \max\{|\widehat{m}_{\hat{\theta}}-\frac{1}{2}|,|m_{\hat{\theta}}-\frac{1}{2}|\}\leq\frac{1}{2}-c . (ii) There exists C>0 such that \mathbb{E}[Y^{2}\,|\,\mathbf{W},T]\leq C . (iii) There exists \delta>0 such that \mathbb{E}\big[|Y|^{2+\delta}\big]<\infty . (iv) It holds that \mathcal{E}_{1,t}^{(n)}\coloneq\frac{1}{|\mathcal{I}_{3}|}\sum_{i\in\mathcal{I}_{3}}(\widehat{m}_{\hat{\theta}}(t\,|\,\mathbf{W}_{i})-m_{\hat{\theta}}(t\,|\,\mathbf{W}_{i}))^{2}\xrightarrow{P}0 . (v) It holds that \mathcal{E}_{2,t}^{(n)}\coloneq\frac{1}{|\mathcal{I}_{3}|}\sum_{i\in\mathcal{I}_{3}}(\widehat{g}_{\hat{\theta}}(t,\mathbf{W}_{i})-g_{\hat{\theta}}(t,\mathbf{W}_{i}))^{2}\xrightarrow{P}0 . (vi) It holds that |\mathcal{I}_{3}|\cdot\mathcal{E}_{1,t}^{(n)}\mathcal{E}_{2,t}^{(n)}\xrightarrow{P}0 . Classical convergence results of the AIPW are proven under similar conditions, but with (vi) replaced by the stronger convergence in ( 4.4.11 ). We establish conditional asymptotic results under conditions on the conditional errors \mathcal{E}_{1,t}^{(n)} and \mathcal{E}_{2,t}^{(n)} . To the best of our knowledge, the most similar results that we are aware of are those of Benkeser et al. (2020) , and our proof techniques are most similar to those of Chernozhukov et al. (2018) ; Lundborg and Pfister (2023) . We can now state our first asymptotic result for the DOPE. Theorem 4.4.1 . Under Assumptions 4.4.1 and 4.4.2 , it holds that \displaystyle\mathbb{V}_{t}(\mathbf{Z}_{\hat{\theta}})^{-1/2}\cdot U_{\hat{\theta}}^{(n)}\xrightarrow{d}\mathrm{N}(0,1),\qquad\text{and}\qquad R_{i}\xrightarrow{P}0,\quad i=1,2,3, as n\to\infty . As a consequence, \displaystyle\sqrt{|\mathcal{I}_{3}|}\cdot\mathbb{V}_{t}(\mathbf{Z}_{\hat{\theta}})^{-1/2}\left(\widehat{\chi}_{t}^{\mathrm{dope}}-\chi_{t}(\mathbf{Z}_{\hat{\theta}})\right)\xrightarrow{d}\mathrm{N}(0,1). In other words, we can expect the DOPE to have an asymptotic distribution, conditionally on \hat{\theta} , approximated by \widehat{\chi}_{t}^{\mathrm{dope}}(\widehat{g}_{\hat{\theta}},\widehat{m}_{\hat{\theta}})\,|\,\hat{\theta}\quad\stackrel{{\scriptstyle as.}}{{\sim}}\quad\mathrm{N}\Big(\chi_{t}(\mathbf{Z}_{\hat{\theta}}),\,\frac{1}{|\mathcal{I}_{3}|}\mathbb{V}_{t}(\mathbf{Z}_{\hat{\theta}})\Big). Note that if |\mathcal{I}_{3}|=\lfloor n/3\rfloor , say, then the asymptotic variance is \frac{3}{n}\mathbb{V}_{t}(\mathbf{Z}_{\hat{\theta}}) . Our simulation study indicates that the asymptotic approximation may be valid in some cases without the use of sample splitting, in which case |\mathcal{I}_{3}|=n and the asymptotic variance is \frac{1}{n}\mathbb{V}_{t}(\mathbf{Z}_{\hat{\theta}}) . A direct implementation of the sample splitting procedure thus comes with an efficiency cost. In the supplementary Section 4 we discuss how the cross-fitting procedure makes use of sample splitting without an efficiency cost. Given nuisance estimates (\widehat{g},\widehat{m}) we consider the empirical variance estimator given by \displaystyle\widehat{\mathcal{V}}_{t}(\widehat{g},\widehat{m})=\frac{1}{|\mathcal{I}_{3}|}\sum_{i\in\mathcal{I}_{3}}\widehat{u}_{i}^{2}-\Big(\frac{1}{|\mathcal{I}_{3}|}\sum_{i\in\mathcal{I}_{3}}\widehat{u}_{i}\Big)^{2}=\frac{1}{|\mathcal{I}_{3}|}\sum_{i\in\mathcal{I}_{3}}\Big(\widehat{u}_{i}-\frac{1}{|\mathcal{I}_{3}|}\sum_{j\in\mathcal{I}_{3}}\widehat{u}_{j}\Big)^{2}, (4.4.17) where \displaystyle\widehat{u}_{i}=\widehat{u}_{i}(\widehat{g},\widehat{m})=\widehat{g}(t,\mathbf{W}_{i})+\frac{\mathbbl{1}(T=t)(Y_{i}-\widehat{g}(t,\mathbf{W}_{i}))}{\widehat{m}(t\,|\,\mathbf{W}_{i})}. The following theorem states that the variance estimator with nuisance functions (\widehat{g}_{\hat{\theta}},\widehat{m}_{\hat{\theta}}) is consistent for the asymptotic variance in Theorem 4.4.1 . Theorem 4.4.2 . Under Assumptions 4.4.1 and 4.4.2 , it holds that \displaystyle\widehat{\mathcal{V}}_{t}(\widehat{g}_{\hat{\theta}},\widehat{m}_{\hat{\theta}})-\mathbb{V}_{t}(\mathbf{Z}_{\hat{\theta}})\xrightarrow{P}0 as n\to\infty . 4.4.2.2 Asymptotics of representation induced error We now turn to the discussion of the second term in ( 4.4.15 ), i.e., the difference between the adjusted mean for the estimated representation \mathbf{Z}_{\hat{\theta}} and the adjusted mean for the full covariate \mathbf{W} . Under sufficient regularity, the delta method ( van der Vaart, 2000 , Thm. 3.8) describes the distribution of this error: Proposition 4.4.3 . Assume (T,\mathbf{W},Y)\sim P satisfies the model ( 4.4.12 ) with \theta_{P}\in\Theta\subseteq\real^{p} . Let u\colon\Theta\to\real be the function given by u(\theta)=\chi_{t}(\varphi(\theta,\mathbf{W});P) and assume that u is differentiable in \theta_{P} . Suppose that \hat{\theta} is an estimator of \theta_{P} with rate r_{n} such that \displaystyle r_{n}\cdot(\hat{\theta}-\theta_{P})\xrightarrow{d}\mathrm{N}(0,\Sigma). Then \displaystyle r_{n}\cdot(\chi_{t}(\mathbf{Z}_{\hat{\theta}})-\chi_{t})\xrightarrow{d}\mathrm{N}(0,\nabla u(\theta_{P})^{\top}\Sigma\nabla u(\theta_{P})) as n\to\infty . The delta method requires that the adjusted mean, \chi_{t}=\chi_{t}(\varphi(\theta,\mathbf{W});P) , is differentiable with respect to \theta\in\Theta . The theorem below showcases that this is the case for the single-index model in Example 4 . Theorem 4.4.4 . Let (T,\mathbf{W},Y)\sim P be given by the single-index model in Example 4 with h_{t}(\cdot)\coloneq h(t,\cdot)\in C^{1}(\mathbb{R}) . Assume that \mathbf{W} has a distribution with density p_{\mathbf{W}} with respect to Lebesgue measure on d and that p_{\mathbf{W}} is continuous almost everywhere with bounded support. Assume also that the propensity m(t\mid\mathbf{w})=\mathbb{P}(T=t\,|\,\mathbf{W}=\mathbf{w}) is continuous in \mathbf{w} . Then u\colon\real^{d}\to\real , defined by u(\theta)=\chi_{t}(\mathbf{W}^{\top}\theta;P) , is differentiable at \theta=\theta_{P} with \displaystyle\nabla u(\theta_{P})=\mathbb{E}_{P}\Big[h_{t}^{\prime}(\mathbf{W}^{\top}\theta_{P})\Big(1-\frac{\mathbb{P}(T=t\,|\,\mathbf{W})}{\mathbb{P}(T=t\,|\,\mathbf{W}^{\top}\theta_{P})}\Big)\mathbf{W}\Big]. The theorem is stated with some restrictive assumptions that simplify the proof, but these are likely not necessary. It should also be possible to extend this result to more general models of the form ( 4.4.12 ), but we leave such generalizations for future work. In fact, the proof technique of Theorem 4.4.4 has already found application in Gnecco et al. (2023) in a different context. The convergences implied in Theorem 4.4.1 and Proposition 4.4.3 , with r_{n}=\sqrt{|\mathcal{I}_{3}|} , suggest that the MSE of the DOPE is of order \displaystyle\mathbb{E}[(\widehat{\chi}_{t}^{\mathrm{dope}}-\chi_{t})^{2}] \displaystyle=\mathbb{E}[(\widehat{\chi}_{t}^{\mathrm{dope}}-\chi_{t}(\mathbf{Z}_{\hat{\theta}}))^{2}]+\mathbb{E}[(\chi_{t}(\mathbf{Z}_{\hat{\theta}})-\chi_{t})^{2}] \displaystyle\qquad+2\,\mathbb{E}[(\widehat{\chi}_{t}^{\mathrm{dope}}-\chi_{t}(\mathbf{Z}_{\hat{\theta}}))(\chi_{t}(\mathbf{Z}_{\hat{\theta}})-\chi_{t})] \displaystyle\approx\frac{1}{|\mathcal{I}_{3}|}\Big(\mathbb{E}[\mathbb{V}_{t}(\mathbf{Z}_{\hat{\theta}})]+\nabla u(\theta_{P})^{\top}\Sigma\nabla u(\theta_{P})\Big)+o\left(|\mathcal{I}_{3}|^{-1}\right) (4.4.18) The informal approximation ‘ \approx ’ can be turned into an equality by establishing (or simply assuming) uniform integrability, which enables the distributional convergences to be lifted to convergences of moments. Remark 7 . The expression in ( 4.4.18 ) suggests an approximate confidence interval of the form \widehat{\chi}_{t}^{\mathrm{dope}}\pm\frac{z_{1-\alpha}}{\sqrt{|\mathcal{I}_{3}|}}(\widehat{\mathcal{V}}_{t}+\widehat{\nabla}^{\top}\widehat{\Sigma}\widehat{\nabla}), where \widehat{\Sigma} is a consistent estimator of the asymptotic variance of \sqrt{|\mathcal{I}_{3}|}(\hat{\theta}-\theta_{P}) , and where \widehat{\nabla} is a consistent estimator of \nabla_{\theta}\chi_{t}(\varphi(\theta,\mathbf{W}))|_{\theta=\theta_{P}} . However, the requirement of constructing both \widehat{\Sigma} and \widehat{\nabla} adds further to the complexity of the methodology, so it might be preferable to rely on bootstrapping techniques in practice. In the simulation study we return to the question of inference and examine the coverage of a naive interval that does not include the term \widehat{\nabla}^{\top}\widehat{\Sigma}\widehat{\nabla} . 4.5 Experiments In this section, we showcase the performance of the DOPE on simulated and real data. All code is publicly available on GitHub 7 7 7 https://github.com/AlexanderChristgau/OutcomeAdaptedAdjustment . 4.5.1 Simulation study We present results of a simulation study based on the single-index model from Example 4 . We demonstrate the performance of the DOPE from Algorithms 1 and 2 , and compare with various alternative estimators. 4.5.1.1 Sampling scheme We simulated datasets consisting of n i.i.d. copies of (T,\mathbf{W},Y) sampled according to the following scheme: \displaystyle\mathbf{W}=(W^{1},\ldots,W^{d}) \displaystyle\sim\mathrm{Unif}(0,1)^{\otimes d} \displaystyle T\,|\,\mathbf{W} \displaystyle\sim\mathrm{Bern}(0.01+0.98\cdot\mathbbl{1}(W^{1}>0.5)) \displaystyle Y\,|\,T,\mathbf{W},\beta_{Y} \displaystyle\sim\mathrm{N}(h(T,\mathbf{W}^{\top}\beta_{Y}),1) (4.5.19) where \beta_{Y} is sampled once for each dataset with \displaystyle\beta_{Y} \displaystyle=(1,\tilde{\beta}_{Y}),\qquad\tilde{\beta}_{Y}\sim\mathrm{N}(0,\mathbf{I}_{d-1}), and where n,d , and h are experimental parameters. The settings considered were n\in\{300,900,2700\} , d\in\{4,12,36\} , and with h being one of \displaystyle\begin{array}[]{ll}h_{\text{lin}}(t,z)=t+3z,&\quad h_{\text{square}}(t,z)=z^{1+t},\\ h_{\text{cbrt}}(t,z)=(2+t)z^{1/3},&\quad h_{\text{sin}}(t,z)=(3+t)\sin(\pi z).\end{array} For each setting, N=300 datasets were simulated. Note that while \mathbb{E}[T]=0.01+0.98\cdot\mathbb{P}(W^{1}>0.5)=0.5 , the propensity score m(t\mid\mathbf{w})=0.01+0.98\cdot\mathbbl{1}(w^{1}>0.5) takes the rather extreme values \{0.01,0.99\} . Even though it technically satisfies (strict) positivity, these extreme values of the propensity makes the adjustment for \mathbf{W} a challenging task. For each dataset, the adjusted mean \chi_{1} (conditional on \beta_{Y} ) was considered as the target parameter, and the ground truth was numerically computed as the sample mean of 10^{7} observations of h(1,\mathbf{W}^{\top}\beta_{Y}) . 4.5.1.2 Simulation estimators This section contains an overview of the estimators used in the simulation. For a complete description see Section 4 in the supplementary material. Two settings were considered for outcome regression (OR): • Linear : Ordinary Least Squares (OLS). • Neural network : A feedforward neural network with two hidden layers: a linear layer with one neuron, followed by a fully connected ReLU-layer with 100 neurons. The first layer is a linear bottleneck that enforces the single-index model, and we denote the weights by \theta\in\real^{d} . An illustration of the architecture can be found in the supplementary Section 4 . For a further discussion of leaning single-and multiple-index models with neural networks, see Parkinson et al. (2023) and references therein. For propensity score estimation, logistic regression was used across all settings. A ReLU-network with one hidden layer with 100 neurons was also considered for estimation of the propensity score, but it did not enhance the performance of the resulting ATE estimators in this setting. Random forests and other methods were also initially used for both outcome regression and propensity score estimation. They were subsequently excluded because they did not seem to yield any noteworthy insights beyond what was observed for the methods above. For each outcome regression, two implementations were explored: a stratified regression where Y is regressed onto \mathbf{W} separately for each stratum T=1 and T=2 , and a joint regression where Y is regressed onto (T,\mathbf{W}) simultaneously. In the case of joint regression, the neural network architecture represents the regression function as a single index model, given by Y=h(\alpha T+\theta^{\top}\mathbf{W})+\varepsilon_{Y} . This representation differs from the description of the regression function specified in the sample scheme ( 4.5.19 ), which allows for a more complex interaction between treatment and the index of the covariates. In this sense, the joint regression is misspecified. Based on these methods for nuisance estimation, we considered the following estimators of the adjusted mean: • The regression estimator \widehat{\chi}_{1}^{\mathrm{reg}}\coloneq\mathbb{P}_{n}[\widehat{g}(1,\mathbf{W})] . • The AIPW estimator given in Equation ( 4.4.10 ). • The DOPE from Algorithm 1 , where \mathbf{Z}_{\hat{\theta}}=\mathbf{W}^{\top}\hat{\theta} and where \hat{\theta} contains the weights of the first layer of the neural network designed for single-index regression. We refer to this estimator as the DOPE-IDX. • The DOPE-BCL described in Remark 6 , where the propensity score is based on the final outcome regression. See also Benkeser et al. (2020, App. D) . We considered two versions of each DOPE estimator: one without sample splitting and another using 4-fold cross-fitting 8 8 8 consistent with Rem. 3.1. in Chernozhukov et al. (2018) , which recommends using 4 or 5 folds for cross-fitting. . For the latter, the final empirical mean is calculated based on the hold-out fold, while the nuisance parameters are fitted using the remaining three folds. For each fold k=1,\ldots,4 , this means employing Algorithm 1 with \mathcal{I}_{1}=\mathcal{I}_{2}=[n]\setminus J_{k} and \mathcal{I}_{3}=J_{k} . The two versions showed comparable performance for larger samples. In this section we only present the results for the DOPE without sample splitting, which performed better overall in our simulations. However, a comparison with the cross-fitted version can be found in Section 4 in the supplement. Numerical results for the IPW estimator \widehat{\chi}_{1}^{\mathrm{ipw}}\coloneq\mathbb{P}_{n}[\mathbbl{1}(T=t)Y/\widehat{m}(1\,|\,\mathbf{W})] were also gathered. It performed poorly in our settings, and we have omitted the results for the sake of clarity in the presentation. 4.5.1.3 Empirical performance of estimators Figure 4.5.3 : Root mean square errors for various estimators of \chi_{1} plotted against sample size. Each data point is an average over 900 datasets, 300 for each choice of d\in\{4,12,36\} . The bands around each line correspond to \pm 1 standard error. For this plot, the outcome regression (OR) was fitted separately for each stratum T=1 and T=2 . The results for stratified outcome regression are shown in Figure 4.5.3 . Each panel, corresponding to a link function in ( 4.5.1.1 ), displays the RMSE for various estimators against sample size. Across different values of d\in\{4,12,36\} , the results remain consistent, and thus the RMSE is averaged over the 3\times 300 datasets with varying d . In the upper left panel, where the link is linear, the regression estimator \widehat{\chi}_{1}^{\mathrm{reg}} with OLS performs best as expected. The remaining estimators exhibit similar performance, except for AIPW, which consistently performs poorly across all settings. This can be attributed to extreme values of the propensity score, resulting in a large efficiency bound for AIPW. All estimators seem to maintain an approximate \sqrt{n} -consistent RMSE for the linear link as anticipated. For the nonlinear links, we observe that the OLS-based regression estimators perform poorly and do not exhibit approximate \sqrt{n} -consistency. For the sine link, the RMSEs for all OLS-based estimators are large, and they are not shown for ease of visualization. For neural network outcome regression, the AIPW still performs the worst across all nonlinear links. The regression estimator and the DOPE estimators share similar performance when used with the neural network, with DOPE-IDX being more accurate overall. Since the neural network architecture is tailored to the single-index model, it is not surprising that the outcome regression works well, and as a result there is less need for debiasing. On the other hand, the debiasing introduced in the DOPE does not hurt the accuracy, and in fact, improves it in this setting. Figure 4.5.4 : Root mean square errors for various estimators of \chi_{1} plotted against sample size. Each data point is an average over 900 datasets, 300 for each choice of d\in\{4,12,36\} . The bands around each line correspond to \pm 1 standard error. For this plot, the outcome regression (OR) was fitted jointly onto (T,\mathbf{W}) . The results for joint regression of Y on (T,\mathbf{W}) are shown in Figure 4.5.4 . The results for the OLS-based estimators provide similar insights as previously discussed, so we focus on the results for the neural network based estimators. The jointly trained neural network is, in a sense, misspecified for the single-index model (except for the linear link), as discussed in Section 4.5.1.2 . Thus it is not surprising that the regression estimator fails to adjust effectively for larger sample sizes. What is somewhat unexpected, however, is that the precision of DOPE, especially the DOPE-IDX, does not appear to be compromised by the misspecified outcome regression. In fact, the DOPE-IDX even seems to perform better with joint outcome regression. We suspect that this could be attributed to the joint regression producing more robust predictions for the rare treated subjects with W^{1}\leq 0.5 , for which m(1\,|\,\mathbf{W})=0.01 . The predictions are more robust since the joint regression can leverage some of the information from the many untreated subjects with W^{1}\leq 0.5 at the cost of introducing systematic bias, which the DOPE-IDX deals with in the debiasing step. While this phenomenon is interesting, a thorough exploration of its exact details, both numerically and theoretically, is a task we believe is better suited for future research. In summary, the DOPE serves as a middle ground between the regression estimator and the AIPW. It provides an additional safeguard against biased outcome regression, all while avoiding the potential numerical instability entailed by using standard inverse propensity weights. 4.5.1.4 Inference We now consider approximate confidence intervals obtained from the empirical variance estimator \widehat{\mathcal{V}} defined in ( 4.4.17 ). Specifically, we consider intervals of the form \widehat{\chi}_{1}\pm\frac{z_{0.975}}{\sqrt{n}}\widehat{\mathcal{V}}^{-1/2} , where z_{0.975} is the 0.975 quantile of the standard normal distribution. Figure 4.5.5 : Coverage of asymptotic confidence intervals of the adjusted mean \chi_{1} , aggregated over d\in\{4,12,36\} and with the true \beta given in ( 4.5.19 ). Figure 4.5.5 shows the empirical coverage of \chi_{1} for the AIPW, DOPE-BCL and DOPE-IDX, all based on neural network outcome regression fitted jointly. Based on the number of repetitions, we can expect the estimated coverage probabilities to be accurate up to \pm 0.01 after rounding. The left column shows the results for no sample splitting, whereas the right column shows the results for 4-fold cross-fitting. For all estimators, cross-fitting seems to improve coverage slightly for large sample sizes. The AIPW is a little anti-conservative, especially for the links h_{\text{sin}} and h_{\text{cbrt}} , but overall maintains approximate coverage. The slight miscoverage is to be expected given the challenging nature with the extreme propensity weights. For the DOPE-BCL and DOPE-IDX, the coverage probabilities are worse, but with the DOPE-IDX having better coverage overall. According to our asymptotic analysis, specifically Theorem 4.4.1 , the DOPE-BCL and DOPE-IDX intervals will only achieve asymptotic 95\% coverage of the random parameters \chi_{1}(\widehat{h}(t,\mathbf{Z}_{\hat{\theta}})) and \chi_{1}(\mathbf{Z}_{\hat{\theta}}) , respectively. Thus we do not anticipate these intervals to asymptotically achieve the nominal 95\% coverage of \chi_{1} . However, we show in Figure 4.B.3 in the supplementary Section 4 that the average widths of the confidence intervals are significantly smaller for the DOPE intervals than the AIPW interval. Hence it is possible that the DOPE intervals can be corrected – as we have also discussed in Remark 7 – to gain advantage over the AIPW interval, but we leave such explorations for future work. In summary, the lack of full coverage for the naively constructed intervals are consistent with the asymptotic analysis conditionally on a representation \mathbf{Z}_{\hat{\theta}} . In view of this, our asymptotic results might be more realistic and pragmatic than the previously studied regime ( Benkeser et al., 2020 ; Ju et al., 2020 ) , which assumes fast unconditional rates of the nuisance parameters (\widehat{m}_{\hat{\theta}},\widehat{g}_{\hat{\theta}}) . 4.5.2 Application to NHANES data We consider the mortality dataset collected by the National Health and Nutrition Examination Survey I Epidemiologic Followup Study ( Cox et al., 1997 ) , henceforth referred to as the NHANES dataset. The dataset was initially collected as in Lundberg et al. (2020) 9 9 9 See https://github.com/suinleelab/treeexplainer-study for their GitHub repository. . The dataset contains several baseline covariates, and our outcome variable is the indicator of death at the end of study. To deal with missing values, we considered both a complete mean imputation as in Lundberg et al. (2020) , or a trimmed dataset where covariates with more than 50\% of their values missing are dropped and the rest are mean imputed. The latter approach reduces the number of covariates from 79 to 65 . The final results were similar for the two imputation methods, so we only report the results for the mean imputed dataset here. In the supplementary Section 4 we show the results for the trimmed dataset. The primary aim of this section is to evaluate the different estimation methodologies on a realistic and real data example. For this purpose we consider a treatment variable based on pulse pressure and study its effect on mortality. Pulse pressure is defined as the difference between systolic and diastolic blood pressure (BP). High pulse pressure is not only used as an indicator of disease but is also reported to increase the risk of cardiovascular diseases ( Franklin et al., 1999 ) . We investigate the added effect of high pulse pressure when adjusting for other baseline covariates, in particular systolic BP and levels of white blood cells, hemoglobin, hematocrit, and platelets. We do not adjust for diastolic BP, as it determines the pulse pressure when combined with systolic BP, which would therefore lead to a violation of positivity. Figure 4.5.6 : Distribution of estimated propensity scores based on the full covariate set \mathbf{W} , the single-index \mathbf{W}^{\top}\hat{\theta} , and the outcome predictions \widehat{g}(1,\mathbf{W}) , respectively. A pulse pressure of 40 mmHg is considered normal, and as the pressure increases past 50 mmHg, the risk of cardiovascular diseases is reported to increase. Some studies have used 60 mmHg as the threshold for high pulse pressure ( Homan et al., 2024 ) , and thus we consider the following treatment variable corresponding to high pulse pressure: \displaystyle T=\mathbbl{1}\left(\textrm{pulse pressure}>60\textrm{ mmHg}\right). For the binary outcome regression we consider logistic regression and a variant of the neural network from Section 4.5.1.2 with an additional ‘sigmoid-activation’ on the output layer. Based on 5-fold cross-validation, logistic regression yields a log-loss of 0.50 , whereas the neural network yields a log-loss of 0.48 (smaller is better). Figure 4.5.6 shows the distribution of the estimated propensity scores used in the AIPW, DOPE-IDX, and DOPE-BCL, based on neural network regression. As expected, we see that the full covariate set yields propensity scores that essentially violate positivity, with this effect being less pronounced for DOPE-IDX and even less so for DOPE-BCL, where the scores are comparatively less extreme. Estimator Estimate BS se BS CI Regr. (NN) 0.022 0.009 (0.004, 0.037) Naive contrast 0.388 0.010 (0.369, 0.407) Regr. (Logistic) 0.026 0.010 (0.012, 0.049) DOPE-BCL (Logistic) 0.023 0.010 (0.003, 0.040) DOPE-BCL (NN) 0.021 0.010 (0.001, 0.039) DOPE-IDX (NN) 0.024 0.012 (0.002, 0.048) AIPW (NN) 0.023 0.015 (-0.009, 0.051) AIPW (Logistic) 0.026 0.015 (-0.004, 0.056) IPW (Logistic) -0.040 0.025 (-0.103, -0.006) Table 4.5.1 : Adjusted effect estimates of unhealthy pulse pressure on mortality based on NHANES dataset. Estimators are sorted in increasing order after bootstrap (BS) standard error. Table 4.5.1 shows the estimated treatment effects \widehat{\Delta}=\widehat{\chi}_{1}-\widehat{\chi}_{0} for various estimators together with 95\% bootstrap confidence intervals. The estimators are sorted according to bootstrap variance based on B=1000 bootstraps. Because we do not know the true effect, we cannot directly decide which estimator is best. The naive contrast provides a substantially larger estimate than all of the adjustment estimators, which indicates that the added effect of high pulse pressure on mortality when adjusting is different from the unadjusted effect. The IPW estimator, \widehat{\chi}_{1}^{\mathrm{ipw}} , is the only estimator to yield a negative estimate of the adjusted effect, and its bootstrap variance is also significantly larger than the other estimators. Thus it is plausible, that the IPW estimator fails to adjust appropriately. This is not surprising given extreme distribution of the propensity weights, as shown in blue in Figure 4.5.6 . The remaining estimators yield comparable estimates of the adjusted effect, with the logistic regression based estimators having a marginally larger estimates than their neural network counterparts. The (bootstrap) standard errors are comparable for the DOPE and regression estimators, but the AIPW estimators have slightly larger standard errors. As a result, the added effect of high pulse pressure on mortality cannot be considered statistically significant for the AIPW estimators, whereas it can for the other estimators. In summary, the results indicate that the choice treatment effect estimator impacts the final estimate and confidence interval. While it is uncertain which estimator is superior for this particular application, the DOPE estimators seem to offer a reasonable and stable estimate. 4.6 Discussion In this paper, we address challenges posed by complex data with unknown underlying structure, an increasingly common scenario in observational studies. Specifically, we have formulated a refined and general formalism for studying efficiency of covariate adjustment. This formalism extends and builds upon the efficiency principles derived from causal graphical models, in particular results provided by Rotnitzky and Smucler (2020) . Our theoretical framework has led to the identification of the optimal covariate information for adjustment. From this theoretical groundwork, we introduced the DOPE for general estimation of the ATE with increased efficiency. Several key areas within this research merit further investigation: Extension to other targets and causal effects : Our focus has predominantly been on the adjusted mean \chi_{t}=\mathbb{E}[\mathbb{E}[Y\,|\,T=t,\mathbf{W}]] . However, the extension of our methodologies to continuous treatments, instrumental variables, or other causal effects, such as the average treatment effect among the treated, is an area that warrants in-depth exploration. We suspect that many of the fundamental ideas can be modified to prove analogous results for such target parameters. Beyond neural networks : While our examples and simulation study has applied the DOPE with neural networks, its compatibility with other regression methods such as kernel regression and gradient boosting opens new avenues for alternative adjustment estimators. Investigating such estimators can provide practical insights and broaden the applicability of our approach. The Outcome Highly Adapted Lasso ( Ju et al., 2020 ) is a similar method in this direction that leverages the Highly Adaptive Lasso ( Benkeser and van der Laan, 2016 ) for robust treatment effect estimation. Causal representation learning integration : Another possible direction for future research is the integration of our efficiency analysis into the broader concept of causal representation learning ( Schölkopf et al., 2021 ) . This line of research, which is not concerned with specific downstream tasks, could potentially benefit from some of the insights of our efficiency analysis and the DOPE framework. Implications of sample splitting : Our current asymptotic analysis relies on the implementation of three distinct sample splits. Yet, our simulation results suggest that sample splitting might not be necessary. Using the notation of Algorithm 1 , we hypothesize that the independence assumption \mathcal{I}_{3}\cap(\mathcal{I}_{1}\cup\mathcal{I}_{2})=\emptyset could be replaced with Donsker class conditions. However, the theoretical justifications for setting \mathcal{I}_{1} identical to \mathcal{I}_{2} are not as evident, thus meriting additional exploration into this potential simplification. Valid and efficient confidence intervals : The naive confidence intervals explored in the simulation study, cf. Section 4.5.1.4 , do not provide an adequate coverage of the unconditional adjusted mean. As indicated in Remark 7 , it would be interesting to explore methods for correcting the intervals, for example by: (i) adding a bias correction, (ii) constructing a consistent estimator of the unconditional variance, or (iii) using bootstrapping. Appealing to bootstrapping techniques, however, might be computationally expensive, in particular when combined with cross-fitting. To implement (i), one approach could be to generalize Theorem 4.4.4 to establish general differentiability of the adjusted mean with respect to general representations, and then construct an estimator of the gradient. However, one must asses whether this bias correction could negate the efficiency benefits of the DOPE. Supplement to ‘Efficient adjustment for complex covariates: Gaining efficiency with DOPE’ The supplementary material is organized as follows: Section 4 contains proofs of the results in the main text and a few auxiliary results; Section 4 contains details on the experiments in Section 4.5 ; and Section 4 contains a description of the cross-fitting algorithm. 4.A. Auxiliary results and proofs The proposition below relaxes the criteria for being a valid adjustment set in a causal graphical model. It follows from the results of Perković et al. (2018) , which was pointed out to the authors by Leonard Henckel, and is stated here for completeness. Proposition 4.A.1 . Let T,\mathbf{Z} , and Y be pairwise disjoint node sets in a DAG \mathcal{D}=(\mathbf{V},\mathbf{E}) , and let \mathcal{M}(\mathcal{D}) denote the collection of continuous distributions that are Markovian with respect to \mathcal{D} and with \mathbb{E}|Y|<\infty . Then \mathbf{Z} is an adjustment set relative to (T,Y) if and only if for all P\in\mathcal{M}(\mathcal{D}) and all t \displaystyle\mathbb{E}_{P}[Y\,|\,\mathrm{do}(T=t)]=\mathbb{E}_{P}\left[\frac{\mathbbl{1}(T=t)Y}{\mathbb{P}_{P}(T=t\,|\,\mathrm{pa}_{\mathcal{D}}(T))}\right]=\mathbb{E}_{P}[\mathbb{E}_{P}[Y\,|\,T=t,\mathbf{Z}]] Proof. The ‘only if’ direction is straightforward if we use an alternative characterization of \mathbf{Z} being an adjustment set: for any density p of a distribution P\in\mathcal{P} it holds that p(y\,|\,\mathrm{do}(T=t))=\int p(\mathbf{y}|\mathbf{z},t)p(\mathbf{z})\mathrm{d}\mathbf{z}, where the ‘do-operator’ (and notation) is defined as in, e.g., Peters et al. (2017) . Fubini’s theorem then yields \displaystyle\mathbb{E}_{P}[Y\,|\,\mathrm{do}(T=t)] \displaystyle=\int_{\real{}^{l}}\mathbf{y}p(\mathbf{y}|do(\mathbf{T}=\mathbf{t}))\mathrm{d}\mathbf{y} \displaystyle=\int_{\real{}^{l}}\mathbf{y}\int_{\real{}^{k}}p(\mathbf{y}|\mathbf{z},t)p(\mathbf{z})\mathrm{d}\mathbf{z}\mathrm{d}\mathbf{y} \displaystyle=\int_{\real{}^{k}}\int_{\real{}^{l}}\mathbf{y}p(\mathbf{y}|\mathbf{z},t)\mathrm{d}\mathbf{y}p(\mathbf{z})\mathrm{d}\mathbf{z} \displaystyle=\mathbb{E}_{P}[\mathbb{E}_{P}[Y\,|\,T=t,\mathbf{Z}]], which is equivalent to the ‘only if’ part. On the contrary, assume that \mathbf{Z} is not an adjustment set for (T,Y) . Then Theorem 56 and the proof of Theorem 57 in Perković et al. (2018) imply the existence of a Gaussian distribution \tilde{P}\in\mathcal{P} for which \displaystyle\mathbb{E}_{\tilde{P}}[Y\,|\,\mathrm{do}(T=1)]\neq\mathbb{E}_{\tilde{P}}[\mathbb{E}_{\tilde{P}}[Y\,|\,T=1,\mathbf{Z}]] This implies the other direction. ∎ The following lemma is a generalization of Lemma 27 in Rotnitzky and Smucler (2020) . Lemma 4.A.2 . For any \sigma -algebras \mathcal{Z}_{1}\subseteq\mathcal{Z}_{2}\subseteq\sigma(\mathbf{W}) it holds, under Assumption 4.1.1 , that \mathbb{E}_{P}\left[\pi_{t}(\mathcal{Z}_{2};P)^{-1}\,|\,T=t,\mathcal{Z}_{1}\right]=\pi_{t}(\mathcal{Z}_{1};P)^{-1} for all P\in\mathcal{P} . Proof. Direct computation yields \displaystyle\mathbb{E}_{P}\left[\pi_{t}(\mathcal{Z}_{2};P)^{-1}\,|\,T=t,\mathcal{Z}_{1}\right]\mathbb{P}_{P}(T=t\,|\,\mathcal{Z}_{1}) \displaystyle=\mathbb{E}_{P}\left[\frac{\mathbbl{1}(T=t)}{\pi_{t}(\mathcal{Z}_{2};P)}\,|\,\mathcal{Z}_{1}\right]=\mathbb{E}_{P}\left[\frac{\mathbb{E}_{P}[\mathbbl{1}(T=t)\,|\,\mathcal{Z}_{2}]}{\pi_{t}(\mathcal{Z}_{2};P)}\,|\,\mathcal{Z}_{1}\right]=1. ∎ 4.A.1 Proof of Lemma 4.3.1 Since P\in\mathcal{P} is fixed, we suppress it from the notation in the following computations. From Y\,\perp\!\!\!\perp\,\mathcal{Z}_{2}\,|\,\mathcal{Z}_{1},T and \mathcal{Z}_{1}\subseteq\mathcal{Z}_{2} , it follows that \mathbb{E}[Y\,|\,\mathcal{Z}_{1},T]=\mathbb{E}[Y\,|\,\mathcal{Z}_{2},T] . Hence, for each t\in\mathbb{T} , b_{t}(\mathcal{Z}_{1})=\mathbb{E}[Y\,|\,\mathcal{Z}_{1},T=t]=\mathbb{E}[Y\,|\,\mathcal{Z}_{2},T=t]=b_{t}(\mathcal{Z}_{2}). (4.A.1) Therefore \chi_{t}(\mathcal{Z}_{1})=\mathbb{E}[b_{t}(\mathcal{Z}_{1})]=\mathbb{E}[b_{t}(\mathcal{Z}_{2})]=\chi_{t}(\mathcal{Z}_{2}) . If \mathcal{Z}_{2} is description of \mathbf{W} , this identity shows that \mathcal{Z}_{2} is \mathcal{P} -valid if and only if \mathcal{Z}_{1} is \mathcal{P} -valid. To compare the asymptotic efficiency bounds for \mathcal{Z}_{2} with \mathcal{Z}_{1} we use the law of total variance. Note first that \displaystyle\mathbb{E}[\psi_{t}(\mathcal{Z}_{2})\,|\,T,Y,\mathcal{Z}_{1}] \displaystyle=\mathbb{E}\Big[\mathbbl{1}(T=t)(Y-b_{t}(\mathcal{Z}_{2}))\frac{1}{\pi_{t}(\mathcal{Z}_{2})}+b_{t}(\mathcal{Z}_{2})-\chi_{t}\,|\,T,Y,\mathcal{Z}_{1}\Big] \displaystyle=\mathbbl{1}(T=t)(Y-b_{t}(\mathcal{Z}_{1}))\,\mathbb{E}\Big[\frac{1}{\pi_{t}(\mathcal{Z}_{2})}\,|\,T=t,Y,\mathcal{Z}_{1}\Big]+b_{t}(\mathcal{Z}_{1})-\chi_{t} \displaystyle=\mathbbl{1}(T=t)(Y-b_{t}(\mathcal{Z}_{1}))\mathbb{E}\left[\frac{1}{\pi_{t}(\mathcal{Z}_{2})}\,|\,T=t,\mathcal{Z}_{1}\right]+b_{t}(\mathcal{Z}_{1})-\chi_{t} \displaystyle=\mathbbl{1}(T=t)(Y-b_{t}(\mathcal{Z}_{1}))\frac{1}{\pi_{t}(\mathcal{Z}_{1})}+b_{t}(\mathcal{Z}_{1})-\chi_{t}=\psi_{t}(\mathcal{Z}_{1}). Second equality is due to \mathcal{Z}_{1} -measurability and ( 4.A.1 ), whereas the third equality follows from Y\,\perp\!\!\!\perp\,\mathcal{Z}_{2}\,|\,\mathcal{Z}_{1},T and the last inequality is due to Lemma 4.A.2 . On the other hand, \displaystyle\phantom{=}\mathbb{E}\big[\var(\psi_{t}(\mathcal{Z}_{2})\,|\,T,Y,\mathcal{Z}_{1})\big] \displaystyle=\mathbb{E}\Big[\var\Big(\mathbbl{1}(T=t)(Y-b_{t}(\mathcal{Z}_{1}))\frac{1}{\pi_{t}(\mathcal{Z}_{2})}+b_{t}(\mathcal{Z}_{1})-\chi_{t}(P)\;\big|\;T,Y,\mathcal{Z}_{1}\Big)\Big] \displaystyle=\mathbb{E}\Big[\mathbbl{1}(T=t)(Y-b_{t}(\mathcal{Z}_{1}))^{2}\var\Big(\frac{1}{\pi_{t}(\mathcal{Z}_{2})}\;\big|\;T=t,Y,\mathcal{Z}_{1}\Big)\Big] \displaystyle=\mathbb{E}\Big[\pi_{t}(\mathcal{Z}_{1})\var(Y\,|\,T=t,\mathcal{Z}_{1})\var\Big(\frac{1}{\pi_{t}(\mathcal{Z}_{2})}\;\big|\;T=t,\mathcal{Z}_{1}\Big)\Big]. Combined we have that \displaystyle\mathbb{V}_{t}(\mathcal{Z}_{2}) \displaystyle=\var(\psi_{t}(\mathcal{Z}_{2}))=\var(\mathbb{E}[\psi_{t}(\mathcal{Z}_{2})\,|\,T,Y,\mathcal{Z}_{1}])+\mathbb{E}[\var[\psi_{t}(\mathcal{Z}_{2})\,|\,T,Y,\mathcal{Z}_{1}]] \displaystyle=\mathbb{V}_{t}(\mathcal{Z}_{1})+\mathbb{E}\Big[\pi_{t}(\mathcal{Z}_{1})\var(Y\,|\,T=t,\mathcal{Z}_{1})\var\Big(\frac{1}{\pi_{t}(\mathcal{Z}_{2})}\Big|\;T=t,Y,\mathcal{Z}_{1}\Big)\Big]. To prove the last part of the lemma, we first note that \psi_{t}(\mathcal{Z}_{2}) and \psi_{t^{\prime}}(\mathcal{Z}_{2}) are conditionally uncorrelated for t\neq t^{\prime} . This follows from ( 4.A.1 ), from which the conditional covariance reduces to \displaystyle\cov(\psi_{t}(\mathcal{Z}_{2}),\psi_{t^{\prime}}(\mathcal{Z}_{2})\,|\,T,Y,\mathcal{Z}_{1})=\mathbbl{1}(T=t)\mathbbl{1}(T=t^{\prime})\cov(*,*\,|\,T,Y,\mathcal{Z}_{1})=0. Thus, letting \psi(\mathcal{Z}_{2})=(\psi_{t}(\mathcal{Z}_{2}))_{t\in\mathbb{T}} and using the computation for \mathbb{V}_{t} , we obtain that: \displaystyle\mathbb{V}_{\Delta}(\mathcal{Z}_{2})=\var(\mathbf{c}^{\top}\psi(\mathcal{Z}_{2})) \displaystyle=\var(\mathbb{E}[\mathbf{c}^{\top}\psi(\mathcal{Z}_{2})\,|\,T,Y,\mathcal{Z}_{1}])+\mathbb{E}[\var[\mathbf{c}^{\top}\psi(\mathcal{Z}_{2})\,|\,T,Y,\mathcal{Z}_{1}]] \displaystyle=\mathbb{V}_{\Delta}(\mathcal{Z}_{1})+\sum_{t\in\mathbb{T}}c_{t}^{2}\,\mathbb{E}\Big[\pi_{t}(\mathcal{Z}_{1})\var(Y\,|\,T=t,\mathcal{Z}_{1})\var\Big(\frac{1}{\pi_{t}(\mathcal{Z}_{2})}\Big|\;T=t,Y,\mathcal{Z}_{1}\Big)\Big]. This concludes the proof. ∎ 4.A.2 Proof of Theorem 4.3.2 (i) Assume that \mathcal{Z}\subseteq\sigma(\mathbf{W}) is a description of \mathbf{W} such that \mathcal{Q}_{P}\subseteq\mkern 2.0mu\overline{\mkern-2.0mu\mathcal{Z}\mkern 0.0mu}\mkern 0.0mu . Observe that almost surely, \mathbb{P}_{P}(Y\leq y\,|\,T,\mathbf{W})=\sum_{t\in\mathbb{T}}\mathbbl{1}(T=t)F(y\mid t,\mathbf{W};P) is \sigma(T,\mathcal{Q}_{P}) -measurable and hence also \sigma(T,\mkern 2.0mu\overline{\mkern-2.0mu\mathcal{Z}\mkern 0.0mu}\mkern 0.0mu) -measurable. It follows that \mathbb{P}_{P}(Y\leq y\,|\,T,\mathbf{W}) is also a version of \mathbb{P}_{P}(Y\leq y\,|\,T,\overline{\mathcal{Z}}) . As a consequence, \mathbb{P}_{P}(Y\leq y\,|\,T,\mathbf{W})=\mathbb{P}_{P}(Y\leq y\,|\,T,\mathcal{Z}) almost surely. From Doob’s characterization of conditional independence ( Kallenberg, 2021 , Theorem 8.9) , we conclude that Y\,{\perp\!\!\!\perp}_{P}\,\mathbf{W}\mid T,\mathcal{Z} , or equivalently that \mathcal{Z} is P -ODS. The ‘in particular’ follows from setting \mathcal{Z}=\mathcal{Q}_{P} . (ii) Assume that \mathcal{Z}\subseteq\sigma(\mathbf{W}) is P -ODS. Using Doob’s characterization of conditional independence again, \mathbb{P}_{P}(Y\leq y\,|\,T,\mathbf{W})=\mathbb{P}_{P}(Y\leq y\,|\,T,\mathcal{Z}) almost surely. Under Assumption 4.1.1 , this entails that F(y\,|\,T=t,\mathbf{W};P)=\mathbb{P}_{P}(Y\leq y\,|\,T=t,\mathcal{Z}) almost surely, and hence F(y\,|\,T=t,\mathbf{W};P) must be \mkern 2.0mu\overline{\mkern-2.0mu\mathcal{Z}\mkern 0.0mu}\mkern 0.0mu -measurable. As the generators of \mathcal{Q}_{P} are \mkern 2.0mu\overline{\mkern-2.0mu\mathcal{Z}\mkern 0.0mu}\mkern 0.0mu -measurable, we conclude that \mathcal{Q}_{P}\subseteq\mkern 2.0mu\overline{\mkern-2.0mu\mathcal{Z}\mkern 0.0mu}\mkern 0.0mu . (iii) Let \mathcal{Z} be a P -ODS description. From (i) and (ii) it follows that \mathcal{Q}_{P}\subseteq\mkern 2.0mu\overline{\mkern-2.0mu\mathcal{Z}\mkern 0.0mu}\mkern 0.0mu , and since \mathcal{Z}\subseteq\sigma(\mathbf{W}) it also holds that Y\,{\perp\!\!\!\perp}_{P}\,\mkern 2.0mu\overline{\mkern-2.0mu\mathcal{Z}\mkern 0.0mu}\mkern 0.0mu\mid T,\mathcal{Q}_{P} . Since \mathbb{V}_{\Delta}(\mathcal{Z};P)=\mathbb{V}_{\Delta}(\mkern 2.0mu\overline{\mkern-2.0mu\mathcal{Z}\mkern 0.0mu}\mkern 0.0mu;P) , Lemma 4.3.1 gives the desired conclusion. ∎ 4.A.3 Proof of Corollary 4.3.3 Theorem 4.3.2 (i,ii) implies that \mathcal{Z} is \mathcal{P} -ODS if and only if \mkern 2.0mu\overline{\mkern-2.0mu\mathcal{Z}\mkern 0.0mu}\mkern 0.0mu^{P} contains \mathcal{Q}_{P} for all P\in\mathcal{P} . If \mathcal{Q}\subseteq\mkern 2.0mu\overline{\mkern-2.0mu\mathcal{Z}\mkern 0.0mu}\mkern 0.0mu^{P} for all P\in\mathcal{P} then \mathcal{Q}_{P}\subseteq\mkern 2.0mu\overline{\mkern-2.0mu\mathcal{Z}\mkern 0.0mu}\mkern 0.0mu^{P} for all P\in\mathcal{P} by definition, and \mathcal{Z} is \mathcal{P} -ODS. Equation ( 4.3.9 ) follows from the same argument as Theorem 4.3.2 (iii) . That is, \mathcal{Q}\subseteq\mkern 2.0mu\overline{\mkern-2.0mu\mathcal{Z}\mkern 0.0mu}\mkern 0.0mu^{P} , and since \mathcal{Q} is P -ODS and \mathcal{Z}\subseteq\sigma(\mathbf{W}) we have Y\,{\perp\!\!\!\perp}_{P}\,\mkern 2.0mu\overline{\mkern-2.0mu\mathcal{Z}\mkern 0.0mu}\mkern 0.0mu^{P}\mid T,\mathcal{Q} . Lemma 4.3.1 can be applied for each P\in\mathcal{P} to obtain the desired conclusion. ∎ 4.A.4 Proof of Proposition 4.3.4 Since \mathcal{R}_{P}\subseteq\mathcal{Q}_{P} always holds, so it suffices to prove that \mathcal{Q}_{P}\subseteq\mathcal{R}_{P} . If F(y\,|\,t,\mathbf{W};P) is \sigma(b_{t}(\mathbf{W};P)) -measurable, then \mathcal{Q}_{P}\subseteq\mathcal{R}_{P} follows directly from definition. If Y is a binary outcome, then the conditional distribution is determined by the conditional mean, i.e., F(y\,|\,t,\mathbf{W};P) is \sigma(b_{t}(\mathbf{W};P)) -measurable. If Y=b_{T}(\mathbf{W})+\varepsilon_{Y} with \varepsilon_{Y}\,\perp\!\!\!\perp\,T,\mathbf{W} , then F(y\,|\,t,\mathbf{w};P)=F_{P}(y-b_{t}(\mathbf{w})) where F_{P} is the distribution function for the distribution of \varepsilon_{Y} . Again, F(y\,|\,t,\mathbf{W};P) becomes \sigma(b_{t}(\mathbf{W};P)) -measurable. To prove the last part, let \mathcal{Z} be a P -OMS description. Since b_{t}(\mathbf{W};P)=b_{t}(\mathcal{Z};P) is \mathcal{Z} -measurable for every t\in\mathbb{T} , it follows that \mathcal{R}_{P}\subseteq\mkern 2.0mu\overline{\mkern-2.0mu\mathcal{Z}\mkern 0.0mu}\mkern 0.0mu . Hence the argument of Theorem 4.3.2 (iii) establishes Equation ( 4.3.8 ) when \mathcal{Q}_{P}=\mathcal{R}_{P} . ∎ 4.A.5 Proof of Lemma 4.3.5 Since P\in\mathcal{P} is fixed throughout this proof, we suppress it from notation. From \mathcal{Z}_{1}\subseteq\mathcal{Z}_{2}\subseteq\sigma(\mathbf{W}) and T\,{\perp\!\!\!\perp}_{P}\,\mathcal{Z}_{2}\,|\,\mathcal{Z}_{1} , it follows that \pi_{t}(\mathcal{Z}_{1})=\pi_{t}(\mathcal{Z}_{1}) , and hence \chi_{t}(\mathcal{Z}_{1})=\mathbb{E}[\pi_{t}(\mathcal{Z}_{1})^{-1}\mathbbl{1}(T=t)Y]=\mathbb{E}[\pi_{t}(\mathcal{Z}_{2})^{-1}\mathbbl{1}(T=t)Y]=\chi_{t}(\mathcal{Z}_{2}). This establishes the first part. For the second part, we use that \pi_{t}(\mathcal{Z}_{1})=\pi_{t}(\mathcal{Z}_{2}) and \chi_{t}(\mathcal{Z}_{1})=\chi_{t}(\mathcal{Z}_{2}) to see that \displaystyle\psi_{t}(\mathcal{Z}_{1})-\psi_{t}(\mathcal{Z}_{2}) \displaystyle=b_{t}(\mathcal{Z}_{1})-b_{t}(\mathcal{Z}_{2})+\frac{\mathbbl{1}(T=t)}{\pi_{t}(\mathcal{Z}_{2})}(b_{t}(\mathcal{Z}_{2})-b_{t}(\mathcal{Z}_{1})) \displaystyle=\Big(\frac{\mathbbl{1}(T=t)}{\pi_{t}(\mathcal{Z}_{2})}-1\Big)(b_{t}(\mathcal{Z}_{2})-b_{t}(\mathcal{Z}_{1}))\eqcolon R_{t}(\mathcal{Z}_{1},\mathcal{Z}_{2}). Since \mathbb{E}[R_{t}(\mathcal{Z}_{1},\mathcal{Z}_{2})\,|\,\mathcal{Z}_{2}]=0 we have that \mathbb{E}[\psi_{t}(\mathcal{Z}_{2})R_{t}(\mathcal{Z}_{1},\mathcal{Z}_{2})]=0 , which means that \psi_{t}(\mathcal{Z}_{2}) and R_{t}(\mathcal{Z}_{1},\mathcal{Z}_{2}) are uncorrelated. Note that from \pi_{t}(\mathcal{Z}_{1})=\pi_{t}(\mathcal{Z}_{2}) it also follows that \displaystyle b_{t}(\mathcal{Z}_{1})=\mathbb{E}\Big[\frac{Y\mathbbl{1}(T=t)}{\pi_{t}(\mathcal{Z}_{1})}\,|\,\mathcal{Z}_{1}\Big]=\mathbb{E}\Big[\mathbb{E}\Big[\frac{Y\mathbbl{1}(T=t)}{\pi_{t}(\mathcal{Z}_{2})}\,|\,\mathcal{Z}_{2}\Big]\,|\,\mathcal{Z}_{1}\Big]=\mathbb{E}[b_{t}(\mathcal{Z}_{2})\,|\,\mathcal{Z}_{1}] This means that \mathbb{E}[(b_{t}(\mathcal{Z}_{2})-b_{t}(\mathcal{Z}_{1}))^{2}\,|\,\mathcal{Z}_{1}]=\var(b_{t}(\mathcal{Z}_{2})\,|\,\mathcal{Z}_{1}) . These observations let us compute that \displaystyle\mathbb{V}_{t}(\mathcal{Z}_{1}) \displaystyle=\var(\psi_{t}(\mathcal{Z}_{1})) \displaystyle=\var(\psi_{t}(\mathcal{Z}_{2}))+\var\left(R_{t}(\mathcal{Z}_{1},\mathcal{Z}_{2})\right) \displaystyle=\var(\psi_{t}(\mathcal{Z}_{2}))+\mathbb{E}[\mathbb{E}[R_{t}(\mathcal{Z}_{1},\mathcal{Z}_{2})^{2}\,|\,\mathcal{Z}_{2}]] \displaystyle=\mathbb{V}_{t}(\mathcal{Z}_{2})+\mathbb{E}\Big[(b_{t}(\mathcal{Z}_{2})-b_{t}(\mathcal{Z}_{1}))^{2}\mathbb{E}\Big[\frac{\mathbbl{1}(T=t)^{2}}{\pi_{t}(\mathcal{Z}_{1})^{2}}-\frac{2\mathbbl{1}(T=t)}{\pi_{t}(\mathcal{Z}_{1})}+1\,|\,\mathcal{Z}_{2}\Big]\Big] \displaystyle=\mathbb{V}_{t}(\mathcal{Z}_{2})+\mathbb{E}\Big[\var(b_{t}(\mathcal{Z}_{2})\,|\,\mathcal{Z}_{1})\Big(\frac{1}{\pi_{t}(\mathcal{Z}_{1})}-1\Big)\Big]. (4.A.2) This establishes the formula in the case \Delta=\chi_{t} . For general \Delta , note first that \mathbf{R} and (\psi_{t}(\mathcal{Z}_{2}))_{t\in\mathbb{T}} are uncorrelated since \mathbb{E}[\mathbf{R}\,|\,\mathcal{Z}_{2}]=0 . Therefore we have \displaystyle\mathbb{V}_{\!\Delta}(\mathcal{Z}_{1}) \displaystyle=\var\Big(\sum_{t\in\mathbb{T}}c_{t}\psi_{t}(\mathcal{Z}_{1})\Big) \displaystyle=\var\Big(\sum_{t\in\mathbb{T}}c_{t}\psi_{t}(\mathcal{Z}_{2})\Big)+\var\Big(\sum_{t\in\mathbb{T}}c_{t}R_{t}(\mathcal{Z}_{1},\mathcal{Z}_{2})\Big) \displaystyle=\mathbb{V}_{\!\Delta}(\mathcal{Z}_{2})+\mathbf{c}^{\top}\var\Big(\mathbf{R}\Big)\mathbf{c}. It now remains to establish the covariance expressions for the last term, since the expression of \var\left(R_{t}(\mathcal{Z}_{1},\mathcal{Z}_{2})\right) was found in ( 4.A.2 ). To this end, note first that for any s,t\in\mathbb{T} with s\neq t , \displaystyle\mathbb{E}\left[\Big(\frac{\mathbbl{1}(T=s)}{\pi_{s}(\mathcal{Z}_{2})}-1\Big)\Big(\frac{\mathbbl{1}(T=t)}{\pi_{t}(\mathcal{Z}_{2})}-1\Big)\,|\,\mathcal{Z}_{2}\right]=-1. Thus we finally conclude that \displaystyle\cov(R_{s},R_{t}) \displaystyle=-\mathbb{E}\left[(b_{s}(\mathcal{Z}_{2})-b_{s}(\mathcal{Z}_{1}))(b_{t}(\mathcal{Z}_{2})-b_{t}(\mathcal{Z}_{1}))\right] \displaystyle=-\mathbb{E}\left[\cov(b_{s}(\mathcal{Z}_{2}),b_{t}(\mathcal{Z}_{2})\,|\,\mathcal{Z}_{1})\right], as desired. ∎ 4.A.6 Computations for Example 3 Using symmetry, we see that \displaystyle\pi_{1}(\mathbf{Z}) \displaystyle=\mathbb{E}[T\mid\mathbf{Z}]=\mathbb{E}[\mathbf{W}\mid\mathbf{Z}] \displaystyle=(0.5-\mathbf{Z})\mathbb{P}(\mathbf{W}\leq 0.5\,|\,\mathbf{Z})+(0.5+\mathbf{Z})\mathbb{P}(\mathbf{W}>0.5\,|\,\mathbf{Z})\ =\frac{1}{2}. From T\,\perp\!\!\!\perp\,\mathbf{Z} we observe that \displaystyle b_{t}(\mathbf{W}) \displaystyle=t+\mathbb{E}[g(\mathbf{Z})\,|\,T=t,\mathbf{W}]=t+g(\mathbf{Z}), \displaystyle b_{t}(\mathbf{Z}) \displaystyle=t+\mathbb{E}[g(\mathbf{Z})\,|\,T=t,\mathbf{Z}]=t+g(\mathbf{Z}), \displaystyle b_{t}(0) \displaystyle=t+\mathbb{E}[g(\mathbf{Z})\,|\,T=t]=t+\mathbb{E}[g(\mathbf{Z})]. Plugging these expressions into the asymptotic variance yields: \displaystyle\mathbb{V}_{t}(0) \displaystyle=\var\left(b_{t}(0)+\frac{\mathbbl{1}(T=t)}{\pi_{t}(0)}(Y-b_{t}(0))\right) \displaystyle=\pi_{t}(0)^{-2}\var\left(\mathbbl{1}(T=t)(Y-b_{t}(0))\right) \displaystyle=4\mathbb{E}[\mathbbl{1}(T=t)(g(\mathbf{Z})-\mathbb{E}[g(\mathbf{Z})]+v(\mathbf{W})\varepsilon_{Y})^{2}] \displaystyle=4\mathbb{E}[\mathbf{W}(g(\mathbf{Z})-\mathbb{E}[g(\mathbf{Z})])^{2}]+2\mathbb{E}[v(\mathbf{W})\varepsilon_{Y}^{2}] \displaystyle=2\var(g(\mathbf{Z}))+2\mathbb{E}[v(\mathbf{W})^{2}]\mathbb{E}[\varepsilon_{Y}^{2}] \displaystyle\mathbb{V}_{t}(\mathbf{Z}) \displaystyle=\var\left(b_{t}(\mathbf{Z})+\frac{\mathbbl{1}(T=t)}{\pi_{t}(\mathbf{Z})}(Y-b_{t}(\mathbf{Z}))\right) \displaystyle=\var\left(g(\mathbf{Z})+2\mathbbl{1}(T=t)v(\mathbf{W})\varepsilon_{Y}\right) \displaystyle=\var\left(g(\mathbf{Z})\right)+2\mathbb{E}[v(\mathbf{W})^{2}]\mathbb{E}[\varepsilon_{Y}^{2}] \displaystyle\mathbb{V}_{t}(\mathbf{W}) \displaystyle=\var\left(b_{t}(\mathbf{W})+\frac{\mathbbl{1}(T=t)}{\pi_{t}(\mathbf{W})}(Y-b_{t}(\mathbf{W}))\right) \displaystyle=\var\left(g(\mathbf{Z})+\frac{\mathbbl{1}(T=t)v(\mathbf{W})\varepsilon_{Y}}{\mathbf{W}}\right) \displaystyle=\var\left(g(\mathbf{Z})\right)+\mathbb{E}\left[\frac{v(\mathbf{W})^{2}}{\mathbf{W}}\right]\mathbb{E}[\varepsilon_{Y}^{2}]. ∎ Proof of Theorem 4.4.1 We first prove that R_{i}\xrightarrow{P}0 for i=1,2,3 . The third term is taken care of by combining Assumption 4.4.2 (i,iv) with Cauchy-Schwarz: \displaystyle|R_{3}| \displaystyle\leq\sqrt{|\mathcal{I}_{3}|}\sqrt{\frac{1}{|\mathcal{I}_{3}|}\sum_{i\in\mathcal{I}_{3}}\big(\widehat{m}_{\hat{\theta}}(t\,|\,\mathbf{W}_{i})^{-1}-m_{\hat{\theta}}(t\,|\,\mathbf{W}_{i})^{-1}\big)^{2}}\sqrt{\mathcal{E}_{2,t}^{(n)}} \displaystyle\leq\ell_{c}\sqrt{|\mathcal{I}_{3}|\mathcal{E}_{1,t}^{(n)}\mathcal{E}_{2,t}^{(n)}}\xrightarrow{P}0, where \ell_{c}>0 is the Lipschitz constant of x\mapsto x^{-1} on [c,1-c] . For the first term, R_{1} , note that conditionally on \hat{\theta} and the observed estimated representations \mathbf{Z}_{\hat{\bullet}}\coloneq(\mathbf{Z}_{\hat{\theta},i})_{i\in\mathcal{I}_{3}}=(\varphi(\hat{\theta},\mathbf{W}_{i}))_{i\in\mathcal{I}_{3}} , the summands are conditionally i.i.d. due to Assumption 4.4.1 . They are also conditionally mean zero since \displaystyle\mathbb{E}[r_{i}^{1}\,|\,\mathbf{Z}_{\hat{\bullet}},\hat{\theta}\,] \displaystyle=\left(\widehat{g}_{\hat{\theta}}(t,\mathbf{W}_{i})-g_{\hat{\theta}}(t,\mathbf{W}_{i})\right)\Big(1-\frac{\mathbb{E}[\mathbbl{1}(T_{i}=t)\,|\,\mathbf{Z}_{\hat{\bullet}},\hat{\theta}\,]}{m_{\hat{\theta}}(t\,|\,\mathbf{W}_{i})}\Big) \displaystyle=\left(\widehat{g}_{\hat{\theta}}(t,\mathbf{W}_{i})-g_{\hat{\theta}}(t,\mathbf{W}_{i})\right)\Big(1-\frac{\mathbb{E}[\mathbbl{1}(T_{i}=t)\,|\,\mathbf{Z}_{\hat{\theta},i},\hat{\theta}]}{m_{\hat{\theta}}(t\,|\,\mathbf{W}_{i})}\Big)=0, for each i\in\mathcal{I}_{3} . Using Assumption 4.4.2 (i) , we can bound the conditional variance by \displaystyle\var\left(r_{i}^{1}\,|\,\mathbf{Z}_{\hat{\bullet}},\hat{\theta}\,\right) \displaystyle=\frac{\left(\widehat{g}_{\hat{\theta}}(t,\mathbf{W}_{i})-g_{\hat{\theta}}(t,\mathbf{W}_{i})\right)^{2}}{m_{\hat{\theta}}(t\,|\,\mathbf{W})^{2}}\var\left(\mathbbl{1}(T=t)\,|\,\mathbf{Z}_{\hat{\bullet}},\hat{\theta}\right) \displaystyle=\frac{\left(\widehat{g}_{\hat{\theta}}(t,\mathbf{W}_{i})-g_{\hat{\theta}}(t,\mathbf{W}_{i})\right)^{2}}{m_{\hat{\theta}}(t\,|\,\mathbf{W})}(1-m_{\hat{\theta}}(t\,|\,\mathbf{W})) \displaystyle\leq\frac{(1-c)}{c}\left(\widehat{g}_{\hat{\theta}}(t,\mathbf{W}_{i})-g_{\hat{\theta}}(t,\mathbf{W}_{i})\right)^{2} Now it follows from Assumption 4.4.2 (v) and the conditional Chebyshev’s inequality that \displaystyle\mathbb{P}\left(|R_{1}|>\epsilon\,|\,\mathbf{Z}_{\hat{\bullet}},\hat{\theta}\,\right) \displaystyle\leq\epsilon^{-2}\var(R_{1}\,|\,\mathbf{Z}_{\hat{\bullet}},\hat{\theta})\leq\frac{1-c}{\epsilon^{2}c}\mathcal{E}_{2,t}^{(n)}\xrightarrow{P}0, from which we conclude that R_{1}\xrightarrow{P}0 . The analysis of R_{2} is similar. Observe that the summands are conditionally i.i.d. given \mathbf{Z}_{\hat{\bullet}},\hat{\theta} , and T_{\bullet}\coloneq(T_{i})_{i\in\mathcal{I}_{3}} . They are also conditionally mean zero since \displaystyle\mathbb{E}\left[r_{i}^{2}\,|\,\mathbf{Z}_{\hat{\bullet}},T_{\bullet},\hat{\theta}\right] \displaystyle=\left(\mathbb{E}[Y_{i}\,|\,\mathbf{Z}_{\hat{\bullet}},T_{\bullet},\hat{\theta}]-g_{\hat{\theta}}(t,\mathbf{W}_{i})\right)\left(\frac{\mathbbl{1}(T_{i}=t)}{\widehat{m}_{\hat{\theta}}(\mathbf{W}_{i})}-\frac{\mathbbl{1}(T_{i}=t)}{m_{\hat{\theta}}(\mathbf{W}_{i})}\right) \displaystyle=(\mathbb{E}[Y_{i}\,|\,\varphi(\hat{\theta},\mathbf{W}_{i}),T_{i},\hat{\theta}]-g_{\hat{\theta}}(t,\mathbf{W}_{i}))\left(\frac{\mathbbl{1}(T_{i}=t)}{\widehat{m}_{\hat{\theta}}(\mathbf{W}_{i})}-\frac{\mathbbl{1}(T_{i}=t)}{m_{\hat{\theta}}(\mathbf{W}_{i})}\right)=0, where we use that on the event (T_{i}=t) , \mathbb{E}[Y_{i}\,|\,\mathbf{Z}_{\hat{\theta},i},T_{i},\hat{\theta}\,]=\mathbb{E}[Y_{i}\,|\,\mathbf{Z}_{\hat{\theta},i},T_{i}=t,\hat{\theta}\,]=g_{\hat{\theta}}(t,\mathbf{W}_{i}). To bound the conditional variance, note first that Assumption 4.4.1 and Assumption (ii) imply \displaystyle\var\big(Y_{i}\,|\,\mathbf{Z}_{\hat{\theta},i},T_{i},\hat{\theta}\,\big)\leq\mathbb{E}\big[Y_{i}^{2}\,|\,\mathbf{Z}_{\hat{\theta},i},T_{i},\hat{\theta}\,\big]=\mathbb{E}[\mathbb{E}\big[Y_{i}^{2}\,|\,\mathbf{W}_{i},T_{i},\hat{\theta}\,\big]\,|\,\mathbf{Z}_{\hat{\theta},i},T_{i},\hat{\theta}\,\big]\leq C, which in return implies that \displaystyle\var\left(r_{i}^{2}\,|\,\mathbf{Z}_{\hat{\bullet}},T_{\bullet},\hat{\theta}\right) \displaystyle=\mathbbl{1}(T_{i}=t)\left(\frac{1}{\widehat{m}_{\hat{\theta}}(\mathbf{W}_{i})}-\frac{1}{m_{\hat{\theta}}(\mathbf{W}_{i})}\right)^{2}\var\left(Y_{i}\,|\,\mathbf{Z}_{\hat{\theta},i},T_{i},\hat{\theta}\,\right) \displaystyle\leq C\left(\frac{1}{\widehat{m}_{\hat{\theta}}(\mathbf{W}_{i})}-\frac{1}{m_{\hat{\theta}}(\mathbf{W}_{i})}\right)^{2}. It now follows from the conditional Chebyshev’s inequality that \displaystyle\mathbb{P}(|R_{2}|>\epsilon\,|\,\mathbf{Z}_{\hat{\bullet}},T_{\bullet},\hat{\theta}) \displaystyle\leq\epsilon^{-2}\var(R_{2}\,|\,\mathbf{Z}_{\hat{\bullet}},T_{\bullet},\hat{\theta}) \displaystyle\leq\frac{C}{|\mathcal{I}_{3}|}\sum_{i\in\mathcal{I}_{3}}\left(\frac{1}{\widehat{m}_{\hat{\theta}}(\mathbf{W}_{i})}-\frac{1}{m_{\hat{\theta}}(\mathbf{W}_{i})}\right)^{2}\leq C\ell_{c}^{2}\mathcal{E}_{1,t}^{(n)}. Assumptions 4.4.2 (iv) implies convergence to zero in probability, and from this we conclude that also R_{2}\xrightarrow{P}0 . We now turn to the discussion of the oracle term U_{\hat{\theta}}^{(n)} . From Assumption 4.4.1 it follows that (T_{i},\mathbf{W}_{i},Y_{i})_{i\in\mathcal{I}_{3}}\,\perp\!\!\!\perp\,\hat{\theta} , and hence the conditional distribution U_{\hat{\theta}}^{(n)}\,|\,\hat{\theta}=\theta is the same as U_{\theta}^{(n)} . We show that this distribution is asymptotically Gaussian uniformly over \theta\in\Theta . To see this, note that for each \theta\in\Theta , the terms of U_{\theta}^{(n)} are i.i.d. with mean \chi_{t}(\mathbf{Z}_{\theta}) and variance \mathbb{V}_{t}(\mathbf{Z}_{\theta}) . The conditional Jensen’s inequality and Assumption 4.4.2 (i) imply that \displaystyle\mathbb{E}[|u_{i}(\theta)|^{2+\delta}] \displaystyle\leq C_{2+\delta}(\mathbb{E}[|g_{\theta}(t,\mathbf{W})|^{2+\delta}]+c^{-(1+\delta)}\mathbb{E}[|Y-g_{\theta}(t,\mathbf{W})|^{2+\delta}\,]) \displaystyle\leq C^{\prime}\mathbb{E}[|Y|^{2+\delta}], where C^{\prime}>0 is a constant depending on c and \delta . Thus we can apply the Lindeberg-Feller CLT, as stated in Shah and Peters (2020, Lem. 18) , to conclude that S_{n}(\theta)\coloneq\sqrt{|\mathcal{I}_{3}|}\mathbb{V}_{t}(\mathbf{Z}_{\theta})^{-1/2}(U_{\theta}^{(n)}-\chi_{t}(\mathbf{Z}_{\theta}))\xrightarrow{d/\Theta}\mathrm{N}(0,1), where the convergence holds uniformly over \theta\in\Theta . With \Phi(\cdot) denoting the CDF of a standard normal, this implies that \displaystyle\sup_{t\in\real}|\mathbb{P}(S_{n}(\hat{\theta})\leq t)-\Phi(t)| \displaystyle=\sup_{t\in\real}\left\lvert\int(\mathbb{P}(S_{n}(\hat{\theta})\leq t\,|\,\hat{\theta}=\theta)-\Phi(t))P_{\hat{\theta}}(\mathrm{d}\theta)\right\rvert \displaystyle\leq\sup_{\theta\in\Theta}\sup_{t\in\real}|\mathbb{P}(S_{n}(\theta)\leq t)-\Phi(t)|\longrightarrow 0. (4.A.3) This shows that S_{n}(\hat{\theta})\xrightarrow{d}\mathrm{N}(0,1) as desired. The last part of the theorem is a simple consequence of Slutsky’s theorem. ∎ Proof of Theorem 4.4.2 For each i\in\mathcal{I}_{3} , let \widehat{u}_{i}=u_{i}(\hat{\theta})+r_{i}^{1}+r_{i}^{2}+r_{i}^{3} be the decomposition from ( 4.4.16 ). For the squared sum, it is immediate from Theorem 4.4.1 that \displaystyle\left(\frac{1}{|\mathcal{I}_{3}|}\sum_{i\in\mathcal{I}_{3}}\widehat{u}_{i}\right)^{2}=\left(\frac{1}{|\mathcal{I}_{3}|}\sum_{i\in\mathcal{I}_{3}}u_{i}(\hat{\theta})\right)^{2}+o_{P}(1). For the sum of squares, we first expand the squares as \displaystyle\widehat{u}_{i}^{2}=u_{i}(\hat{\theta})^{2}+2(r_{i}^{1}+r_{i}^{2}+r_{i}^{3})u_{i}(\hat{\theta})+(r_{i}^{1}+r_{i}^{2}+r_{i}^{3})^{2}. (4.A.4) We show that the last two terms are convergent to zero in probability. For the cross-term, we note by Cauchy-Schwarz that \displaystyle\Big|\frac{1}{|\mathcal{I}_{3}|}\sum_{i\in\mathcal{I}_{3}}(r_{i}^{1}+r_{i}^{2}+r_{i}^{3})u_{i}(\hat{\theta})\Big|\leq\left(\frac{1}{|\mathcal{I}_{3}|}\sum_{i\in\mathcal{I}_{3}}(r_{i}^{1}+r_{i}^{2}+r_{i}^{3})^{2}\right)^{1/2}\left(\frac{1}{|\mathcal{I}_{3}|}\sum_{i\in\mathcal{I}_{3}}u_{i}(\hat{\theta})^{2}\right)^{1/2}. We show later that the sum \frac{1}{|\mathcal{I}_{3}|}\sum_{i\in\mathcal{I}_{3}}u_{i}^{2} is convergent in probability. Thus, to show that the last two terms of ( 4.A.4 ) converge to zero, it suffices to show that \frac{1}{|\mathcal{I}_{3}|}\sum_{i\in\mathcal{I}_{3}}(r_{i}^{1}+r_{i}^{2}+r_{i}^{3})^{2}\xrightarrow{P}0 . To this end, we observe that \displaystyle\frac{1}{|\mathcal{I}_{3}|}\sum_{i\in\mathcal{I}_{3}}(r_{i}^{1}+r_{i}^{2}+r_{i}^{3})^{2}\leq\frac{3}{|\mathcal{I}_{3}|}\sum_{i\in\mathcal{I}_{3}}(r_{i}^{1})^{2}+(r_{i}^{2})^{2}+(r_{i}^{3})^{2} The last term is handled similarly to R_{3} in the proof of Theorem 4.4.1 , \displaystyle\frac{1}{|\mathcal{I}_{3}|}\sum_{i\in\mathcal{I}_{3}}(r_{i}^{3})^{2} \displaystyle=\frac{1}{|\mathcal{I}_{3}|}\sum_{i\in\mathcal{I}_{3}}\left(\widehat{g}_{\hat{\theta}}(t,\mathbf{W}_{i})-g_{\hat{\theta}}(t,\mathbf{W}_{i})\right)^{2}\left(\frac{\mathbbl{1}(T_{i}=t)}{\widehat{m}_{\hat{\theta}}(t\,|\,\mathbf{W}_{i})}-\frac{\mathbbl{1}(T_{i}=t)}{m_{\hat{\theta}}(t\,|\,\mathbf{W}_{i})}\right)^{2} \displaystyle\leq\frac{1}{|\mathcal{I}_{3}|}\Big(\sum_{i\in\mathcal{I}_{3}}(\widehat{g}_{\hat{\theta}}(t,\mathbf{W}_{i})-g_{\hat{\theta}}(t,\mathbf{W}_{i}))^{2}\Big)\Big(\sum_{i\in\mathcal{I}_{3}}\Big(\frac{\mathbbl{1}(T_{i}=t)}{\widehat{m}_{\hat{\theta}}(t\,|\,\mathbf{W}_{i})}-\frac{\mathbbl{1}(T_{i}=t)}{m_{\hat{\theta}}(t\,|\,\mathbf{W}_{i})}\Big)^{2}\Big) \displaystyle\leq\ell_{c}^{2}n\mathcal{E}_{1}^{(n)}\mathcal{E}_{2,t}^{(n)}\xrightarrow{P}0, where we have used the naive inequality \sum a_{i}^{2}b_{i}^{2}\leq(\sum a_{i}^{2})(\sum b_{i}^{2}) rather than Cauchy-Schwarz. From the proof of Theorem 4.4.1 , we have that \displaystyle\mathbb{E}[(r_{i}^{1})^{2}\,|\,\mathbf{Z}_{\hat{\bullet}},\hat{\theta}]=\var[r_{i}^{1}\,|\,\mathbf{Z}_{\hat{\bullet}},\hat{\theta}]\leq\frac{1-c}{c}\left(\widehat{g}_{\hat{\theta}}(t,\mathbf{W}_{i})-g_{\hat{\theta}}(t,\mathbf{W}_{i})\right)^{2}, and hence the conditional Markov’s inequality yields \displaystyle\mathbb{P}\left(\frac{1}{|\mathcal{I}_{3}|}\sum_{i\in\mathcal{I}_{3}}(r_{i}^{1})^{2}>\epsilon\,|\,\mathbf{Z}_{\hat{\bullet}},\hat{\theta}\right) \displaystyle\leq\epsilon^{-1}\mathbb{E}\left[\frac{1}{|\mathcal{I}_{3}|}\sum_{i\in\mathcal{I}_{3}}(r_{i}^{1})^{2}\,|\,\mathbf{Z}_{\hat{\bullet}},\hat{\theta}\right] \displaystyle=\epsilon^{-1}\frac{1}{n}\sum_{i=1}^{n}\mathbb{E}\left[(r_{i}^{1})^{2}\,|\,\mathbf{Z}_{\hat{\bullet}},\hat{\theta}\right] \displaystyle\leq\frac{1-c}{\epsilon c}\mathcal{E}_{2,t}^{(n)}\xrightarrow{P}0. Thus we also conclude that \frac{1}{|\mathcal{I}_{3}|}\sum_{i\in\mathcal{I}_{3}}(r_{i}^{1})^{2}\xrightarrow{P}0 . Analogously, the final remainder \frac{1}{|\mathcal{I}_{3}|}\sum_{i\in\mathcal{I}_{3}}(r_{i}^{2})^{2} can be shown to converge to zero in probability by leveraging the argument for R_{2}\xrightarrow{P}0 in the proof of Theorem 4.4.1 . Combining the arguments above we conclude that \displaystyle\widehat{\mathcal{V}}_{t}(\widehat{g},\widehat{m})=\frac{1}{|\mathcal{I}_{3}|}\sum_{i\in\mathcal{I}_{3}}\widehat{u}_{i}^{2}-\left(\frac{1}{|\mathcal{I}_{3}|}\sum_{i\in\mathcal{I}_{3}}\widehat{u}_{i}\right)^{2}=\frac{1}{|\mathcal{I}_{3}|}\sum_{i\in\mathcal{I}_{3}}u_{i}(\hat{\theta})^{2}-\Big(\frac{1}{|\mathcal{I}_{3}|}\sum_{i\in\mathcal{I}_{3}}u_{i}(\hat{\theta})\Big)^{2}+o_{P}(1) As noted in the proof of Theorem 4.4.1 , for each \theta\in\Theta the terms \{u_{i}(\theta)\}_{i\in\mathcal{I}_{3}} are i.i.d with \mathbb{E}[|u_{i}(\theta)|^{2+\delta}]\leq C^{\prime}\mathbb{E}[|Y|^{2+\delta}]<\infty . Hence, the uniform law of large numbers, as stated in Shah and Peters (2020, Lem. 19) , implies that \displaystyle\frac{1}{|\mathcal{I}_{3}|}\sum_{i\in\mathcal{I}_{3}}u_{i}(\theta)-\mathbb{E}[u_{1}(\theta)])\xrightarrow{P/\Theta}0,\qquad\frac{1}{|\mathcal{I}_{3}|}\sum_{i\in\mathcal{I}_{3}}u_{i}^{2}(\theta)-\mathbb{E}[u_{1}(\theta)^{2}]\xrightarrow{P/\Theta}0, where the convergence in probability holds uniformly over \theta\in\Theta . Since \var(u_{1}(\theta))=\var(\psi_{t}(\mathbf{Z}_{\theta}))=\mathbb{V}_{t}(\mathbf{Z}_{\theta}) , this lets us conclude that \displaystyle S_{n}(\theta)\coloneq\frac{1}{|\mathcal{I}_{3}|}\sum_{i\in\mathcal{I}_{3}}{u}_{i}(\theta)^{2}-\Big(\frac{1}{|\mathcal{I}_{3}|}\sum_{i\in\mathcal{I}_{3}}u_{i}(\theta)\Big)^{2}-\mathbb{V}_{t}(\mathbf{Z}_{\theta})\xrightarrow{P/\Theta}0. We now use that convergence in distribution is equivalent to convergence in probability for deterministic limit variables, see Christgau et al. (2023b, Cor. B.4.) for a general uniform version of the statement. Since Assumption 4.4.1 implies that the conditional distribution S_{n}(\hat{\theta})\,|\,\hat{\theta}=\theta is the same as S_{n}(\theta) , the computation in ( 4.A.3 ) with \Phi(\cdot)=\mathbbl{1}(\cdot\geq 0) yields that S_{n}(\hat{\theta})\xrightarrow{d}0 . This lets us conclude that \widehat{\mathcal{V}}_{t}(\widehat{g},\widehat{m})=S_{n}(\hat{\theta})+o_{P}(1)\xrightarrow{P}0, which finishes the proof. ∎ 4.A.7 Proof of Theorem 4.4.4 We fix P\in\mathcal{P} and suppress it from notation throughout the proof. Given \theta\in\real^{d} , the single-index model assumption ( 4.4.13 ) implies that \displaystyle b_{t}(\mathbf{W}^{\top}\theta)=\mathbb{E}[Y\,|\,T=t,\mathbf{W}^{\top}\theta]=\mathbb{E}[h_{t}(\mathbf{W}^{\top}\theta_{P})\,|\,T=t,\mathbf{W}^{\top}\theta]. Now since h_{t}\in C^{1}(\mathbb{R}) , we may write \displaystyle h_{t}(\mathbf{W}^{\top}\theta) \displaystyle=h_{t}(\mathbf{W}^{\top}\theta_{P})+R(\theta,\theta_{P}), \displaystyle R(\theta,\theta_{P}) \displaystyle=h_{t}^{\prime}(\mathbf{W}^{\top}\theta_{P})\mathbf{W}^{\top}(\theta-\theta_{P})+r(\mathbf{W}^{\top}(\theta-\theta_{P}))\mathbf{W}^{\top}(\theta-\theta_{P}) for a continuous function r\colon\mathbb{R}\to\mathbb{R} satisfying that \lim_{\epsilon\to 0}r(\epsilon)=0 . It follows that \displaystyle\mathbb{E}[h_{t}(\mathbf{W}^{\top}\theta_{P})\,|\,T=t,\mathbf{W}^{\top}\theta]=h_{t}(\mathbf{W}^{\top}\theta)-\mathbb{E}[R(\theta,\theta_{P})\,|\,T=t,\mathbf{W}^{\top}\theta], The theoretical bias induced by adjusting for \mathbf{W}^{\top}\theta instead of \mathbf{W} , or equivalently \mathbf{W}^{\top}\theta_{P} , is therefore \displaystyle\chi_{t}(\mathbf{W}^{\top}\theta;P)-\chi_{t}(\mathbf{W}) \displaystyle=\chi_{t}(\mathbf{W}^{\top}\theta;P)-\chi_{t}(\mathbf{W}^{\top}\theta_{P}) \displaystyle=\mathbb{E}\left[h_{t}(\mathbf{W}^{\top}\theta)-\mathbb{E}[R(\theta,\theta_{P})\,|\,T=t,\mathbf{W}^{\top}\theta]-h_{t}(\mathbf{W}^{\top}\theta_{P})\right] \displaystyle=\mathbb{E}[R(\theta,\theta_{P})-\mathbb{E}[R(\theta,\theta_{P})\,|\,T=t,\mathbf{W}^{\top}\theta]] \displaystyle=\mathbb{E}\left[R(\theta,\theta_{P})\cdot\left(1-\frac{\mathbbl{1}(T=t)}{\mathbb{P}(T=t\,|\,\mathbf{W}^{\top}\theta)}\right)\right] \displaystyle=C(\theta,\theta_{P})^{\top}(\theta-\theta_{P}), where \displaystyle C(\theta;\theta_{P})=\mathbb{E}\left[\left(h_{t}^{\prime}(\mathbf{W}^{\top}\theta)+r(\mathbf{W}^{\top}(\theta-\theta_{P}))\right)\left(1-\frac{\mathbbl{1}(T=t)}{\mathbb{P}(T=t\,|\,\mathbf{W}^{\top}\theta)}\right)\mathbf{W}\right]. To show that u is differentiable at \theta=\theta_{P} , it therefore suffices to show that the mapping \theta\mapsto C(\theta;\theta_{P}) is continuous at \theta_{P} . We first show that \mathbb{P}(T=t\,|\,\mathbf{W}^{\top}\theta) is continuous at \theta_{P} almost surely, which follows after applying a coordinate change such that \theta becomes a basis vector. To be more precise, we may choose a neighborhood \mathcal{U}\subset\real^{d} of \theta_{P} and d-1 continuous functions q_{2},\ldots,q_{d}\colon\mathcal{U}\longrightarrow\mathcal{S}^{d-1} such that Q(\theta)\coloneq(\lVert\theta\rVert^{-1}\theta,q_{2}(\theta),\ldots q_{d}(\theta)) is an orthogonal matrix for every \theta\in\mathcal{U} . For example, the first d vectors of the Gram-Schmidt process applied to (\theta,\mathbf{e}_{1},\ldots,\mathbf{e}_{d}) is continuous and yields an orthonormal basis for \theta\in\real^{d}\setminus\operatorname{span}(\mathbf{e}_{d}) , so this works in case \theta_{P}\neq\pm\mathbf{e}_{d} . Let Z(\theta)=Q(\theta)^{\top}\mathbf{W} and note that Z(\theta)_{1}=\lVert\theta\rVert^{-1}\theta^{\top}\mathbf{W}=\lVert\theta\rVert^{-1}\mathbf{W}^{\top}\theta . Then by iterated expectations, \displaystyle\mathbb{P}(T=t\,|\,\mathbf{W}^{\top}\theta)=\mathbb{E}[m(t\,|\,\mathbf{W})\,|\,\mathbf{W}^{\top}\theta] \displaystyle=\mathbb{E}[m(t\,|\,Q(\theta)Z(\theta))\,|\,Z(\theta)_{1}] \displaystyle=\frac{\int_{\real{}^{d-1}}m(t\,|\,\widetilde{\mathbf{W}}(\theta,z))p_{\mathbf{W}}(\widetilde{\mathbf{W}}(\theta,z))\mathrm{d}z}{\int_{\real{}^{d-1}}p_{\mathbf{W}}(\widetilde{\mathbf{W}}(\theta,z))\mathrm{d}z},\qquad\widetilde{\mathbf{W}}(\theta,z)\coloneq Q(\theta)\begin{pmatrix}Z(\theta)_{1}\\ z\end{pmatrix} Each integrand is bounded and continuous over \theta\in\mathcal{U} . From dominated convergence it follows that \mathbb{P}(T=t\,|\,\mathbf{W}^{\top}\theta) is continuous at \theta_{P} almost surely. It follows that almost surely, \displaystyle\left(h_{t}^{\prime}(\mathbf{W}^{\top}\theta)+r(\mathbf{W}^{\top}(\theta-\theta_{P}))\right)\left(1-\frac{\mathbbl{1}(T=t)}{\mathbb{P}(T=t\,|\,\mathbf{W}^{\top}\theta)}\right)\mathbf{W} \displaystyle\longrightarrow h_{t}^{\prime}(\mathbf{W}^{\top}\theta_{P})\left(1-\frac{\mathbbl{1}(T=t)}{\mathbb{P}(T=t\,|\,\mathbf{W}^{\top}\theta_{P})}\right)\mathbf{W},\qquad\text{for }\theta\to\theta_{P}. By dominated convergence again we conclude that \displaystyle C(\theta;\theta_{P})\longrightarrow\mathbb{E}\left[h_{t}^{\prime}(\mathbf{W}^{\top}\theta_{P})\left(1-\frac{\mathbbl{1}(T=t)}{\mathbb{P}(T=t\,|\,\mathbf{W}^{\top}\theta_{P})}\right)\mathbf{W}\right],\qquad\theta\to\theta_{P}. This shows that \theta\mapsto C(\theta;\theta_{P}) is continuous at \theta_{P} , and hence we conclude that u is differentiable at \theta=\theta_{P} with gradient \displaystyle\nabla u(\theta_{P}) \displaystyle=\mathbb{E}\left[h_{t}^{\prime}(\mathbf{W}^{\top}\theta_{P})\left(1-\frac{\mathbbl{1}(T=t)}{\mathbb{P}(T=t\,|\,\mathbf{W}^{\top}\theta_{P})}\right)\mathbf{W}\right] \displaystyle=\mathbb{E}\left[h_{t}^{\prime}(\mathbf{W}^{\top}\theta_{P})\left(1-\frac{\mathbb{P}(T=t\,|\,\mathbf{W})}{\mathbb{P}(T=t\,|\,\mathbf{W}^{\top}\theta_{P})}\right)\mathbf{W}\right]. ∎ 4.B. Details of simulation study Our experiments were conducted in Python ( Van Rossum et al., 1995 ) . The linear and logistic regression was imported from the scikit-learn package ( Pedregosa et al., 2011 ) , and the neural network for the DOPE-IDX was implemented using pytorch ( Paszke et al., 2019 ) . Figure 4.B.1 : Neural network architecture for single-index model. The neural network architecture is illustrated in Figure 4.B.1 . The network was optimized using MSE loss and the ADAM optimizer with lr=1e-3 and n_iter=1200 in the simulation experiment. For the NHANES application the settings were similar, but with BCELoss and n_iter=3000 . We discovered that the optimization procedure could get stuck in a local minimum with significantly lower training score. To avoid getting stuck in a such a ‘bad local minimum’, it was possible to refit the network with random initialization several times and pick the model with highest training score. The frequency of bad local minimums is roughly 15\% , with variation between each setting. Thus, refitting the network, say 5 times, is enough to avoid a bad minimum >99,99\% of the time. To save the computational cost of refitting many times for each simulation, we initialized the first layer with an initial value \theta_{init}=\beta+\mathrm{Unif}(-0.1,0.1)^{\otimes d} . The logistic regression for the propensity score was fitted without \ell_{2} -penalty and optimized using the lbfgs optimizer. The propensity score was clipped to the interval (0.01,0.99) for all estimators of the adjusted mean. Figure 4.B.2 : Comparison of DOPE estimators with and without sample splitting. Figure 4.B.2 shows the cross-fitted DOPE estimators versus their full sample counterparts in the simulation setup of Section 4.5.1 . We observe that cross-fitting generally seems to decrease performance for small sample sizes, but the discrepancy diminishes for larger sample sizes. Estimator Estimate BS se BS CI Regr. (NN) 0.020 0.008 (0.002, 0.035) Regr. (Logistic) 0.027 0.009 (0.012, 0.048) DOPE-BCL (Logistic) 0.024 0.010 (0.004, 0.040) Naive contrast 0.388 0.010 (0.369, 0.407) DOPE-BCL (NN) 0.018 0.010 (-0.003, 0.036) DOPE-IDX (NN) 0.023 0.012 (-0.001, 0.047) AIPW (NN) 0.017 0.016 (-0.017, 0.046) AIPW (Logistic) 0.022 0.016 (-0.012, 0.051) IPW (Logistic) -0.047 0.027 (-0.119, -0.01) Table 4.B.1 : Treatment effect estimates for NHANES dataset, where covariates with more than 50% missing values have been removed. Table 4.B.1 corresponds to Table 4.5.1 in the main manuscript, but where covariates with more than 50\% missing data have been removed rather than imputed. Except for the naive contrast (which has dropped two rows) the ordering according to bootstrap variance is the same. Figure 4.B.3 : Coverage of asymptotic confidence intervals of the adjusted mean \chi_{1} , aggregated over d\in\{4,12,36\} and with the true \beta given in ( 4.5.19 ). The numbers in the parentheses denote the corresponding average width of the confidence interval. Figure 4.B.3 shows the same coverage values as Figure 4.5.5 , but also includes the average lengths of the confidence intervals in the parentheses. We note that the lengths of the confidence intervals for the DOPE estimators are much smaller than those of the AIPW estimator. 4.C. Extension to cross-fitting Algorithm 2 Cross-fitted DOPE input : observations (T_{i},\mathbf{W}_{i},Y_{i})_{i\in[n]} , partition [n]=J_{1}\cup\cdots\cup J_{K} ; 1 options : integer 1\leq m\leq K-2 and options for Algorithm 1 ; 2 for k=1,\ldots,K do 3 Set \mathcal{I}_{3}=J_{k} , \mathcal{I}_{1}=\bigcup_{l=k+1}^{k+m}J_{l} and \mathcal{I}_{2}=[n]\setminus(\mathcal{I}_{1}\cup\mathcal{I}_{3}) ; 4 Compute \widehat{\chi}_{t,k}^{\mathrm{dope}} as the output of Algorithm 1 ; 5 Compute variance estimate \widehat{\mathcal{V}}_{t,k} given as in ( 4.4.17 ); 6 return \widehat{\chi}_{t}^{\mathsf{x}}\coloneq\frac{1}{K}\sum_{k=1}^{K}\widehat{\chi}_{t,k}^{\mathrm{dope}} and \widehat{\mathcal{V}}_{t}^{\mathsf{x}}\coloneq\frac{1}{K}\sum_{k=1}^{K}\widehat{\mathcal{V}}_{t,k} A cross-fitting procedure for the DOPE is described in Algorithm 2 , which computes both a cross-fitted version of the DOPE and its variance estimator. Here the indices of the folds are understood to cycle modulo K such that J_{K+1}=J_{1} and so forth. This version of cross-fitting with three index sets has also been referred to as ‘double cross-fitting’ by Zivich and Breskin (2021) . We note that the ‘standard arguments’ for establishing convergence of the cross-fitted estimator cannot be applied directly to our case. This is because, for each fold k\in[K] , the corresponding oracle terms U_{\hat{\theta}_{k}}^{(n)} do not only involve the data indexed by \mathcal{I}_{3}^{k} , but also depend on \hat{\theta}_{k} which is estimated from data indexed by \mathcal{I}_{1}^{k} . Hence the oracle terms are not independent. However, we believe that this dependency should be negligible, and perhaps the convergence can be established under a more refined theoretical analysis. Chapter 5 Assumption-lean Aalen regression Alexander Mangulad Christgau and Niels Richard Hansen 5.1 Introduction Statistical inference for the conditional association between a time-to-event and an exposure is the primary objective in many bio-medical applications. A critical task for such applications is to first define an appropriate measure of association. Formulating a general and interpretable measure is intricate and remains an active research topic. The hazard ratio is one of the most popular and reported measures of association in clinical research, with its application being a subject of ongoing discussion since the influential work of Cox (1972) . Despite its popularity, the hazard ratio, and the often accompanying Cox model, are subject to several significant drawbacks, as highlighted by Hernán (2010) ; Martinussen and Vansteelandt (2013) ; Stensrud and Hernán (2020) , among others. These drawbacks include non-collapsibility of the hazard ratio and that it is unsuitable for quantifying causal effects. The pitfalls of model misspecification is another notable drawback. When used as a conditional association measure within the framework of the Cox model, its interpretation is problematic without strong model assumptions such as proportionality. To address the issue of model misspecification, Vansteelandt et al. (2022) propose a more general measure of association that reduces to the log (cumulative) hazard ratio under the Cox model. Generalizing a model-based measure of association with a model-free measure has now become known as assumption-lean inference ( Berk et al., 2019 ) . This approach subsumes model-based and estimand-based methods, and can be advantageous when each method has its own merits, see Vansteelandt and Dukes (2022) and the surrounding discussion for more details. In this work we develop an analogous approach, but based on the hazard difference as an effect measure. The hazard difference is collapsible for the additive hazards model , introduced by Aalen ( Aalen, 1980 ; Aalen, 1989 ) . As mentioned, this desirable property does not hold for the hazard ratio and the Cox model ( Martinussen and Vansteelandt, 2013 ; Daniel et al., 2021 ) . There are other appealing properties of the hazard difference, but the discussion is subtle, see, for example, Didelez and Stensrud (2022) ; Martinussen et al. (2020) . Regardless, there are several applications where additive hazards are more plausible than proportional ones; we refer to Breslow and Day (1987) ; Lin and Ying (1994) ; Kravdal (1997) ; Lee S. McDaniel and Chappell (2019) ; Bischofberger et al. (2023) . Assumptions on the non-baseline term Ratio-based target Difference-based target Parametric Cox model ( Cox, 1972 ) Additive risk model in Lin and Ying (1994) Semi-parametric Partial Cox model ( Sasieni, 1992 ; Huang, 1999 ; Zhong et al., 2022 ) Partially additive hazards ( McKeague and Sasieni, 1994 ; Dukes et al., 2019 ; Hou et al., 2023 ) Assumption-lean ( Vansteelandt et al., 2022 ) This work Table 5.1.1 : Overview of selected works on inference for the conditional association between a time-to-event and an exposure, defined using varying levels of model assumptions. All models include a nonparametric baseline term that does not depend on covariates. Despite some of their well-behaved theoretical properties, additive hazards are “somewhat overlooked in practice” according to Martinussen and Scheike (2006, p. 103) . A common criticism of additive hazard models is that they can lead to hazard estimates that are negative and are thus not valid hazards. To circumvent this issue, we define a model-free target parameter based on the Local Covariance Measure (LCM) introduced by Christgau et al. (2023b) . We show that, within a partially additive hazards model, it coincides with the cumulative effect of the exposure. However, our target does not rely on such modeling assumptions and we discuss its interpretations in more general settings. Table 5.1.1 gives an overview of our target parameter in relation to some existing works. We show how the target may be estimated using flexible machine learning methods, and prove asymptotic normality under suitable rate conditions on the nuisance parameters. 5.1.1 A hazard difference estimand To motivate our general framework and results we first present a simplified example. Example 1 . Let T\in[0,1] denote a survival time, let X\in\{0,1\} denote a binary baseline exposure and let Z denote additional baseline covariates. With \bm{H}_{t}(X,Z) denoting the conditional cumulative hazard given (X,Z) , the conditional survival function is \mathbb{P}(T>t\,|\,X,Z)=e^{-\bm{H}_{t}(X,Z)} , and \Theta_{t}(Z)\coloneq\log\frac{\mathbb{P}(T>t\,|\,X=0,Z)}{\mathbb{P}(T>t\,|\,X=1,Z)}=\bm{H}_{t}(1,Z)-\bm{H}_{t}(0,Z) (5.1.1) quantifies the, possibly heterogeneous, exposure effect as a function of Z . Suppose that \bm{H}_{t}(X,Z)=\int_{0}^{t}\bm{h}_{s}(X,Z)\mathrm{d}s is given in terms of the conditional hazard \bm{h}_{s}(X,Z) , then \Theta_{t}(Z)=\int_{0}^{t}\underbrace{\bm{h}_{s}(1,Z)-\bm{h}_{s}(0,Z)}_{\eqcolon\theta_{s}(Z)}\mathrm{d}s=\int_{0}^{t}\theta_{s}(Z)\mathrm{d}s is the integrated difference of conditional hazards. We can always express the conditional hazard as \bm{h}_{s}(X,Z)=X\theta_{s}(Z)+\bm{h}_{s}(0,Z), (5.1.2) and the additive decomposition ( 5.1.2 ) does not impose any model restrictions unless we restrict one of the functions \theta_{s}(Z) or \bm{h}_{s}(0,Z) . We seek an estimand the summarizes the values of \theta_{s}(Z) over s and Z . To this end, let w_{s}(Z) denote a weight process with w_{s}(Z)\geq 0 and \int_{0}^{1}\mathbb{E}[w_{s}(Z)]\mathrm{d}s=1 , and consider the weighted hazard difference estimand \gamma^{w}_{1}\coloneq\int_{0}^{1}\mathbb{E}[\theta_{s}(Z)w_{s}(Z)]\mathrm{d}s. The real-valued parameter \gamma^{w}_{1} is the endpoint of the functional estimand \gamma^{w}_{t}\coloneq\int_{0}^{t}\mathbb{E}[\theta_{s}(Z)w_{s}(Z)]\mathrm{d}s,\quad t\in[0,1]. For w_{s}(Z)=1 , the estimand simplifies to the expected cumulative hazard difference \gamma^{1}_{t}=\mathbb{E}(\Theta_{t}(Z)) , but other weights are also of interest. For the partially additive hazards model , where \theta_{s} is independent of Z , we see that \gamma_{t}^{w}=\int_{0}^{t}\theta_{s}\mathbb{E}[w_{s}(Z)]\mathrm{d}s is a cumulative weighted hazard difference. Efficient and (rate) doubly robust estimation was considered for the partially additive model in Dukes et al. (2019) and Hou et al. (2023) using semiparametric estimation theory – in particular when \theta_{t}=\theta is independent of t and \gamma_{t}^{w}=\theta t . In this paper we introduce an assumption-lean additive hazard estimand and corresponding estimation theory that, as a special case, applies to model ( 5.1.2 ) without any model restrictions. To give an explicit formula for our assumption-lean estimand for model ( 5.1.2 ) within this simplified example, let Y_{t}=\mathbbl{1}(T\geq t) denote the at-risk indicator, and define what we call the Aalen covariance weights w_{s}^{\textsc{ac}}(Z)\coloneq\frac{Y_{s}\pi_{s}(Z)(1-\pi_{s}(Z))}{\mathbb{E}[Y_{s}\pi_{s}(Z)(1-\pi_{s}(Z))]}, (5.1.3) where \pi_{s}(Z)=\mathbb{P}(X=1\,|\,T\geq s,Z) . The resulting estimand can be expressed as \gamma_{t}=\int_{0}^{t}\mathbb{E}\left[\theta_{s}(Z)w_{s}^{\textsc{ac}}(Z)\right]\mathrm{d}s=\int_{0}^{t}\frac{\mathbb{E}\left[\theta_{s}(Z)Y_{s}\pi_{s}(Z)(1-\pi_{s}(Z))\right]}{\mathbb{E}[Y_{s}\pi_{s}(Z)(1-\pi_{s}(Z))]}\mathrm{d}s. (5.1.4) The weights ( 5.1.3 ) and the formula ( 5.1.4 ) may at first appear unmotivated. In Section 3 in Vansteelandt and Dukes (2022) we find weights similar to ( 5.1.3 ) used to represent assumption-lean GLM regression estimands, and also in Section 2 in Vansteelandt et al. (2022) similar weights appear in the representation of assumption-lean Cox regression estimands. In Example 4 we show that the Aalen covariance weights and the estimand ( 5.1.4 ) appear naturally as an assumption-lean Aalen regression estimand. The estimand \gamma_{t} given by ( 5.1.4 ) is an example of the Aalen covariance measure (ACM) – the general estimand we introduce in Definition 1 . This is, in turn, an example of a Local Covariance Measure as introduced by Christgau et al. (2023b) . We show in this paper that ACM can be defined and interpreted as an assumption-lean estimand for any real-valued and time-dependent X -process and time-dependent Z -process, thus generalizing model ( 5.1.2 ) considerably. 5.1.2 Organization of paper We organize the rest of the paper as follows. In Section 5.2 , we first introduce our general setup and define our target estimand. We then discuss interpretations of the estimand based on theoretical properties and computations in concrete examples. Conditions on the censoring mechanism are postponed to the end of the section to avoid a technical discussion from the onset. In Section 5.3 , we discuss an estimation methods for our target estimand, in particular we propose the x-acm , which is based on double machine learning estimator. In Section 5.4 , we prove that the x-acm is asymptotically Gaussian with a \sqrt{n} -rate under suitable conditions. The most significant conditions are rate-conditions on nuisance estimators, which are similar to those for other (rate) doubly robust estimators. In Section 5.5 , conduct a simulation study that demonstrates the effect of the x-acm . We conclude with a discussion in Section 5.6 outlining potential future research directions. The supplementary material consists of Section 5 , which contains proofs of all our main results and related auxiliary lemmas, and Section 5 , which includes a discussion of our framework in the context of multiplicative hazards models. 5.2 Target estimand and interpretations 5.2.1 General setup We consider a survival time T^{*}>0 censored by a random variable C\in[0,1] , such that the observed time is T\coloneq T^{*}\wedge C together with the indicator \Delta\coloneq\mathbbl{1}(T^{*}\leq C) . From these we define the observed counting process N_{t}=\mathbbl{1}(T\leq t,\Delta=1) , and the at-risk indicator Y_{t}=\mathbbl{1}(T\geq t) . In addition to (T,\Delta) , we also observe a covariate process Z=(Z_{t}) and an exposure process X=(X_{t}) of particular interest. The covariate process can, in principle, take values in any measurable space, whereas the exposure process is assumed real-valued and left-continuous. We postpone an elaborate discussion of assumptions on the censoring mechanism to Section 5.2.4 . In summary, we introduce Assumption 5.2.1 , which is an instance of independent right-censoring in the sense of Andersen et al. (1993) , and which will remain an assumption throughout the remainder of the manuscript. For any stochastic process W=(W_{t}) , we let \mkern 2.0mu\overline{\mkern-2.0muW\mkern 0.0mu}\mkern 0.0mu_{t}=(W_{s})_{s0 , but not including the timepoint t . 10 10 10 This convention differs from other works such as ( Lok, 2017 ; Lok, 2008 ) , which do include the timepoint t in the history. For any left-continuous process, this convention does not affect the information content of the history. In particular, there is no distinction between the conventions when conditioning on \mkern 2.0mu\overline{\mkern-2.0muX\mkern 0.0mu}\mkern 0.0mu_{t} , see also Remark 1 Note that by left-continuity, X_{t}=X_{t-}\coloneq\lim_{s\to t^{-}}X_{s} is determined by the history \mkern 2.0mu\overline{\mkern-2.0muX\mkern 0.0mu}\mkern 0.0mu_{t} . The conditional cumulative hazard \bm{H}_{t} , given the processes X and Z , is defined by \displaystyle\bm{H}_{t}(\mkern 2.0mu\overline{\mkern-2.0muX\mkern 0.0mu}\mkern 0.0mu_{t},\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t})\coloneq-\log\mathbb{P}(T^{*}>t\,|\,\mkern 2.0mu\overline{\mkern-2.0muX\mkern 0.0mu}\mkern 0.0mu_{t},\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t}). The overall objective is to quantify how \bm{H}_{t}(\mkern 2.0mu\overline{\mkern-2.0muX\mkern 0.0mu}\mkern 0.0mu_{t},\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t}) depends on the exposure process \mkern 2.0mu\overline{\mkern-2.0muX\mkern 0.0mu}\mkern 0.0mu_{t} . Such a dependence can, in general, be complicated and depend on the value of the covariate process \mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t} . Our approach is assumption-lean meaning that we do not make strong model assumptions on how \bm{H}_{t} depends on \mkern 2.0mu\overline{\mkern-2.0muX\mkern 0.0mu}\mkern 0.0mu_{t} and \mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t} . We will assume, though, that \bm{H}_{t}(\mkern 2.0mu\overline{\mkern-2.0muX\mkern 0.0mu}\mkern 0.0mu_{t},\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t}) is given by a conditional hazard function, denoted by \bm{h}_{t} , that is, \bm{H}_{t}(\mkern 2.0mu\overline{\mkern-2.0muX\mkern 0.0mu}\mkern 0.0mu_{t},\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t})=\int_{0}^{t}\bm{h}_{s}(\mkern 2.0mu\overline{\mkern-2.0muX\mkern 0.0mu}\mkern 0.0mu_{s},\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{s})\mathrm{d}s . 5.2.2 Aalen Covariance Measure Before we define our model-free estimand in the most general case, we need to introduce two auxiliary stochastic processes: the predictable projection of X and the Z -compensated counting process. A stochastic process is said to be càglàd if its sample paths are left-continuous and have right-limits at all times. We henceforth assume that X is càglàd and square-integrable. Then, the predictable projection of X onto the histories of N and Z can be defined as the unique 11 11 11 Technically, it is unique up to evanescence . càglàd process, denoted by \Pi=(\Pi_{t}) , satisfying that \Pi_{t}=\mathbb{E}[X_{t}\,|\,\mkern 2.0mu\overline{\mkern-2.0muN\mkern 0.0mu}\mkern 0.0mu_{t},\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t}]. (5.2.5) For more details, see for example Corollary 7.6.8 in Cohen and Elliott (2015) . We will primarily need the process \Pi_{t} on the event (Y_{t}=1)=(T\geq t) , where it takes the value \pi_{t}(\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t})\coloneq\mathbb{E}[X_{t}\,|\,T\geq t,\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t}] . 12 12 12 We technically define \pi_{t} via the Doob-Dynkin lemma such that Y_{t}\Pi_{t}=Y_{t}\pi_{t}(\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t}) holds surely . Thus we can ensure that \pi_{t}(\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t}) is a càglàd version of \mathbb{E}[X_{t}\,|\,T\geq t,\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t}] . Introducing h_{t}(\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{s})=\mathbb{E}[\bm{h}_{s}(\mkern 2.0mu\overline{\mkern-2.0muX\mkern 0.0mu}\mkern 0.0mu_{s},\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{s})\,|\,T\geq t,\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t}], the innovation theorem , see, e.g., Theorem II.T14 in Brémaud (1981) , gives that h_{t} is the conditional hazard given Z that satisfies the relation \displaystyle H_{t}(\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t})\coloneq\int_{0}^{t}h_{s}(\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{s})\mathrm{d}s=-\log\mathbb{P}(T^{*}>t\,|\,\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t}). In terms of the conditional hazard given Z we define the Z -compensated counting process M_{t}\coloneq N_{t}-\int_{0}^{t}Y_{s}h_{s}(\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{s})\mathrm{d}s=N_{t}-H_{t\wedge T}(\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t\wedge T}). We can now define our target estimand. Definition 1 (Aalen Covariance Measure) . For each t\in[0,1] let \displaystyle\rho(t)\coloneq\mathbb{E}[Y_{t}(X_{t}-\Pi_{t})^{2}]=\mathbb{E}[Y_{t}(X_{t}-\pi_{t}(\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t}))^{2}], (5.2.6) and define, whenever \rho(t)>0 , the residual process G=(G_{t}) by \displaystyle G_{t}\coloneq\frac{Y_{t}(X_{t}-\Pi_{t})}{\rho(t)}=\frac{Y_{t}(X_{t}-\pi_{t}(\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t}))}{\rho(t)}. (5.2.7) If \rho(t)>0 for all t\in[0,1] , the Aalen Covariance Measure (ACM) is defined as the functional estimand \gamma=(\gamma_{t}) given by \gamma_{t}=\mathbb{E}\left[\int_{0}^{t}G_{s}\mathrm{d}M_{s}\right] (5.2.8) for t\in[0,1] . We discuss the positivity assumption \rho(t)>0 further in Remark 2 . To appreciate Definition 1 we compute the ACM for the partially additive hazards model. Example 2 (Partially additive hazards model) . Suppose that \bm{h}_{t}(\mkern 2.0mu\overline{\mkern-2.0muX\mkern 0.0mu}\mkern 0.0mu_{t},\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t})=\theta_{t}X_{t}+g_{t}(\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t}), (5.2.9) for some \theta_{t}\in\real and a function g_{t}\in L^{1}(P_{\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t}}) , where P_{\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t}} denotes the distribution of \mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t} . The model given by ( 5.2.9 ) is the partially additive hazards model . It specifies the direct effect of X in a separate term with time-varying coefficient \theta_{t} . For this model the innovation theorem yields the explicit expression h_{t}(\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t})=\theta_{t}\pi_{t}(\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t})+g_{t}(\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t}). (5.2.10) Introducing the (X,Z) -compensated counting process, \bm{M}_{t}\coloneq N_{t}-\bm{H}_{t\wedge T}(\mkern 2.0mu\overline{\mkern-2.0muX\mkern 0.0mu}\mkern 0.0mu_{t\wedge T},\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t\wedge T}) we get by ( 5.2.10 ) that M_{t}=\bm{M}_{t}+\int_{0}^{t}\theta_{s}(X_{s}-\pi_{s}(\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{s}))\mathrm{d}s. Since \bm{M}_{t} is a mean zero martingale and the residual process is predictable, \displaystyle\gamma_{t} \displaystyle=\mathbb{E}\left[\int_{0}^{t}G_{s}\mathrm{d}\bm{M}_{s}+\int_{0}^{t}G_{s}\theta_{s}(X_{s}-\pi_{s}(\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{s}))\mathrm{d}s\right] \displaystyle=\mathbb{E}\left[\int_{0}^{t}\theta_{s}\frac{Y_{s}(X_{s}-\pi_{s}(\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{s}))^{2}}{\rho(s)}\mathrm{d}s\right]=\int_{0}^{t}\theta_{s}\mathrm{d}s. (5.2.11) Hence, the ACM reduces to the cumulative direct effect \Theta_{t}=\int_{0}^{t}\theta_{s}\mathrm{d}s for the partially additive hazards model. We note that both Dukes et al. (2019) ; Hou et al. (2023) consider models that fall under the partially additive model given by ( 5.2.9 ), and they propose estimation of the cumulative effect \Theta_{t} with doubly robust estimation methods. The example above shows that our ACM estimand reduces to the cumulative effect for the partially additive model, but we will not make this model assumption. We present additional represetations and interpretations of the ACM in Section 5.2.3 Remark 1 . The ACM is an example of a Local Covariance Measure (LCM), which was introduced by Christgau et al. (2023b) in a more general setting of counting processes, where all definitions and results are formulated in terms of filtrations and intensities. Since this work is focused on survival analysis, the results are formulated using histories and conditional hazards to make them more accessible. To describe the connection between the notation used in this paper and in Christgau et al. (2023b) , introduce the two filtrations \mathcal{F}_{t}\coloneq\sigma(Z_{s},N_{s};s\leq t) and \mathcal{G}_{t}\coloneq\sigma(X_{s},Z_{s},N_{s};s\leq t) . Then \mathcal{G}_{t-}=\sigma(\mkern 2.0mu\overline{\mkern-2.0muX\mkern 0.0mu}\mkern 0.0mu_{t},\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t},\mkern 2.0mu\overline{\mkern-2.0muN\mkern 0.0mu}\mkern 0.0mu_{t}) and \mathcal{F}_{t-}=\sigma(\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t},\mkern 2.0mu\overline{\mkern-2.0muN\mkern 0.0mu}\mkern 0.0mu_{t}) , and \lambda_{t}\coloneq Y_{t}h_{t}(\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t}) and \bm{\lambda}_{t}\coloneq Y_{t}\bm{h}_{t}(\mkern 2.0mu\overline{\mkern-2.0muX\mkern 0.0mu}\mkern 0.0mu_{t},\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t}) are the \mathcal{F}_{t} - and \mathcal{G}_{t} -predictable intensities, respectively, for the counting process N . The martingale argument in Example 2 uses that \bm{M}_{t} is a \mathcal{G}_{t} -martingale, which relies on the implicit Assumption 5.2.1 on the censoring mechanism. The supplementary Section 5 elaborates on the notation, which is also used in the proofs. In Christgau et al. (2023b) , the LCM was introduced for any \mathcal{G}_{t} -predictable residual process G_{t} satisfying \mathbb{E}[G_{t}\,|\,\mathcal{F}_{t-}]=0 . The residual process given by ( 5.2.7 ) is a specific example of such a process. The LCM was introduced in Christgau et al. (2023b) to quantify deviations from the hypothesis that N is locally independent of X given \mathcal{F}_{t} . The ACM, being an example of a LCM, enjoys the same interpretation: under local independence, \gamma is equal to the zero function. The ACM was, however, not considered in Christgau et al. (2023b) , and we proceed to show that the ACM enjoys the interpretation as an effect measure generalizing the cumulative effect in a partially additive hazards model. 5.2.3 Interpretations of the ACM as an effect measure By Proposition 2.6 in Christgau et al. (2023b) , the LCM, and therefore also the ACM, has the following equivalent representation for each t\in[0,1] , \displaystyle\gamma_{t} \displaystyle=\int_{0}^{t}\cov\big(G_{s},Y_{s}\big(\bm{h}_{s}(\mkern 2.0mu\overline{\mkern-2.0muX\mkern 0.0mu}\mkern 0.0mu_{s},\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{s})-h_{s}(\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{s})\big)\big)\mathrm{d}s (5.2.12) \displaystyle=\int_{0}^{t}\mathbb{E}\left[G_{s}\big(\bm{h}_{s}(\mkern 2.0mu\overline{\mkern-2.0muX\mkern 0.0mu}\mkern 0.0mu_{s},\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{s})-h_{s}(\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{s})\big)\right]\mathrm{d}s, (5.2.13) where ( 5.2.13 ) follows from G_{s} having mean zero and Y_{s}\in\{0,1\} . Example 2 showed that the ACM equals the cumulative direct effect under the partially additive hazards model. The following proposition asserts that in general – when ( 5.2.9 ) may not hold – the ACM equals the cumulated coefficient in the L^{2} -projection of the conditional hazard \bm{h}_{t} onto a partially additive model. Proposition 5.2.1 . Consider the minimization problem \displaystyle\minimize_{\vartheta,g}\!: \displaystyle\quad\mathbb{E}\left[\int_{0}^{1}Y_{t}\big(\bm{h}_{t}(\mkern 2.0mu\overline{\mkern-2.0muX\mkern 0.0mu}\mkern 0.0mu_{t},\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t})-\vartheta_{t}X_{t}-g_{t}(\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t})\big)^{2}\mathrm{d}t\right] (5.2.14) over all measurable functions \vartheta\colon[0,1]\to\real and collections of functions (g_{t})_{t\in[0,1]} such that g_{t}(\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t}) is progressively measurable. Let \vartheta^{\star}=(\vartheta_{t}^{\star}) be given by \vartheta_{t}^{\star}\coloneq\cov\!\big(G_{t},Y_{t}\big(\bm{h}_{t}(\mkern 2.0mu\overline{\mkern-2.0muX\mkern 0.0mu}\mkern 0.0mu_{t},\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t})-h_{t}(\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t})\big)\big) for t\in[0,1] . Then there exists g^{\star} such that (\vartheta^{\star},g^{\star}) is a solution to ( 5.2.14 ), and \vartheta^{\star} is unique up to modifications on a null set of [0,1] . In particular, the ACM can be expressed as \gamma_{t}=\int_{0}^{t}\vartheta_{s}\mathrm{d}s,\qquad t\in[0,1], for any solution (\vartheta,g) to ( 5.2.14 ). All proofs are deferred to the supplement. Example 3 . Continuing Example 2 we see that for the partially additive hazards model given by ( 5.2.9 ), the minimizer given by Proposition 5.2.1 is \displaystyle\vartheta^{\star}_{t} \displaystyle=\cov\!\big(G_{t},Y_{t}\big(\bm{h}_{t}(\mkern 2.0mu\overline{\mkern-2.0muX\mkern 0.0mu}\mkern 0.0mu_{t},\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t})-h_{t}(\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t})\big)\big) \displaystyle=\cov\!\big(G_{t},\theta_{t}Y_{t}\big(X_{s}-\pi_{t}(\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t})\big)\big) \displaystyle=\frac{\theta_{t}\mathbb{E}[Y_{t}(X_{t}-\pi_{t}(\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t}))^{2}]}{\rho(s)}=\theta_{t}. Thus, as also established directly in Example 2 , for the partially additive hazards model, \gamma_{t}=\Theta_{t}=\int_{0}^{t}\theta_{s}\mathrm{d}s . Example 4 . As a generalization of the introductory Example 1 , suppose that X_{t}\in\{0,1\} and that \bm{h}_{t}(\mkern 2.0mu\overline{\mkern-2.0muX\mkern 0.0mu}\mkern 0.0mu_{t},\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t})=X_{t}\theta_{t}(\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t})+g_{t}(\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t}). If \theta_{t}(\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t}) does not depend on \mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t} , this model is also a partially additive hazards model. In general, we see that h_{t}(\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t})=\pi_{t}(\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t})\theta_{t}(\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t})+g_{t}(\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t}) where \pi_{t}(\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t})=\mathbb{P}(X_{t}=1\,|\,T\geq t,\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t}) . Hence, \displaystyle\rho(t) \displaystyle=\mathbb{E}\left[Y_{t}(X_{t}-\pi_{t}(\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t}))^{2}\right] \displaystyle=\mathbb{E}\left[Y_{t}\mathbb{E}\left[(X_{t}-\pi_{t}(\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t}))^{2}\mid T\geq 1,\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t}\right]\right] \displaystyle=\mathbb{E}\left[Y_{t}\pi_{t}(\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t})(1-\pi_{t}(\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t}))\right]. The minimizer given by Proposition 5.2.1 is \displaystyle\vartheta^{\star}_{t} \displaystyle=\cov\!\big(G_{t},Y_{t}\big(\bm{h}_{t}(\mkern 2.0mu\overline{\mkern-2.0muX\mkern 0.0mu}\mkern 0.0mu_{t},\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t})-h_{t}(\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t})\big)\big) \displaystyle=\cov\!\big(G_{t},\theta_{t}(\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t})Y_{t}\big(X_{t}-\pi_{t}(\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t})\big)\big) \displaystyle=\mathbb{E}\left[\theta_{t}(\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t})\frac{Y_{t}\mathbb{E}\left[\big(X_{t}-\pi_{t}(\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t})\big)^{2}\,|\,T\geq t,Z\right]}{\rho(t)}\right] \displaystyle=\mathbb{E}\left[\theta_{t}(\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t})\frac{Y_{t}\pi_{t}(\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t})(1-\pi_{t}(\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t}))}{\mathbb{E}\left[Y_{t}\pi_{t}(\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t})(1-\pi_{t}(\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t}))\right]}\right] \displaystyle=\mathbb{E}\left[\theta_{t}(\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t})w_{t}^{\textsc{ac}}(\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t})\right], where the Aalen covariance weights are w_{t}^{\textsc{ac}}(Z)=\frac{Y_{t}\pi_{t}(\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t})(1-\pi_{t}(\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t}))}{\mathbb{E}\left[Y_{t}\pi_{t}(\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t})(1-\pi_{t}(\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t}))\right]}. (5.2.15) In the special case with baseline exposure and baseline covariates, as treated in Example 1 , these weights reduce to the weights in ( 5.1.3 ), and the estimand given by ( 5.1.4 ) is, indeed, the ACM. To give a more specific example of a model that is not a partially additive model, suppose that Z_{t}\in\real^{d} and that \theta_{t}(\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t})=\theta^{T}Z_{t} for \theta\in\real^{d} . Then \gamma_{t}^{w}=\theta^{T}\int_{0}^{t}\mathbb{E}[Z_{s}w_{s}^{\textsc{ac}}(\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{s})]\mathrm{d}s=\theta^{T}\omega_{t}^{\textsc{ac}}=\sum_{k=1}^{d}\theta_{k}\omega_{k,t}^{\textsc{ac}} is a linear combination of the \theta_{k} -parameters with \omega_{k,t}^{\textsc{ac}}=\int_{0}^{t}\mathbb{E}\left[Z_{k,s}w_{s}^{\textsc{ac}}(\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{s})\right]\mathrm{d}s . Proposition 5.2.1 allows us to interpret the ACM as a cumulative direct effect in the best L^{2} model-approximation by a partially additive hazards model. This underlines that the ACM is well-defined and retains some level of interpretability for (small) deviations from the partially additive model. In contrast, the model-based target parameter in ( 5.2.11 ) is a priori undefined when the partially additive model is misspecified. Beyond the partially additive model, as treated in Examples 2 and 3 , we cannot expect the ACM to have a simple closed-form expression. Even for the simple baseline model ( 5.1.2 ), the innocent looking representation \gamma_{t}=\int_{0}^{t}\mathbb{E}\left[\theta_{s}(Z)w_{s}^{\textsc{ac}}(Z)\right]\mathrm{d}s, that follows from Example 4 , involves the weights and in turn the predictable projections \pi_{t}(Z) . We elaborate on the computation of \pi_{t}(Z) for a multiplicative (baseline) hazards model in supplementary Section 5 , and we discuss the representation of the ACM further for the Cox proportional hazards model in Example 5 . 5.2.4 Censoring Let N_{t}^{*}\coloneq\mathbbl{1}(T^{*}\leq t) denote the uncensored counting process, and let N_{t}^{\mathrm{c}}=\mathbbl{1}(C\leq t) denote the counting process for censoring. Recall the definitions of the filtrations \mathcal{F}_{t} and \mathcal{G}_{t} in Remark 1 , and define similarly the filtrations \mathcal{F}_{t}^{*}\coloneq\sigma(Z_{s},N_{s}^{*};s\leq t) and \mathcal{G}_{t}^{*}\coloneq\sigma(X_{s},Z_{s},N_{s}^{*};s\leq t) . We assume two conditions on the censoring mechanism, both are forms of independent right-censoring in the sense of Andersen et al. (1993) . We refer to Martinussen and Scheike (2006) ; Andersen et al. (1993) for interpretations and intuition behind this type of censoring. Formulated in terms of local independence as in ( Røysland et al., 2022 ) , we specifically assume that N_{t}^{*} is locally independent of N_{t}^{\mathrm{c}} given both \mathcal{F}_{t} and \mathcal{G}_{t} . Alternatively, the censoring condition may be formulated as in Assumption 5.2.1 below. An equivalent definition of the conditional hazards, h_{s} and \bm{h}_{s} , is that N_{t}^{*}-\int_{0}^{t}\mathbbl{1}(T^{*}\geq s)h_{s}(\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{s})\mathrm{d}s\qquad\text{and}\qquad N_{t}^{*}-\int_{0}^{t}\mathbbl{1}(T^{*}\geq s)\bm{h}_{s}(\mkern 2.0mu\overline{\mkern-2.0muX\mkern 0.0mu}\mkern 0.0mu_{t},\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{s})\mathrm{d}s are martingales with respect to the filtrations \mathcal{F}_{t}^{*} and \mathcal{G}_{t}^{*} , respectively. Independent right-censoring means that the conditional hazards also yield valid compensators of the observed counting process in the following sense. Assumption 5.2.1 (Independent right-censoring) . It holds that \displaystyle N_{t}-\int_{0}^{t}\mathbbl{1}(T\geq s)h_{s}(\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{s})\mathrm{d}s\qquad\text{and}\qquad N_{t}-\int_{0}^{t}\mathbbl{1}(T\geq s)\bm{h}_{s}(\mkern 2.0mu\overline{\mkern-2.0muX\mkern 0.0mu}\mkern 0.0mu_{t},\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{s})\mathrm{d}s are martingales with respect to the filtrations \mathcal{F}_{t} and \mathcal{G}_{t} , respectively. All of our results regarding estimation and asymptotic theory will rely on Assumption 5.2.1 , and no other assumptions on censoring. It is natural to ask if the ACM depends on the censoring distribution. For the partially additive hazards model ( 5.2.9 ), the ACM is determined by the conditional hazard \bm{h} and is thus unaffected by the censoring distribution in this special case. However, the more general interpretations of the ACM in ( 5.2.12 ) and in Proposition 5.2.1 depend a priori on the censoring distribution via the at-risk indicator Y_{t} . In view of ( 5.2.12 ), the ACM is unaffected by censoring if for all t\in[0,1] , \displaystyle\frac{\mathbb{E}[u(\mkern 2.0mu\overline{\mkern-2.0muX\mkern 0.0mu}\mkern 0.0mu_{t},\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t})\,|\,C\geq t,T^{*}\geq t]}{\mathbb{E}[v(X_{t},\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t})\,|\,C\geq t,T^{*}\geq t]}=\frac{\mathbb{E}[u(\mkern 2.0mu\overline{\mkern-2.0muX\mkern 0.0mu}\mkern 0.0mu_{t},\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t})\,|\,T^{*}\geq t]}{\mathbb{E}[v(X_{t},\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t})\,|\,T^{*}\geq t]}, where \displaystyle u(\mkern 2.0mu\overline{\mkern-2.0muX\mkern 0.0mu}\mkern 0.0mu_{t},\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t}) \displaystyle=(X_{t}-\pi_{t}(\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t}))(\bm{h}_{t}(\mkern 2.0mu\overline{\mkern-2.0muX\mkern 0.0mu}\mkern 0.0mu_{t},\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t})-h_{t}(\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t})), \displaystyle v(X_{t},\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t}) \displaystyle=(X_{t}-\pi_{t}(\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t}))^{2}. This holds, for example, when C\,\perp\!\!\!\perp\,X,Z,T^{*} . 5.3 Estimation We let [n]=\{1,\ldots,n\} for n\in\mathbb{N} and assume that a sample of n observations, (\mathbf{W}^{(i)})_{i\in[n]}=(T^{(i)},\Delta^{(i)},X^{(i)},Z^{(i)})_{i\in[n]} , is available as independent copies of the template observation \mathbf{W}\coloneq(T,\Delta,X,Z) . For each index i\in[n] , we use a superscript notation, (i) , for the corresponding quantities introduced in Section 5.2 . For example, M_{t}^{(i)}=N_{t}^{(i)}-H_{t\wedge T^{(i)}}(\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t\wedge T^{(i)}}^{(i)}) is the Z^{(i)} -compensated counting process, where N_{t}^{(i)}=\mathbbl{1}(T^{(i)}\leq t,\Delta^{(i)}=1) . We will use cross-fitting to construct an estimator of the ACM, but for simplicity we first describe our estimator based on single sample split [n]=\mathcal{I}_{1}\cup\mathcal{I}_{2} , where \mathcal{I}_{1} and \mathcal{I}_{2} are disjoint sets. For convenience we let n_{1}\coloneq|\mathcal{I}_{1}| and n_{2}\coloneq|\mathcal{I}_{2}| , and we assume that \min\{n_{1},n_{2}\}\to\infty as n\to\infty . The data indexed by \mathcal{I}_{1} , henceforth called the training data , is used to compute estimates \widehat{\pi}_{t} and \widehat{h}_{t} of the functions \pi_{t} and h_{t} . The remaining data (\mathbf{W}_{i})_{i\in\mathcal{I}_{2}} is used to compute the estimate of ACM by the following three-step procedure: 1. Compute an estimate of \rho(\cdot) , as defined by ( 5.2.6 ). Such an estimate could be \tilde{\rho}(t)=\frac{1}{n_{2}}\sum_{i\in\mathcal{I}_{2}}Y_{t}^{(i)}\big(X_{t}^{(i)}-\widehat{\pi}_{t}(\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t}^{(i)})\big)^{2}. (5.3.16) Since we need to divide by an estimate of \rho(\cdot) , it will be convenient to consider a clipped estimate of the form \widehat{\rho}(\cdot)=\max\{\tilde{\rho}(\cdot),c\} for some c>0 . We return to this discussion in both the general theory and for practical considerations. 2. Compute estimates of the residual process and Z^{(i)} -compensated counting process by \displaystyle\widehat{G}_{t}^{(i)} \displaystyle=\widehat{\rho}(t)^{-1}Y_{t}^{(i)}(X_{t}^{(i)}-\widehat{\pi}_{t}(\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t}^{(i)})), (5.3.17) \displaystyle\lx@scalerel@obj{\hat{\lx@scalerel@obj{M}}}_{t}^{(i)} \displaystyle=N_{t}^{(i)}-\int_{0}^{t}Y_{s}\,\widehat{h}_{s}(\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{s}^{(i)})\mathrm{d}s, for each index i\in\mathcal{I}_{2} . 3. Compute the ACM estimator, denoted \widehat{\gamma}=(\widehat{\gamma}_{t}) , by \widehat{\gamma}_{t}=\frac{1}{n_{2}}\sum_{i\in\mathcal{I}_{2}}\int_{0}^{t}\widehat{G}_{s}^{(i)}\mathrm{d}\lx@scalerel@obj{\hat{\lx@scalerel@obj{M}}}_{s}^{(i)},\qquad t\in[0,1]. (5.3.18) While the formula ( 5.3.18 ) is the same for the LCM estimator proposed in Christgau et al. (2023b) , there is an important technical distinction: the residual estimate \widehat{G}_{t}^{(i)} cannot be determined from the training data and i -th observation alone, since the estimate \widehat{\rho} is based on all of the data indexed by \mathcal{I}_{2} . Thus the residual estimates are not conditionally independent given the training data, which makes the theoretical analysis of the estimator a bit more involved. See the discussion in Section 5.6 for an elaboration regarding this difference. A general procedure for computing the ACM estimator is described in Algorithm 1 . There are additional numerical challenges when computing the ACM estimator in practice. The estimator ( 5.3.18 ) is, for instance, defined as an integral, and its practical evaluation may require numerical integration. We return to this practical discussion in Section 5.5.1 . Algorithm 1 Single split estimate of ACM input : sample (T^{(i)},\Delta^{(i)},X^{(i)},Z^{(i)})_{i\in[n]} and partition \mathcal{I}_{1}\cup\mathcal{I}_{2}=[n] ; 1 options : regression methods for estimation of h_{t}(\cdot) and \pi_{t}(\cdot) ; 2 begin 3 fit conditional hazard \widehat{h}_{t}(\cdot) by regressing (T^{(i)},\Delta^{(i)})_{i\in\mathcal{I}_{1}} onto (\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu^{(i)}_{t})_{i\in\mathcal{I}_{1}} ; 4 fit projection \widehat{\pi}_{t}(\cdot) by regressing (X^{(i)}_{t})_{i\in\mathcal{I}_{1}} onto (T^{(i)},\Delta^{(i)},\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu^{(i)}_{t})_{i\in\mathcal{I}_{1}} ; 5 compute \widehat{\rho}(\cdot) using \widehat{\pi}_{t}(\cdot) and (T^{(i)},\Delta^{(i)},X^{(i)},Z^{(i)})_{i\in\mathcal{I}_{2}} ; 6 compute (\widehat{G}^{(i)},\lx@scalerel@obj{\hat{\lx@scalerel@obj{M}}}^{(i)})_{i\in\mathcal{I}_{2}} according to ( 5.3.17 ); 7 output : the ACM estimate \widehat{\gamma}_{t}=\frac{1}{n_{2}}\sum_{i\in\mathcal{I}_{2}}\int_{0}^{t}\widehat{G}_{s}^{(i)}\mathrm{d}\lx@scalerel@obj{\hat{\lx@scalerel@obj{M}}}_{s}^{(i)} ; 5.3.1 Cross-fitted ACM estimator The ACM estimator defined in ( 5.3.18 ), and described in Algorithm 1 , is based on a single data split [n]=\mathcal{I}_{1}\cup\mathcal{I}_{2} and only uses the data indexed by \mathcal{I}_{2} for estimation of the target. The more sophisticated technique of 2-fold cross-fitting produces an additional estimate by swapping the roles of \mathcal{I}_{1} and \mathcal{I}_{2} and aggregates the two estimates by averaging. More generally, K -fold cross-fitting partitions the data into K disjoint folds, and cyclically uses each fold for estimation of the ACM. We assume that the folds have sizes at least \lfloor{n/K}\rfloor and at most \lceil{n/K}\rfloor . The procedure is described in detail in Algorithm 2 , and the resulting cross-fitted estimator is referred to as the x-acm and is denoted by \widecheck{\gamma} . We refer to Chernozhukov et al. (2018) and references therein for a more general description of cross-fitting. Algorithm 2 K -fold cross-fitted x-acm input : sample (T^{(i)},\Delta^{(i)},X^{(i)},Z^{(i)})_{i\in[n]} and partition J_{1}\cup\cdots\cup J_{K}=[n] ; 1 options : options for Algorithm 1 ; 2 begin 3 for k=1,\ldots,K do 4 compute \widehat{\gamma}^{k} using Algorithm 1 with \mathcal{I}_{1}=\bigcup_{\ell\neq k}J_{\ell} and \mathcal{I}_{2}=J_{k} ; 5 output : the x-acm estimate \widecheck{\gamma}=\frac{1}{K}\sum_{k=1}^{K}\widehat{\gamma}^{k} 5.4 Asymptotic theory We present in this section asymptotic representations of the estimation errors, \widehat{\gamma}-\gamma and \widecheck{\gamma}-\gamma , for the sample split and cross-fit estimators. We leverage these representations to derive asymptotic Gaussian process limits, which can be used for statistical inference. The asymptotic properties of the general LCM estimator were analyzed in Christgau et al. (2023b) for the specific purpose of understanding type I and type II errors of the Local Covariance Test – a test of local independence based on the LCM estimator. In Christgau et al. (2023b) it was established, under suitable regularity conditions, that: • The asymptotic limit of the LCM estimator is a Gaussian martingale under the null hypothesis \gamma=0 . • The LCM estimator is \sqrt{n} -consistent using the additive residual process X_{t}-\Pi_{t} . These results cannot directly be applied to our proposed ACM estimator, as the residual estimates in ( 5.3.17 ) are constructed with a mutual dependence via \widehat{\rho} . However, by tailoring the theoretical analysis to the residual process given by ( 5.2.7 ), and its corresponding estimates in ( 5.3.17 ), we establish the asymptotic Gaussian process limit of \sqrt{n_{2}}(\widehat{\gamma}-\gamma) , also under the alternative \gamma\neq 0 . It will be instructive and useful for the general analysis to first understand the asymptotics of the ACM estimator in the simplified scenario where \rho is assumed known. In this case we can largely use the results from Christgau et al. (2023b) , and we can then in Section 5.4.2 combine these results with a decomposition of the full estimation error to arrive at the general results when \rho is estimated. 5.4.1 Asymptotics with a \rho -oracle In this section we analyze the asymptotics of the \rho -oracle estimator \displaystyle\widetilde{\gamma}_{t}\coloneq\frac{1}{n_{2}}\sum_{i\in\mathcal{I}_{2}}\int_{0}^{t}\frac{Y_{t}^{(i)}(X_{t}^{(i)}-\widehat{\pi}_{t}(\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t}^{(i)}))}{\rho(s)}\mathrm{d}\lx@scalerel@obj{\hat{\lx@scalerel@obj{M}}}_{s}^{(i)},\qquad t\in[0,1]. (5.4.19) That is, we assume that \rho is known and not estimated. Since the terms in the sum are conditionally i.i.d. given (\widehat{\pi}_{t},\widehat{h}_{t}) – and these nuisance estimates are obtained from the training data only – the estimator \widetilde{\gamma}_{t} fits into the framework of Christgau et al. (2023b) . While Christgau et al. (2023b) did not establish an asymptotic limit in the alternative \gamma\neq 0 , we can follow their initial asymptotic analysis. To this end, it will be convenient to first define the processes \displaystyle E_{t} \displaystyle\coloneq Y_{t}(X_{t}-\Pi_{t})=\rho(t)G_{t}, (5.4.20) \displaystyle\widehat{E}_{t} \displaystyle\coloneq Y_{t}(X_{t}-\widehat{\pi}_{t}(\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t}))=\widehat{\rho}(t)\widehat{G}_{t}. (5.4.21) The following assumption is essentially a reformulation of Assumption 4.1 in ( Christgau et al., 2023b ) . Assumption 5.4.1 (Boundedness) . There exist constants C_{\bm{h}},C_{E},c_{\rho}>0 such that for each t\in[0,1] : (i) Y_{t}\max\big\{\bm{h}_{t}(\mkern 2.0mu\overline{\mkern-2.0muX\mkern 0.0mu}\mkern 0.0mu_{t},\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t}),\ \widehat{h}_{t}(\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t})\big\}\leq C_{\bm{h}} . (ii) \max\{|E_{t}|,|\widehat{E}_{t}|\}\leq C_{E} . (iii) \rho(t)\geq c_{\rho} . A few remarks regarding Assumption 5.4.1 are in order. Remark 2 (Remarks on boundedness assumptions) . 1. From the innovation theorem it follows that Y_{t}\bm{h}_{t}(\mkern 2.0mu\overline{\mkern-2.0muX\mkern 0.0mu}\mkern 0.0mu_{t},\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t})\leq C_{\bm{h}}\implies Y_{t}h_{t}(\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t})\leq C_{\bm{h}}. Since hazards are non-negative, the assumption (i) also entails the bounds Y_{t}|\bm{h}_{t}(\mkern 2.0mu\overline{\mkern-2.0muX\mkern 0.0mu}\mkern 0.0mu_{t},\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t})-h_{t}(\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t})|\leq C_{\bm{h}} and Y_{t}|h_{t}(\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t})-\widehat{h}_{t}(\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t})|\leq C_{\bm{h}} .x 2. If the exposure process takes values in an interval, that is, X_{t}\in[a,b] , then also \Pi_{t}\in[a,b] and it is reasonable to impose \widehat{\pi}_{t}\in[a,b] . In this case, (ii) is satisfied with C_{E}=b-a . 3. Note that \rho(t)=\mathbb{P}(T\geq t)\mathbb{E}[(X_{t}-\Pi_{t})^{2}\,|\,T\geq t]. Thus Assumption 5.4.1 (iii) is equivalent to the two conditions: \mathbb{P}(T\geq 1)>0 and \inf_{t\in[0,1]}\mathbb{E}[(X_{t}-\Pi_{t})^{2}\,|\,T\geq t]>0 . The first is natural in order to perform statistical inference up to time t=1 . The second condition should also not be surprising: even for the partially additive model we would need \mathbb{E}[(X_{t}-\Pi_{t})^{2}\,|\,T\geq t]>0 for all t\in[0,1] to identify the coefficient \theta_{t} . In case that (iii) appears to be violated for the observed data, it is always possible to restrict the observation window and target the ACM over a shorter timespan. To establish convergence it is, of course, also necessary to control the estimation error of the nuisance parameters. Assumption 5.4.2 (Analogous to Assumption 4.2 in Christgau et al. (2023b) ) . With \displaystyle a_{n}\coloneq\int_{0}^{1}\mathbb{E}\Big[Y_{t}(\widehat{\pi}_{t}(\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t})-\pi_{t}(\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t}))^{2}\Big]\mathrm{d}t,\quad\text{and}\quad b_{n}\coloneq\int_{0}^{1}\mathbb{E}\Big[Y_{t}(\widehat{h}_{t}(\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t})-h_{t}(\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t}))^{2}\Big]\mathrm{d}t, it holds that \displaystyle\max\{a_{n},b_{n},n_{2}\cdot a_{n}b_{n}\}\longrightarrow 0 as n\to\infty . Under these assumptions, it follows that \widetilde{\gamma}_{t} is asymptotically equivalent to the corresponding oracle term, where the nuisance estimates (\widehat{\pi}_{t},\widehat{h}_{t}) are replaced with (\pi_{t},h_{t}) . Proposition 5.4.1 . Under Assumptions 5.4.1 and 5.4.2 , it holds that \sup_{t\in[0,1]}|\sqrt{n_{2}}\cdot\widetilde{\gamma}_{t}-U_{t}|\xrightarrow{P}0 as n\to\infty , where (U_{t}) is the oracle process given by U_{t}=\frac{1}{\sqrt{n_{2}}}\sum_{i\in\mathcal{I}_{2}}\int_{0}^{t}G_{s}^{(i)}\mathrm{d}M_{s}^{(i)},\qquad t\in[0,1]. The proof of Proposition 5.4.1 is largely based on the results of Christgau et al. (2023b) , with a few minor modifications. Under Assumptions 5.4.1 and 5.4.2 , it is possible to establish that the process U-\sqrt{n_{2}}\gamma converges in distribution to a continuous Gaussian process by appealing to a central limit theorem in Skorokhod space. However, as we are primarily interested in the actual ACM estimator, \widehat{\gamma} , we return to the asymptotics of the process (U_{t}) in the proof of Theorem 5.4.4 , see Section 5.A.6 in the supplement, where it is analyzed in combination with another non-vanishing term. Remark 3 . It should be possible to weaken the rate requirements to the empirical errors. To wit, if we define \displaystyle\tilde{a}_{n} \displaystyle\coloneq\frac{1}{n_{2}}\sum_{i\in\mathcal{I}_{2}}\int_{0}^{1}Y_{t}^{(i)}(\widehat{\pi}_{t}(\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu_{t}^{(i)})-\pi_{t}(\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu^{(i)}))^{2}\mathrm{d}t, \displaystyle\tilde{b}_{n} \displaystyle\coloneq\frac{1}{n_{2}}\sum_{i\in\mathcal{I}_{2}}\int_{0}^{1}Y_{t}^{(i)}(\widehat{h}_{t}(\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu^{(i)})-h_{t}(\mkern 2.0mu\overline{\mkern-2.0muZ\mkern 0.0mu}\mkern 0.0mu^{(i)}))^{2}\mathrm{d}t, then Assumption 5.4.2 can likely be replaced by the weaker condition that \max\{\tilde{a}_{n},\tilde{b}_{n},n_{2}\cdot\tilde{a}_{n}\tilde{b}_{n}\}\xrightarrow{P}0,\qquad n\to\infty. In fact, (\tilde{a}_{n},\tilde{b}_{n})\xrightarrow{P}0 is equivalent with (a_{n},b_{n})=(\mathbb{E}[\tilde{a}_{n}],\mathbb{E}[\tilde{b}_{n}])\to 0 under Assumption 5.4.1 due to uniform integrability. The scaled product error, n_{2}\cdot\tilde{a}_{n}\tilde{b}_{n} , is not a priori uniformly integrable, so its convergence does not imply that n_{2}\cdot a_{n}b_{n}\to 0 . 5.4.2 Asymptotics when \rho is estimated To analyze the ACM estimator in the general case, where \rho is estimated, we consider the decomposition \displaystyle\sqrt{n_{2}}\cdot\widehat{\gamma}=\sqrt{n_{2}}\cdot\widetilde{\gamma}+B, (5.4.22) where \widetilde{\gamma} is the \rho -oracle estimator defined as in ( 5.4.19 ), and where B is the process given by \displaystyle B_{t}=\frac{1}{\sqrt{n_{2}}}\sum_{i\in\mathcal{I}_{2}}\int_{0}^{t}\left(\frac{1}{\widehat{\rho}(s)}-\frac{1}{\rho(s)}\right)\widehat{E}_{s}^{(i)}\mathrm{d}\lx@scalerel@obj{\hat{\lx@scalerel@obj{M}}}_{s}^{(i)}. In Proposition 5.4.1 we found an asymptotically equivalent oracle process for \sqrt{n_{2}}\cdot\widetilde{\gamma} . We proceed to find an asymptotically equivalent oracle process for B , and then we identify the limit distribution of the sum of the oracle processes. The decompositions of \widetilde{\gamma} and B into oracle terms and remainder terms can be found in the proofs of Proposition 5.4.1 and Theorem 5.4.3 . In view of Assumption 5.4.1 (iii) , we will for our general theory, and in the residual estimates \widehat{G}^{(i)} , consider the clipped estimator \widehat{\rho} given by \widehat{\rho}(t)=\max\{c_{\widehat{\rho}},\tilde{\rho}(t)\}, (5.4.23) for a c_{\widehat{\rho}}>0 and where \tilde{\rho} is the empirical estimate from ( 5.3.16 ). We assume that c_{\widehat{\rho}} is chosen such that \lim_{n\to\infty}c_{\widehat{\rho}}=0 and c_{\widehat{\rho}}^{-1}=o(\sqrt{n_{2}}) , or in other words, c_{\widehat{\rho}} tends to zero, but slower than 1/\sqrt{n_{2}} . In particular, this implies that c_{\widehat{\rho}}t) . This corresponds to directly targeting the quantity \pi_{t}(Z)=\mathbb{E}[X\,|\,Y_{t}=1,Z] , rather than targeting \mathbb{E}[X\,|\,Y_{t},Z_{t}] as done in the steps (3) and (4) . Both methods were tried initially, with no noteworthy differences in the analysis result observed. For the interpolation in step (5) , it is important that the method preserves predictability, which would not be ensured by, e.g., linear interpolation . For conditional hazard estimation, we considered two off-the-shelf implementations: GradientBoostingSurvivalAnalysis from the scikit-survival module ( Pölsterl, 2020 ) and the AalenAdditiveFitter from the lifelines package ( Davidson-Pilon, 2019 ) . The two methods are again indicated by a subscript gb and lin , respectively. The estimate \widehat{\rho} was computed with the clipping value c_{\widehat{\rho}}=0.005 . However, the estimate was set to ‘ nan ’ rather than c_{\widehat{\rho}} whenever \tilde{\rho}(t)\varepsilon\Big)\leq\frac{1}{\varepsilon^{2}}\mathbb{E}\big[(\tilde{R}_{1}^{(\ell)})^{2}\,\big] (5.A.10) for \ell\in\{2,4\} . Now using the calculus of the quadratic characteristic for compensated counting processes (see, for example, Proposition II.4.1 in ( Andersen et al., 1993 ) ) we obtain \displaystyle\mathbb{E}\Big[(\tilde{R}_{1}^{(2)})^{2}\Big]=\mathbb{E}\Big[\langle\tilde{R}_{1}^{(2)}\rangle\Big] \displaystyle=\mathbb{E}\Big[\int_{0}^{1}\zeta_{t}^{2}\widehat{E}_{t}^{2}\bm{\lambda}_{t}\mathrm{d}t\Big] \displaystyle=C_{\bm{h}}C_{E}^{2}\int_{0}^{1}\frac{(\rho(t)-\widehat{\rho}(t))^{2}}{\rho(t)^{4}}\mathrm{d}t\leq c_{\rho}^{-4}C_{\bm{h}}C_{E}^{2}\|\rho-\widehat{\rho}\|_{2}^{2}\to 0. Similarly, observe that \displaystyle\mathbb{E}\big[(\tilde{R}_{1}^{(4)})^{2}\big]=\mathbb{E}\Big[\langle\tilde{R}_{1}^{(4)}\rangle\Big] \displaystyle=\mathbb{E}\Big[\int_{0}^{1}\xi_{t}^{2}\widehat{E}_{t}^{2}\bm{\lambda}_{t}\mathrm{d}t\Big] \displaystyle\leq C_{\bm{h}}C_{E}^{2}\int_{0}^{1}\frac{(\rho(t)-\widehat{\rho}(t))^{4}}{\widehat{\rho}(t)^{2}\rho(t)^{4}}\mathrm{d}t\leq c_{\widehat{\rho}}^{-2}c_{\rho}^{-4}C_{\bm{h}}C_{E}^{6}\|\rho-\widehat{\rho}\|_{2}^{2}\to 0, where the convergence follows from Proposition 5.4.2 and the fact that c_{\widehat{\rho}}^{-2}=o(n) . Combined with ( 5.A.10 ), we conclude that ( 5.A.7 ) holds for \ell=2 and \ell=4 . For the final term, a direct bound yields \displaystyle\mathbb{E}\Big[\sup_{t\in[0,1]}|\tilde{R}_{t}^{(5)}|\Big]\leq C_{E}C_{\bm{h}}\sqrt{n_{2}}\|\xi\|_{1}\leq c_{\rho}^{-2}c_{\widehat{\rho}}^{-1}C_{E}C_{\bm{h}}\sqrt{n_{2}}\|\rho-\widehat{\rho}\|_{2}^{2}\to 0. Thus we have established ( 5.A.7 ) for \ell\in\{1,2,3,4,5\} . ∎ Proposition 5.A.3 . Under Assumptions 5.4.1 and 5.4.3 , it holds that \sup_{t\in[0,1]}|\tilde{B}_{t}-V_{t}|\xrightarrow{P}0, where V=(V_{t}) is the process given by \displaystyle V_{t}=\frac{1}{\sqrt{n_{2}}}\sum_{i\in\mathcal{I}_{2}}\int_{0}^{t}\frac{(\rho(s)-(E_{s}^{(i)})^{2})}{\rho(s)^{2}}\mathbb{E}[E_{s}(\bm{\lambda}_{s}-\lambda_{s})]\mathrm{d}s,\qquad t\in[0,1]. Proof. The results follows from combining Lemmas 5.A.4 and 5.A.5 . ∎ Lemma 5.A.4 . Under Assumptions 5.4.1 and 5.4.3 , it holds that \sup_{t\in[0,1]}|\tilde{B}_{t}-\widehat{V}_{t}|\xrightarrow{P}0 , where \widehat{V}=(\widehat{V}_{t}) is the process given by \displaystyle\widehat{V}_{t} \displaystyle=\sqrt{n_{2}}\int_{0}^{t}\zeta_{s}\mathbb{E}[E_{s}(\bm{\lambda}_{s}-\lambda_{s})]\mathrm{d}s,\qquad t\in[0,1]. Proof. Letting \|\cdot\|_{[0,1]} denote the norm on L^{2}([0,1],\mathrm{d}t) , an application of Cauchy-Schwarz yields that \displaystyle\sup_{t}|\tilde{B}_{t}-\widehat{V}_{t}| \displaystyle=\sqrt{n_{2}}\int_{0}^{1}|\zeta_{s}|\Big\lvert\frac{1}{n_{2}}\sum_{i\in\mathcal{I}_{2}}E_{s}^{(i)}(\bm{\lambda}_{s}^{(i)}-\lambda_{s}^{(i)})-\mathbb{E}[E_{s}(\bm{\lambda}_{s}-\lambda_{s})]\Big\rvert\mathrm{d}s \displaystyle=\Big\|\frac{1}{n_{2}}\sum_{i\in\mathcal{I}_{2}}E^{(i)}(\bm{\lambda}^{(i)}-\lambda^{(i)})-\mathbb{E}[E(\bm{\lambda}-\lambda)]\Big\|_{[0,1]}\cdot\sqrt{n_{2}}\|\zeta\|_{[0,1]} (5.A.11) Since \mathbb{E}\|E(\bm{\lambda}-\lambda)\|_{[0,1]}\leq C_{E}C_{\bm{h}}, the law of large numbers – in the space L^{2}([0,1]) – gives that the first factor of ( 5.A.11 ) converges to zero almost surely, and in particular also in probability. See for example Ledoux and Talagrand (1991, Cor. 7.10) for a general formulation of the law of large numbers on separable Banach spaces. For the second factor, we note that \sqrt{n_{2}}\|\zeta\|_{[0,1]}\leq c_{\rho}^{-2}\sqrt{n_{2}}\|\widehat{\rho}-\rho\|_{[0,1]}. The right-hand side is bounded in expectation by ( 5.4.24 ), and in particular it is bounded in probability. Combined we conclude that the right-hand side of ( 5.A.11 ) converges to zero in probability. ∎ Lemma 5.A.5 . Under Assumptions 5.4.1 and 5.4.3 , it holds that \mathbb{E}\Big[\sup_{t\in[0,1]}|\widehat{V}_{t}-V_{t}|\Big]\xrightarrow{P}0 Proof. Let \tilde{V}=(\tilde{V}_{t}) be the process given by \displaystyle\tilde{V}_{t}\coloneq\sqrt{n_{2}}\int_{0}^{t}\varsigma_{s}\mathbb{E}[E_{s}(\bm{\lambda}_{s}-\lambda_{s})]\mathrm{d}s,\qquad\text{where}\quad\varsigma_{s}\coloneq\frac{\rho(s)-\tilde{\rho}(s)}{\rho(s)^{2}}. In other words, \varsigma_{s} corresponds to \zeta_{s} , but where the clipped estimate, \widehat{\rho} , is replaced by the empirical estimate \tilde{\rho} from ( 5.3.16 ). As such, we have equality of the events (\varsigma_{s}\neq\zeta_{s})=(\tilde{\rho}(s)0 , such that for every 0\leq s0 independent of (s,t,u) . In fact, in each case the constant will be a polynomial over the constants C_{\bm{h}},C_{E} , and c_{\rho}^{-1} from Assumption 5.4.1 . We first note that J_{st}\lesssim t-s,\quad\text{and}\quad J_{tu}\lesssim u-t, (5.A.14) under Assumption 5.4.1 . Using the quadratic characteristic for compensated counting processes, we also have \displaystyle\mathbb{E}[I_{st}^{2}] \displaystyle\lesssim\mathbb{E}\Big[\Big(\int_{s}^{t}G_{r}\mathrm{d}\bm{M}_{r}\Big)^{2}\Big]+\mathbb{E}\Big[\Big(\int_{s}^{t}G_{r}(\bm{\lambda}_{r}-\lambda_{r})\mathrm{d}r\Big)^{2}\Big] \displaystyle=\mathbb{E}\Big[\int_{s}^{t}G_{r}^{2}\bm{\lambda}\mathrm{d}r\Big]+\mathbb{E}\Big[\Big(\int_{s}^{t}G_{r}(\bm{\lambda}_{r}-\lambda_{r})\mathrm{d}r\Big)^{2}\Big] \displaystyle\lesssim(t-s)+(t-s)^{2}\leq 2(t-s) Thus we conclude that \displaystyle\mathbb{E}[(I_{st}+J_{st})^{2}]\lesssim\mathbb{E}[I_{st}^{2}]+\mathbb{E}[J_{st}^{2}]\lesssim t-s. This shows that the condition ( 5.A.12 ) holds with \epsilon_{1}=\frac{1}{2} and F_{1}(r)=C_{1}r for a suitably large constant C_{1}>0 . For the second condition we have that \displaystyle\mathbb{E}[(I_{st}+J_{st})^{2}(I_{tu}+J_{tu})^{2}] \displaystyle\leq 4(\mathbb{E}[I_{st}^{2}I_{tu}^{2}]+\mathbb{E}[I_{st}^{2}J_{tu}^{2}]+\mathbb{E}[J_{st}^{2}I_{tu}^{2}]+\mathbb{E}[J_{st}^{2}J_{tu}^{2}]). By same argument as \mathbb{E}[I_{st}^{2}]\lesssim t-s , we also have that \mathbb{E}[I_{tu}^{2}]\lesssim t-u . Combining this with the inequality ( 5.A.14 ) we obtain \displaystyle\mathbb{E}[I_{st}^{2}J_{tu}^{2}]+\mathbb{E}[J_{st}^{2}I_{tu}^{2}]+\mathbb{E}[J_{st}^{2}J_{tu}^{2}]\lesssim(t-s)(u-t) For the term \mathbb{E}[I_{st}^{2}I_{tu}^{2}] , we note that if T\in(s,t] then M is constant on the interval (t,u] , in which case I_{tu}=0 . Therefore \displaystyle\mathbb{E}[I_{st}^{2}I_{tu}^{2}]=\mathbb{E}\left[\left(\int_{s}^{t}G_{r}\lambda_{r}\mathrm{d}r\right)^{2}I_{tu}^{2}\right]\lesssim(t-s)^{2}\mathbb{E}\left[I_{tu}^{2}\right]\lesssim(t-s)^{2}(u-t) Combined we conclude that \mathbb{E}[(I_{st}+J_{st})^{2}(I_{tu}+J_{tu})^{2}]\lesssim(t-s)(u-t)\leq(u-s)^{2}. This shows that the second condition ( 5.A.13 ) is satisfied with \epsilon=1 and F_{2}(r)=C_{2}r for a suitably large constant C_{2}>0 . ∎ Returning to the proof of Theorem 5.4.4 , the limit distribution of the ACM estimator is now a simple consequence of the continuous mapping theorem. 14 14 14 Applied to the map \mathbb{D}^{3}\ni(x,y,z)\mapsto x+y+z\in\mathbb{D} , where \mathbb{D} is the space of càglàd functions on [0,1] endowed with the uniform norm. Using the limits establised in Proposition 5.4.1 , Theorem 5.4.3 , and Theorem 5.A.6 , we conclude that \sqrt{n_{2}}(\;\!\widehat{\gamma}-\gamma)=\underbrace{S}_{\xrightarrow{d}\Gamma}+\underbrace{(\sqrt{n_{2}}\cdot\widetilde{\gamma}-U)}_{\xrightarrow{p}0}+\underbrace{(B-V)}_{\xrightarrow{p}0}\>\xrightarrow{\>d\>}\>\Gamma (5.A.15) in the uniform topology as n\to\infty . Turning to the cross-fitted ACM estimator, let \widehat{\gamma}^{k} denote ACM estimator fitted with \mathcal{I}_{1}=[n]\setminus J_{k} and \mathcal{I}_{2}=J_{k} for each k\in[K] . Let also S_{t}^{k}=\frac{1}{\sqrt{|J_{k}|}}\sum_{i\in J_{k}}s_{t}^{(i)},\qquad\text{where}\quad s_{t}^{(i)}\coloneq\int_{0}^{t}G_{s}^{(i)}\mathrm{d}M_{s}^{(i)}+\int_{0}^{t}E_{s}^{(i)}G_{s}^{(i)}\mathrm{d}\gamma_{s}, denote the corresponding oracle processes. In the following computation, we use x\sim y as a shorthand for \sup_{t\in[0,1]}|x_{t}-y_{t}|\xrightarrow{p}0 . Using that folds are assumed to have sizes |J_{k}|\in\{\lfloor{n/K}\rfloor,\lceil{n/K}\rfloor\} , Proposition 5.4.1 and Theorem 5.4.3 applied to each fold yields that \displaystyle\sqrt{n}(\widecheck{\gamma}-\gamma)\sim\frac{\sqrt{n}}{K}\sum_{k=1}^{K}\frac{S^{k}}{\sqrt{|J_{k}|}}=\frac{\sqrt{n}}{K}\sum_{k=1}^{K}\frac{1}{|J_{k}|}\sum_{i\in J_{k}}s^{(i)}\sim\frac{1}{\sqrt{n}}\sum_{i\in[n]}s^{(i)} where last equivalence follows from Lemma 5.A.7 . By the continuous mapping theorem, applied as in ( 5.A.15 ), it suffices to establish that \frac{1}{\sqrt{n}}\sum_{i\in[n]}s^{(i)}\xrightarrow{d}\Gamma . However, this is simply the CLT established in Theorem 5.A.6 with \mathcal{I}_{2}=[n] . \Box The following lemma is a Banach space generalization of one of the standard steps for proving validity of cross-fitting, cf. Lemma S1 in Lundborg and Pfister (2023) . Lemma 5.A.7 . Let W be a random element in a Banach space (\mathbb{D},\|\cdot\|) , satisfying that \mathbb{E}[\|W\|]<\infty , and let (W_{i})_{i\in\mathbb{N}} be i.i.d. copies of W . For a fixed K\in\mathbb{N} , let [n]=J_{1}\cup\cdots\cup J_{K} be a disjoint partition of [n] with |J_{k}|\in\{\lfloor{n/K}\rfloor,\lceil{n/K}\rfloor\} for each k\in[K] . Finally, let S=\frac{1}{n}\sum_{i\in[n]}W_{i} and S_{k}=\frac{1}{|J_{k}|}\sum_{i\in J_{k}}W_{i} for each k\in[K] . Then, for any r<1 , \displaystyle n^{r}\cdot\Big(\frac{1}{K}\sum_{k=1}^{K}S_{k}-S\Big)\xrightarrow{L^{1}}0 as n\to\infty . Proof. Note that \frac{1}{n+K}<\frac{1}{K|J_{k}|}<\frac{1}{n-K} and hence |\frac{1}{K|J_{k}|}-\frac{1}{n}|\leq\frac{1}{n-K}-\frac{1}{n}=\frac{K}{(n-K)n} . Since \displaystyle\frac{1}{K}\sum_{k=1}^{K}S_{k}-S=\sum_{k=1}^{K}\sum_{i\in J_{k}}\left(\frac{1}{K|J_{k}|}-\frac{1}{n}\right)W_{i}, we conclude that \displaystyle n^{r}\cdot\mathbb{E}\Big\|\frac{1}{K}\sum_{k=1}^{K}S_{k}-S\Big\|\leq\frac{Kn^{r}}{n-K}\mathbb{E}\|W\|\longrightarrow 0 as n\to\infty . ∎ 5.B. Multiplicative hazards models The predictable projection, \pi_{t}(\overline{Z}_{t})=\mathbb{E}[X_{t}\,|\,T\geq t,\overline{Z}_{t}] , is generally difficult to compute – even with baseline covariates Z and a binary baseline exposure X , where \pi_{t}(Z)=\mathbb{P}(X=1\,|\,T\geq t,Z) . However, for a multiplicative hazards model, and under a strengthened censoring assumption, we give a fairly explicit representation of \pi_{t}(Z) in Proposition 5.B.1 below. Example 5 elaborates further on the ACM in the Cox proportional hazards model. Proposition 5.B.1 (Predictable projection for binary exposure) . Suppose that X\in\{0,1\} is a binary baseline exposure, that Z is a baseline covariate and that the model is a nonparametric time-varying proportional hazards model: \displaystyle\bm{h}_{t}(X,Z)=(X\theta_{t}+1)\varphi_{t}(Z). If C\,\perp\!\!\!\perp\,(T^{*},X)\,|\,Z , then the predictable projection is given by \displaystyle\pi_{t}(Z)=\frac{\pi_{0}(Z)}{\pi_{0}(Z)+(1-\pi_{0}(Z))e^{\mathsf{I}_{t}(Z)}}, where \pi_{0}(Z)=\mathbb{P}(X=1\,|\,Z) is the (baseline) propensity score and \displaystyle\mathsf{I}_{t}(Z)\coloneq\int_{0}^{t}\theta_{s}\varphi_{s}(Z)\mathrm{d}s. The predictable projection can be expressed as the logistic model: \mathrm{logit}(\pi_{t}(Z))=\mathrm{logit}(\pi_{0}(Z))-\mathsf{I}_{t}(Z). Proof. Recall that Y_{t}=\mathbbl{1}(T\geq t)=\mathbbl{1}(C\geq t)\mathbbl{1}(T^{*}\geq t) . Using the definition of \pi_{t}(Z) and the conditional independence assumption regarding censoring, we find that \displaystyle\pi_{t}(Z) \displaystyle=\mathbb{E}[X\,|\,T\geq t,Z]=\frac{\mathbb{E}[XY_{t}\,|\,Z]}{\mathbb{P}(T\geq t\,|\,Z)} \displaystyle=\frac{\mathbb{E}[X\mathbbl{1}(T^{*}\geq t)\,|\,Z]\mathbb{P}(C\geq t\mid Z)}{\mathbb{P}(T^{*}\geq t\,|\,Z)\mathbb{P}(C\geq t\,|\,Z)} \displaystyle=\frac{\mathbb{E}[X\mathbbl{1}(T^{*}\geq t)\,|\,Z]}{\mathbb{P}(T^{*}\geq t\,|\,Z)}. Using the correspondence between survival time and cumulative hazard we obtain that \displaystyle\mathbb{E}[X\mathbbl{1}(T^{*}\geq t)\,|\,Z] \displaystyle=\mathbb{E}[X\cdot\mathbb{P}(T^{*}\geq t\,|\,X,Z)\,|\,Z] \displaystyle=\mathbb{E}\Big[X\exp\Big(-X\int_{0}^{t}\theta_{s}\varphi_{s}(Z)\mathrm{d}s-\int_{0}^{t}\varphi_{s}(Z)\mathrm{d}s\Big)\,|\,Z\Big] \displaystyle=\mathbb{P}(X=1\,|\,Z)\exp\Big(-\int_{0}^{t}\theta_{s}\varphi_{s}(Z)\mathrm{d}s-\int_{0}^{t}\varphi_{s}(Z)\mathrm{d}s\Big) \displaystyle=\pi_{0}(Z)e^{-\mathsf{I}_{t}(Z)-\mathsf{II}_{t}(Z)}, where \mathsf{I}_{t}(z)\coloneq\int_{0}^{t}\theta_{s}\varphi_{s}(z)\mathrm{d}s and \mathsf{II}_{t}(z)\coloneq\int_{0}^{t}\varphi_{s}(z)\mathrm{d}s . Similarly the denominator is given by \displaystyle\mathbb{P}(T^{*}\geq t\,|\,Z) \displaystyle=\mathbb{E}\left[\exp\left(-X\int_{0}^{t}\theta_{s}\varphi_{s}(Z)\mathrm{d}s-\int_{0}^{t}b_{s}\varphi_{s}(Z)\mathrm{d}s\right)\,|\,Z\right] \displaystyle=((1-\pi_{0}(Z))+e^{-\mathsf{I}_{t}(Z)}\pi_{0}(Z))e^{-\mathsf{II}_{t}(Z)}. From this we obtain that \displaystyle\pi_{t}(Z) \displaystyle=\frac{\pi_{0}(Z)e^{-\mathsf{I}_{t}(Z)}}{(1-\pi_{0}(Z))+e^{-\mathsf{I}_{t}(Z)}\pi_{0}(Z)} \displaystyle=\frac{\pi_{0}(Z)}{\pi_{0}(Z)+(1-\pi_{0}(Z))e^{\mathsf{I}_{t}(Z)}} \displaystyle=\frac{1}{1+e^{-\mathrm{logit}(\pi_{0}(Z))}e^{\mathsf{I}_{t}(Z)}}=\mathrm{expit}(\mathrm{logit}(\pi_{0}(Z))-\mathsf{I}_{t}(Z)). ∎ Example 5 (ACM in a Cox proportional hazards model) . With baseline covariates Z\in\real^{d} , in addition to a binary exposure X\in\{0,1\} , the Cox proportional hazards model asserts that: \displaystyle\bm{h}_{t}(X,Z)=h^{0}(t)\exp(\beta_{X}X+\beta_{Z}^{\top}Z)=(X(e^{\beta_{X}}-1)+1)h^{0}(t)\exp(\beta_{Z}^{\top}Z). (5.B.1) Letting \phi(Z)=(e^{\beta_{X}}-1)e^{\beta_{Z}^{\top}Z} we see that this model is a special case of Example 1 with \theta_{t}(Z)=h^{0}(t)\phi(Z) . It follows by ( 5.1.4 ) that the ACM can be expressed as \displaystyle\gamma_{t} \displaystyle=\int_{0}^{t}\mathbb{E}\left[h^{0}(s)\phi(Z)w_{s}^{\textsc{ac}}(Z)\right]\mathrm{d}s \displaystyle=\mathbb{E}\Big[\phi(Z)\underbrace{\int_{0}^{t}h^{0}(s)w_{s}^{\textsc{ac}}(Z)\mathrm{d}s}_{\eqcolon W_{t}^{\textsc{ac}}(Z)}\Big]=\mathbb{E}\left[\phi(Z)W_{t}^{\textsc{ac}}(Z)\right]=\mathbb{E}\left[e^{\beta_{Z}^{\top}Z}W_{t}^{\textsc{ac}}(Z)\right](e^{\beta_{X}}-1). Thus \gamma_{t}=c(t)(e^{\beta_{X}}-1) is proportional to e^{\beta_{X}}-1 with a t -dependent proportionality constant c(t)=\mathbb{E}\left[e^{\beta_{Z}^{\top}Z}W_{t}^{\textsc{ac}}(Z)\right]\geq 0 . Using the innovation theorem we see that \displaystyle h_{t}(Z) \displaystyle=\big(\pi_{t}(Z)(e^{\beta_{X}}-1)+1\big)h^{0}(t)\exp(\beta_{Z}^{\top}Z), and we could also arrive at the representation of the ACM directly from the identity ( 5.2.13 ). Indeed, \bm{h}_{s}(X,Z)-h_{s}(Z)=(e^{\beta_{X}}-1)(X-\pi_{s}(Z))h^{0}(s)\exp(\beta_{Z}^{\top}Z) , and ( 5.2.13 ) gives \displaystyle\gamma_{t} \displaystyle=(e^{\beta_{X}}-1)\int_{0}^{t}h^{0}(s)\mathbb{E}\left[e^{\beta_{Z}^{\top}Z}\frac{Y_{s}(X-\pi_{s}(Z))^{2}}{\rho(s)}\right]\mathrm{d}s The proportionality constant must, of course, be c(t) , but this can also be verified directly using the same argument as in Example ( 4 ). We may note that h_{t}(\cdot) is not generally of the form of a Cox proportional hazards model, which illustrates the fact that the Cox model is not closed under marginalization. To compute the proportionality constant we need the weights w_{t}^{\textsc{ac}}(Z)=\frac{Y_{t}\pi_{t}(Z)(1-\pi_{t}(Z))}{\mathbb{E}[Y_{t}\pi_{t}(Z)(1-\pi_{t}(Z))]}, and to this end we need to compute the predictable projection \pi_{t}(Z) . Under the censoring assumption C\,\perp\!\!\!\perp\,(T^{*},X)\,|\,Z , it follows from Proposition 5.B.1 that \displaystyle\mathrm{logit}(\pi_{t}(Z))=\mathrm{logit}(\pi_{0}(Z))-\phi(Z)H^{0}(t), (5.B.2) where H^{0}(t)=\int_{0}^{t}h^{0}(s)\mathrm{d}s . This shows that \pi_{t}(Z) evolves in time with a logistic growth rate precomposed with H^{0} . Formula ( 5.B.2 ) makes it straightforward to compute \pi_{t}(z)(1-\pi_{t}(z)) for any given t and z (provided that we can compute \pi_{0}(z) ), but it does not appear to yield a simple analytic expression of neither the weights w_{t}^{\textsc{ac}}(Z) nor the proportionality constant c(t) . It is, however, useful for Monte Carlo computation of the ACM. 34 32 31 33 15