Testing Conditional Independence via Density Ratio Regression
Chunrong Ai · 2025
Read Testing Conditional Independence via Density Ratio Regression by Chunrong Ai (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-17322.txt.
Introduction
Chunrong Ai and co-authors build a new test for whether two variables are truly independent once a third is held fixed, in this 2025 statistics paper. Such tests underpin causal claims, and existing ones can be slow or lose power as data grow wider. The new test runs through a ratio of densities, estimated in two stages with flexible sieve fits.
The finished statistic has a closed form, which makes it fast, and it does not change under monotone reshaping of the data. The estimated ratio also respects the moment conditions the theory demands, so it avoids wild values. Simulations show the test beating rivals under several dependence patterns. Its power fades almost as slowly as theory allows, whatever the dimension of the data.
Catalog record
| CREATOR | Chunrong Ai |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 162 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-17322
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Testing Conditional Independence via Density Ratio Regression Thanks: The authors are alphabetically ordered. Zixuan Xu is a PhD student. The present work constitutes part of her research study leading to her doctoral thesis at Renmin University of China. Zheng Zhang is the corresponding author. E-mail: [email protected]. Chunrong Ai Abstract This paper develops a conditional independence (CI) test from a conditional density ratio (CDR) for weakly dependent data. The main contribution is presenting a closed-form expression for the estimated conditional density ratio function with good finite-sample performance. The key idea is exploiting the linear sieve combined with the quadratic norm. Matsushita et al. 2022 exploited the linear sieve to estimate the unconditional density ratio. We must exploit the linear sieve twice to estimate the conditional density ratio. First, we estimate an unconditional density ratio with an unweighted sieve least-squares regression, as done in Matsushita et al. 2022 , and then the conditional density ratio with a weighted sieve least-squares regression, where the weights are the estimated unconditional density ratio. The proposed test has several advantages over existing alternatives. First, the test statistic is invariant to the monotone transformation of the data distribution and has a closed-form expression that enhances computational speed and efficiency. Second, the conditional density ratio satisfies the moment restrictions. The estimated ratio satisfies the empirical analog of those moment restrictions. As a result, the estimated density ratio is unlikely to have extreme values. Third, the proposed test can detect all deviations from conditional independence at rates arbitrarily close to n − 1 / 2 n^{-1/2} , and the local power loss is independent of the data dimension. A small-scale simulation study indicates that the proposed test outperforms the alternatives in various dependence structures. Keywords: Conditional density ratio, conditional independence, weighted least-squares. 1 Introduction Conditional independence (hereafter CI) is vital in econometrics, statistics, and machine learning studies. For example, in time-series regressions, researchers usually assume that the far-lagged dependent variables and the error terms are independent conditional on the most recent information. In the literature of program evaluation, the independence between program participation and latent outcomes conditional on the confounders is a key condition for identifying treatment effects ( Linton and Gozalo 2014 , Huang et al. 2016 ) . CI is also a key condition for exploring queries in statistical inference, such as sufficiency, parameter identification, adequacy, and ancillary ( Dawid 1979 , Dawid 1980 ) . Furthermore, CI is a widely used feature selection and screening measure in high-dimensional data learning ( Xing et al. 2001 , Tong et al. 2022 ) . Because of the critical role of CI in the studies above, testing its validity has received increasing attention from the econometric literature. Existing studies proposed several tests based on conditional densities, distributions, or characteristic functions, with distance measures like L^{2} distance, Hellinger distance, or (generalized) mutual information (also termed Kullback–Leibler (hereafter KL) information or entropy). These tests are called density-based, characteristics-based, and distribution-based tests respectively. Most of these tests use a kernel-smoothed nonparametric estimation. For example, Su and White 2008 proposed a density-based test with kernel smoothing; Su and White 2007 and Wang and Hong 2018 proposed characteristics-based tests with kernel smoothing; Su and White 2014 proposed a distribution-based test with a kernel-smoothed conditional empirical likelihood. All of these tests are asymptotically pivotal with a standard limiting distribution and are consistent in detecting any deviation from CI. However, a key limitation is their significant loss of local power, and the power loss increases with the dimension of the data. Linton and Gozalo 2014 , on the other hand, proposed a moment-restrictions test without kernel smoothing. However, their test needs a complicated bias correction, is not asymptotically pivotal, and is inconsistent against all deviations from CI. Huang et al. 2016 proposed an integrated moment test without kernel smoothing. Though consistent against all deviations from CI and achieving n^{-1/2} local power, their test needs numerical integration. Ai et al. 2024 proposed a mutual information test for CI. Though consistent against all departures from CI, their test suffers a slight loss of local power and needs to numerically solve an optimization. Moreover, Linton and Gozalo 2014 , Huang et al. 2016 , and Ai et al. 2024 only considered independent and identically distributed (i.i.d.) data, so their tests do not apply to dependent data. For an example of a CI test for dependent data, see testing Granger non-causality for two stationary ergodic time series ( Florens and Mouchart 1982 , Florens and Fougere 1996 ) . The literature lacks a CI test that is asymptotically pivotal, consistent against all departures from CI, suffers a slight loss of power, and is easy to compute. This paper fills this gap with a weighted L^{2} -test for CI that applies to both independent and weakly dependent data. The main idea is to estimate a conditional density ratio via a weighted sieve least-squares regression, with an unconditional density ratio as weight. We estimate the unconditional density ratio by an unweighted sieve least-squares regression. Kanamori et al. 2009 used the unweighted sieve least-squares regression to calculate the ratio of two marginal probability densities, and Matsushita et al. 2022 applied the same idea to estimate the unconditional density ratio (i.e. the product of two marginal densities over the joint density). We extend their approach to estimate the conditional density ratio. The estimated conditional density ratio has a closed-form expression, satisfies the empirical moment restrictions, and has good finite-sample performance. Under sufficient conditions, we show that the proposed test is asymptotically pivotal with a standard limiting distribution and is consistent against all departures from CI. The test suffers only a slight loss of local power and the loss is independent of the data dimension. The rest of the paper is organized as follows. Section 2 provides a basic framework and describes the least-squares approach for estimating density ratios. Section 3 studies the convergence rates of the estimated density ratio and establishes the limiting distribution and the power against local and fixed alternatives, respectively, for the test statistic. We report a simulation analysis of the size and power of the proposed test in Section 4 and an application in Section 5 . The final section summarizes the main results. All technical proofs are contained in the appendix. 2 Basic Framework Let X\in\mathbb{R}^{d_{X}} , Y\in\mathbb{R}^{d_{Y}} , and Z\in\mathbb{R}^{d_{Z}} denote three random vectors whose supports are denoted by \mathcal{X} , \mathcal{Y} and \mathcal{Z} , where d_{X} , d_{Y} and d_{Z} are integers signifying the dimensions of X , Y , Z respectively. The goal of this paper is to develop a consistent test for the null hypothesis that X and Y are conditionally independent given Z , i.e. \displaystyle H_{0}:X\perp Y|Z;\ \text{against}\ H_{1}:X\not\perp Y|Z, (2.1) Let \{X_{t},Y_{t},Z_{t}\}_{t=1}^{n} denote a weakly dependent and identically distributed sample of (X,Y,Z) . Let f_{X,Y|Z}(x,y|z) , f_{X|Z}(x|z) , and f_{Y|Z}(y|z) denote the conditional probability density functions. The primal null hypothesis ( 2.1 ) is equivalent to \displaystyle H_{0}:\pi_{0}(x,y,z)=1\ \text{for almost all}\ (x,y,z);\ \text{against}\ H_{1}:H_{0}\ \text{fails}. (2.2) where \pi_{0}(x,y,z):=\frac{f_{X|Z}(x|z)f_{Y|Z}(y|z)}{f_{X,Y|Z}(x,y|z)} is a conditional density ratio function (CDR). Let Q(\pi) be the weighted L_{2}(X,Y,Z) distance between an arbitrary function \pi:\mathcal{X}\times\mathcal{Y}\times\mathcal{Z}\to\mathbb{R} and \pi_{0}(x,y,z) : \displaystyle Q(\pi):=\frac{1}{2}\int_{\mathcal{X}\times\mathcal{Y}\times\mathcal{Z}}\left\{\pi(x,y,z)-\pi_{0}(x,y,z)\right\}^{2}r_{0}(y,z)f_{X,Y,Z}(x,y,z)dxdydz, (2.3) where r_{0}(y,z):=\frac{f_{Y}(y)f_{Z}(z)}{f_{Y,Z}(y,z)} is an unconditional density ratio function. Obviously,