Density Ratio-based Causal Discovery from Bivariate Continuous-Discrete Data
Takashi Nicholas Maeda, Shohei Shimizu, Hidetoshi Matsui · 2025
Read Density Ratio-based Causal Discovery from Bivariate Continuous-Discrete Data by Takashi Nicholas Maeda, Shohei Shimizu, Hidetoshi Matsui (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-08371.txt.
Introduction
Takashi Nicholas Maeda, Shohei Shimizu, and Hidetoshi Matsui tackle causal direction between a continuous and a discrete variable. Their 2025 paper asks which of two variables drives the other when only observational data are at hand. One direction is modeled with a threshold rule, a setup used in prior work.
Three theory results anchor the method. In one direction, a key density ratio must rise in a monotone way. In the reverse direction, that pattern holds only on a vanishing slice of parameter choices, or needs a finely tuned match between cause and input. Together, the results say the ratio's shape can reveal the causal arrow. The authors build a practical test on that insight for mixed data pairs.
Catalog record
| CREATOR | Takashi Nicholas Maeda, Shohei Shimizu, Hidetoshi Matsui |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 66 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-08371
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Density Ratio-based Causal Discovery from Bivariate Continuous-Discrete Data Takashi Nicholas Maeda, Shohei Shimizu, Hidetoshi Matsui Abstract We address the problem of inferring the causal direction between a continuous variable X X and a discrete variable Y Y from observational data. For the model X → Y X\to Y , we adopt the threshold model used in prior work. For the model Y → X Y\to X , we consider two cases: (1) the conditional distributions of X X given different values of Y Y form a location-shift family, and (2) they are mixtures of generalized normal distributions with independently parameterized components. We establish identifiability of the causal direction through three theoretical results. First, we prove that under X → Y X\to Y , the density ratio of X X conditioned on different values of Y Y is monotonic. Second, we establish that under Y → X Y\to X with non-location-shift conditionals, monotonicity of the density ratio holds only on a set of Lebesgue measure zero in the parameter space. Third, we show that under X → Y X\to Y , the conditional distributions forming a location-shift family requires a precise coordination between the causal mechanism and input distribution, which is non-generic under the principle of independent mechanisms. Together, these results imply that monotonicity of the density ratio characterizes the direction X → Y X\to Y , whereas non-monotonicity or location-shift conditionals characterizes Y → X Y\to X . Based on this, we propose Density Ratio-based Causal Discovery (DRCD), a method that determines causal direction by testing for location-shift conditionals and monotonicity of the estimated density ratio. Experiments on synthetic and real-world datasets demonstrate that DRCD outperforms existing methods. Figure 1: Monotonicity property of the density ratio. When a continuous variable ( X ) causes a discrete variable ( Y ) (left), the conditional density ratio \frac{P(X|Y=1)}{P(X|Y=0)} (red line) exhibits monotonic behavior. In contrast, when the causal direction is reversed ( Y\to X ) with non-location-shift conditionals (right), this monotonicity property does not hold. See Appendix C for the generative model settings used in this figure. 1 Introduction Determining the causal relationship between continuous and discrete variables from observational data alone is a fundamental problem in causal discovery. Consider, for example, the relationship between a biological marker (a continuous variable) and the presence of a disease (a discrete variable). It is often unclear whether changes in the biomarker cause the disease or whether early-stage disease processes alter the biomarker’s levels. While randomized controlled trials can resolve such ambiguities, they are frequently infeasible due to ethical, logistical, or financial constraints. Causal discovery [ Pearl, 2000 , Spirtes et al., 2000 , Glymour et al., 2019 ] aims to infer causal relationships from observational data without experiments. Developing causal discovery methods requires three key steps: specifying assumptions about the data-generating process (the causal model ), proving that causal relationships are identifiable under these assumptions, and designing algorithms to estimate causal directions based on this identifiability. Existing approaches for mixed continuous-discrete data face fundamental limitations. Constraint-based methods [ Spirtes and Glymour, 1991 , Spirtes et al., 1999 ] rely on conditional independence tests, which require additional variables for conditioning and thus cannot determine causal direction in bivariate settings. Functional causal model-based approaches [ Wenjuan et al., 2018 , Zeng et al., 2022 , Yao et al., 2025 ] assume that when a discrete variable Y causes a continuous variable X , the conditional distributions P(X|Y=c) form a location-shift family, differing only in their means while sharing the same shape and scale. This assumption excludes causal models where conditional distributions have different shapes or variances. Flexible score-based methods [ Marx and Vreeken, 2019 , Huang et al., 2018 ] avoid such distributional assumptions but face the challenge of fairly comparing causal directions between variables of inherently different types, as continuous and discrete variables differ fundamentally in their information content and scale. For the model X\to Y , we adopt the threshold model from prior work [ Wenjuan et al., 2018 , Zeng et al., 2022 ] . For the model Y\to X , we extend existing frameworks by considering two cases: (1) the conditional distributions of X given different values of Y form a location-shift family, as assumed by prior methods [ Wenjuan et al., 2018 , Zeng et al., 2022 , Yao et al., 2025 ] , and (2) they are mixtures of generalized normal distributions with independently specified components, allowing heterogeneous variances or shapes. Our theoretical contributions are as follows: • We prove that under the model X\to Y , the density ratio \frac{P(X|Y=c_{t})}{P(X|Y=c_{s})} is monotonic (Section 6 ). • We show that under Y\to X with non-location-shift conditionals (i.e., conditionals with different shapes or scales), monotonicity of the density ratio holds only on a set of Lebesgue measure zero in the parameter space (Section 5 ). • We show that under X\to Y , the conditional distributions forming a location-shift family requires a precise coordination between the causal mechanism and input distribution, which is non-generic under the principle of independent mechanisms [ Peters et al., 2017 , Schölkopf et al., 2012 ] (Section 5 ). These results imply that monotonicity of the density ratio characterizes the direction X\to Y , whereas non-monotonicity or location-shift conditionals characterizes Y\to X . Figure 1 illustrates the monotonicity of the density ratio under X\to Y and its absence under Y\to X with non-location-shift conditionals. Based on these theoretical findings, we propose Density Ratio-based Causal Discovery (DRCD), which determines causal direction by testing for location-shift conditionals and monotonicity of the estimated density ratio (Section 7 ). Since DRCD tests a property of the density ratio rather than comparing scores across causal directions, it avoids the difficulty of fairly comparing models between different variable types. Experiments on synthetic and real-world datasets demonstrate that DRCD consistently outperforms existing methods (Section 8 ). For our theoretical results, proofs are provided in Appendix A . Code is available at https://github.com/causal111/DRCD . 2 Related Studies Constraint-based approaches. Constraint-based methods such as PC [ Spirtes and Glymour, 1991 ] and FCI [ Spirtes et al., 1999 ] determine causal structure through conditional independence tests. While extensions to mixed data exist [ Tsagris et al., 2018 , Cui et al., 2016 , Ge et al., 2020 ] , these methods fundamentally cannot identify causal direction in bivariate settings, as there are no additional variables available for conditioning. Functional causal model-based approaches. Methods such as MIC [ Wenjuan et al., 2018 ] , LiM [ Zeng et al., 2022 ] , and MANMs [ Yao et al., 2025 ] assume specific functional forms for the causal mechanisms. For the direction X\to Y , they employ a threshold model where Y is determined by whether f(X)+N_{Y} exceeds a threshold. For the direction Y\to X , they assume that the conditional distributions P(X|Y=c) form a location-shift family, differing only in their means while sharing the same shape and scale. This assumption excludes causal models with heterogeneous conditional distributions. Our work extends this framework by additionally allowing non-location-shift conditionals under Y\to X . Flexible score-based methods. Methods such as CRACK [ Marx and Vreeken, 2019 ] and GSF [ Huang et al., 2018 ] avoid strong distributional assumptions