The third pillar of causal analysis? A measurement perspective on causal representations

Dingling Yao ∗, Shimeng Huang ∗, Riccardo Cadei, Kun Zhang, Francesco Locatello · 2025

Read The third pillar of causal analysis? A measurement perspective on causal representations by Dingling Yao ∗, Shimeng Huang ∗, Riccardo Cadei, Kun Zhang, Francesco Locatello (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-17708.txt.

Introduction

Dingling Yao and four co-authors reframe how learned causal representations should be judged in a 2025 paper. Causal representation learning tries to recover hidden cause variables from messy, high-dimensional data. But what makes a recovered representation useful for later causal work, and how to score it, has stayed murky.

The authors borrow measurement theory: a learned representation is a proxy measurement of the true hidden variables. That lens states plainly when a representation can support causal reasoning downstream. They add a score, T-MEX, that tests whether a representation captures its target and excludes the rest. Checks on simulations and on ecological videos show the score tracks identification quality and downstream usefulness well.

Catalog record

CREATORDingling Yao ∗, Shimeng Huang ∗, Riccardo Cadei, Kun Zhang, Francesco Locatello
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE81 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-17708

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

The third pillar of causal analysis? A measurement perspective on causal representations Dingling Yao ∗, Shimeng Huang ∗, Riccardo Cadei, Kun Zhang, Francesco Locatello Abstract Causal reasoning and discovery, two fundamental tasks of causal analysis, often face challenges in applications due to the complexity, noisiness, and high-dimensionality of real-world data. Despite recent progress in identifying latent causal structures using causal representation learning (CRL), what makes learned representations useful for causal downstream tasks and how to evaluate them are still not well understood. In this paper, we reinterpret CRL using a measurement model framework, where the learned representations are viewed as proxy measurements of the latent causal variables. Our approach clarifies the conditions under which learned representations support downstream causal reasoning and provides a principled basis for quantitatively assessing the quality of representations using a new Test-based Measurement EXclusivity (T-MEX) score. We validate T-MEX across diverse causal inference scenarios, including numerical simulations and real-world ecological video analysis, demonstrating that the proposed framework and corresponding score effectively assess the identification of learned representations and their usefulness for causal downstream tasks. Reproducible code can be found at https://github.com/shimenghuang/a-measurement-perspective-of-crl . 1 Introduction Causal analysis rests on two foundational pillars: causal reasoning and causal discovery. Causal reasoning operates under the assumption that the causal structure is known or can be assumed, and leverages data to make quantitative causal statements, for example, about the average effect of one variable on another. As causal structures are often unknown, causal discovery aims to uncover this structure, assuming that the causal variables of interest are readily observed. In many real-world settings, however, the causal variables may not be directly observable. While originally formulated mostly to enable causal capabilities in machine learning models, Causal Representation Learning ( Schölkopf et al., 2021 , CRL,) has the potential to serve as a third pillar of causal analysis: enabling applications of causality involving unstructured data. For this, we reinterpret causal representation learning using the formalism of “ measurement models ” ( Silva et al., 2006 ) , wherein the learned representations serve as proxy measurements for latent causal variables. This perspective of CRL allows us to better characterize when a representation supports downstream causal reasoning, and it also provides a principled basis for quantitatively evaluating the quality of identification. Methodologically, CRL tackles a more challenging task compared to independent component analysis (ICA) and disentanglement, where the latent variables are assumed to be independent of each other ( Hyvärinen and Pajunen, 1999 ; Hyvarinen et al., 2019 ; Higgins et al., 2017 ; Locatello et al., 2019 ) . Instead, CRL aims to unmix a set of causally related latent variables. Many recent causal representation learning works have provided different theoretical results for causal variable identification compiling various problem settings ( von Kügelgen et al., 2021 ; von Kügelgen et al., 2024 ; Zhang et al., 2024b ; Ahuja et al., 2024 ; Ahuja et al., 2022 ; Varici et al., 2024 ; Zhang et al., 2024a ; Yao et al., 2024b ; Kong et al., 2022 ; Lippe et al., 2022b ; Xie et al., 2024 ; Dong et al., 2024 ; Lachapelle et al., 2022 ; Lachapelle et al., 2023 ; Yao et al., 2022 ; Zhang et al., 2024a ; Squires et al., 2023 ; Buchholz et al., 2024 ; Kong et al., 2023 ) , recently unified by ( Yao et al., 2025 ) into a single general methodology. Although most of the results have been theoretical in nature, machine learning models explicitly empowered with identified causal structure have been shown to be more robust under distributional shifts and provide better out-of-distribution generalization ( Fumero et al., 2024 ; Ahuja et al., 2021 ; Bareinboim and Pearl, 2016 ; Zhang et al., 2020 ; Rojas-Carulla et al., 2018 ) . From an AI for science perspective, CRL has shown its potential in understanding climate physics from raw measurement data ( Yao et al., 2024a ) , answering causal questions in the scope of ecology experiments ( Cadei et al., 2024 ; Cadei et al., 2025 ; Yao et al., 2025 ) , psychometric studies ( Dong et al., 2024 ) , and countless more applications related to biomedicine ( Zhang et al., 2024a ; Sun et al., 2025 ; Ravuri et al., 2025 ; Jain et al., 2024 ) . Despite recent progress in identifying latent causal structures within causal representation learning, it remains unclear what makes learned representations useful for downstream causal tasks and how to best evaluate them. Building on the proposed measurement model framework, we introduce a new evaluation metric, the Test-based Measurement EXclusivity (T-MEX) Score, which effectively quantifies how well the learned representation aligns with the underlying measurement model. This underlying measurement model can be specified by, for instance, identifiability theory of a CRL algorithm ( Fig. 1 ), assumptions for a particular causal reasoning task ( Figs. 2 and 4 ), or ground truth knowledge. In contrast to commonly used CRL evaluation metrics, which suffer from clear limitations ( § 4 ), we demonstrate that T-MEX reliably assesses both the identifiability ( Defn. B.1 ) and causal validity ( Defn. 2.2 ) of learned representations, as shown in a wide range of causal reasoning tasks across numerical simulations and real-world ecological video analysis ( § 5 ). We summarize the main contributions of this paper as follows: \mathbf{Z}_{1} \mathbf{Z}_{2} \mathbf{Z}_{3} \mathbf{X} \mathbf{Z}_{1} \mathbf{Z}_{2} \mathbf{Z}_{3} \widehat{\mathbf{Z}}_{A_{1}} \widehat{\mathbf{Z}}_{A_{2}} \widehat{\mathbf{Z}}_{A_{3}} \mathbf{Z}_{1} \mathbf{Z}_{2} \mathbf{Z}_{3} \widehat{\mathbf{Z}}_{A_{1}} \widehat{\mathbf{Z}}_{A_{2}} Algorithm 1 Algorithm 2 (a) (b) Figure 1 : ( Left ) A measurement model where \mathbf{X} is a fully mixed measurement of the causal variables. \mathbf{X} is often termed the observables in CRL literature, representing the observed data. ( Right ) Two measurement models specified by different CRL identification algorithms: (a) Algorithm 1 guarantees one-to-one correspondence between the learned representation and causal variables; (b) Algorithm 2 guarantees that \widehat{\mathbf{Z}}_{A_{1}} corresponds to \mathbf{Z}_{1} while \widehat{\mathbf{Z}}_{A_{2}} represents a mixing of \mathbf{Z}_{2} and \mathbf{Z}_{3} . • We reinterpret CRL using a measurement model framework, wherein the learned representations serve as proxy measurements for latent causal variables ( § 2 ). This formalism provides a clearer characterization of both the identification quality of learned representation and its usefulness for causal downstream tasks. • We propose a new evaluation metric (T-MEX) that quantifies the alignment of the representations and the underlying measurement model ( § 3 ), and we demonstrate its advantages over widely used CRL evaluation metrics that suffer from notable limitations ( § 4 ). • Supported by theoretical analysis, our empirical evaluations confirm that T-MEX maintains validity and effectiveness across diverse causal reasoning scenarios, including treatment effect estimation and covariate adjustment in both numerical simulations and real-world ecological experiments ( § 5 ). 2 CRL from A Measurement Model Perspective Notation. Throughout, we write [N] as shorthand for the set \{1,\dots,N\} . Random vectors are denoted by bold uppercase letters (e.g. \mathbf{Z} ) and their realizations by bold lowercase (e.g., \mathbf{z} ), indexed by superscripts. For instance, n samples of \mathbf{Z} are written as \{\mathbf{z}^{k}\}_{k\in[N]} . A vector \mathbf{Z} can be sliced either by a single index i\in[\dim(\mathbf{Z})] via \mathbf{Z}_{i} or a index subset A\subseteq[\dim(\mathbf{Z})] with \mathbf{Z}_{A}:=\{\mathbf{Z}_{i}:i\in A\} . P_{\mathbf{Z}} denotes the probability distribution

Read the complete text