Point-Identification of a Robust Predictor Under Latent Shift with Imperfect Proxies

Zahra Rahiminasab [email protected], Reza Soumi [email protected], Arto Klami [email protected], Samuel Kaski [email protected] · 2026

Read Point-Identification of a Robust Predictor Under Latent Shift with Imperfect Proxies by Zahra Rahiminasab [email protected], Reza Soumi [email protected], Arto Klami [email protected], Samuel Kaski [email protected] (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-15158.txt.

Introduction

Rahiminasab and co-authors tackle robust prediction when hidden confounders shift between domains and proxies are imperfect. Older proxy methods need a completeness assumption that imperfect proxies break. The team groups confounders into latent equivalent classes that yield the same proxy distribution. Point identification still works if domains mix these classes in varied enough ways, a weaker rank condition. Their PQAL framework actively queries a few well-chosen domains that meet the condition. It beat prior methods on synthetic and semi-synthetic datasets.

Catalog record

CREATORZahra Rahiminasab [email protected], Reza Soumi [email protected], Arto Klami [email protected], Samuel Kaski [email protected]
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE68020
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.15158

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Point-Identification of a Robust Predictor Under Latent Shift with Imperfect Proxies Zahra Rahiminasab [email protected], Reza Soumi [email protected], Arto Klami [email protected], Samuel Kaski [email protected] Abstract Addressing the domain adaptation problem becomes more challenging when distribution shifts across domains stem from latent confounders that affect both covariates and outcomes. Existing proxy-based approaches that address latent shift rely on a strong completeness assumption to uniquely determine (point-identify) a robust predictor. Completeness requires that proxies have sufficient information about variations in latent confounders. For imperfect proxies the mapping from confounders to the space of proxy distributions is non-injective, and multiple latent confounder values can generate the same proxy distribution. This breaks the completeness assumption and observed data are consistent with multiple potential predictors (set-identified). To address this, we introduce latent equivalent classes (LECs). LECs are defined as groups of latent confounders that induce the same conditional proxy distribution. We show that point-identification for the robust predictor remains achievable as long as multiple domains differ sufficiently in how they mix proxy-induced LECs to form the robust predictor. This domain diversity condition is formalized as a cross-domain rank condition on the mixture weights, which is substantially weaker assumption than completeness. We introduce the Proximal Quasi-Bayesian Active learning (PQAL) framework, which actively queries a minimal set of diverse domains that satisfy this rank condition. PQAL can efficiently recover the point-identified predictor, demonstrates robustness to varying degrees of shift and outperforms previous methods on synthetic data and semi-synthetic dSprites dataset. 1 Introduction Domain adaptation transfers models trained on labeled source domains to a target domain, where labeled data is either unavailable entirely ( 24 ) or restricted to a few samples (few-shot domain adaptation) ( 16 ) . To successfully adapt a trained predictor from the source to the target domain, some assumptions about the type of data distribution shift must be made ( 5 ) . Traditionally, covariate ( 20 ) or label ( 10 ) shift assumptions are used. However, these assumptions do not always hold in real-world settings. In such settings, let S source domains and a target domain are indexed by Z\in\mathcal{Z}=\{1,\dots,S,S+1\} . Then, the shift in distribution between source and target domains is due to a latent confounder U\in\mathcal{U} , such that P(U|Z=i)\neq P(U|Z=S+1) for all i\in\{1,\dots,S\} , which affects the covariates X\in\mathcal{X}\subseteq\mathbb{R}^{d_{X}} and the outcomes Y\in\mathcal{Y}\subseteq\mathbb{R}^{d_{Y}} ( 1 ; 24 ) . Due to such unobserved confounders U , the predictors may learn spurious correlations between X and Y . Previous studies, such as 24 ; 1 ; 19 , use proxies W\in\mathcal{W} to address the latent shift. They assume that the proxy is informative enough to uniquely identify (point-identify) the parameter or function of interest, based on the probability of the observed data ( 11 ) . For discrete unobserved confounders and proxies, being informative translates to the invertibility of the conditional distribution of the proxy given the unobserved confounder P(W|U) , which is often formalized as a rank condition ( 1 ; 19 ; 24 ) . In contrast, when unobserved confounders and proxies are continuous ( 24 ) , the completeness assumption must hold, which ensures injectivity of the conditional operator induced by P(W|U) ( 15 ) . These assumptions break in practice when proxies are imperfect or insufficiently informative. More precisely, when the P(W|U) is not invertible, or the conditional expectation operator is not injective. In such cases, parameters or functions of interest can only be partially identified (set-identified). In human-in-the-loop learning, proxies are not passively observed; instead, they are actively collected through budget-limited interactions with a human expert. As a result, these proxies are often noisy or weak ( 21 ) . Examples include expert annotations ( 23 ) or feedback ( 18 ) . Since acquiring proxies requires costly interactions, only a limited number of proxies can be obtained in practice. Consequently, it is important to identify robust predictors while making efficient use of these imperfect proxy queries. We address the aforementioned problems by making the following contributions. • Relaxing completeness via latent equivalent classes (LECs): This paper addresses domain adaptation under latent shift, when proxies are imperfect and do not satisfy the standard completeness assumption. When the completeness assumption does not hold, distinct values of the latent confounder may generate the same conditional proxy distribution P(W|U) . We introduce latent equivalent classes (LECs) as sets of latent confounder values that are observationally indistinguishable given the proxy. Although individual latent confounder values cannot be recovered, the conditional proxy distribution in each domain can be represented as a mixture over these LECs. This decomposition enables tracking latent shifts by leveraging variation in mixture weights across domains. • Point-identification via distinguishing environment set: Based on the obtained mixture formulation, we prove that the robust predictor ( \mathbb{E}[Y|X,Z] , where X is a covariate and Y is an outcome. In addition, environments are indexed by discrete variable Z .) is point-identified as long as the observed domains exhibit sufficient diversity in their mixture weights over LECs. We call such environments distinguishing environments Z^{\star}\subseteq\mathcal{Z} . This condition is formalized as a simple cross-domain rank condition. We formally prove that this rank condition is strictly weaker than the completeness assumption, as it depends on variation across environments rather than on the injectivity of the conditional operator in each environment. • Proximal Quasi-Bayesian Active Learning (PQAL): We propose the Proximal Quasi-Bayesian Active Learning (PQAL) framework to train a point-identified robust predictor. PQAL actively queries proxies to satisfy the required rank condition. We show that PQAL efficiently recovers a point-identified predictor and achieves lower mean squared error than state-of-the-art methods across varying degrees of latent distribution shift on synthetic and semi-synthetic dSprites data. 2 Problem formulation Let \mathcal{X} denotes the space of observed covariates X , and \mathcal{Y} the space of outcomes Y . We define a set of S sources and a target environment with domain IDs Z\in\{1,\dots,S,S+1\} . In every environment, both the covariates and the outcomes are influenced by an unobserved confounder U , which varies across the environments. That is, p(U|Z=z) . This distribution is also unknown, but we assume that partial knowledge about it can be obtained via a proxy W that contains indirect and imperfect information regarding changes in the distribution of unobserved confounders U . When proxies are imperfect, multiple latent values from U can induce the same conditional proxy distribution P(W\mid U) . For instance, periodically repeating confounders, like orientation where 2\pi+\theta and \theta induce the same proxy distribution (see dSprites dataset in the Section 6.1 for an example, where we consider domains that differ by such orientation). Assumption 1 (Latent shift (from 24 )) . Latent shift is translated to the following conditions: 1. The shift between source distribution P and a target distribution Q stems from unobserved confounder U . Therefore P(U)\neq Q(U) . Also, \forall z_{i},z_{j}\;\text{when}\;i\neq j , P(U|z_{i})\neq P(U|z_{j})\neq Q(U) . 2. Invariant distributions: a conditional distribution of observed covariates, proxy, and an outcome for an unobserved confounder remain invariant between source and target domains P(R|U)=Q(R|U) for R\subseteq\{X,Y,W\} . Figure 1 illustrates the causal DAG that complies with the latent shift (Assumptions 1 ). Figure 1 : Causal diagram that complies with the latent shift assumption Problem: Given m labeled data

Read the complete text