Unsupervised Domain Adaptation with an Unobservable Source Subpopulation Chao Ying, Jun Jin, Haotian Zhang, Qinglong Tian, Yanyuan Ma, Yixuan Li, Jiwei Zhao Abstract We study an unsupervised domain adaptation problem where the source domain consists of subpopulations defined by the binary label Y Y and a binary background (or environment) A A . We focus on a challenging setting in which one such subpopulation in the source domain is unobservable. Naively ignoring this unobserved group can result in biased estimates and degraded predictive performance. Despite this structured missingness, we show that the prediction in the target domain can still be recovered. Specifically, we rigorously derive both background-specific and overall prediction models for the target domain. For practical implementation, we propose the distribution matching method to estimate the subpopulation proportions. We provide theoretical guarantees for the asymptotic behavior of our estimator, and establish an upper bound on the prediction error. Experiments on both synthetic and real-world datasets show that our method outperforms the naive benchmark that does not account for this unobservable source subpopulation. Key Words: Unsupervised domain adaptation, Structured missingness, Distribution matching 1 Introduction Unsupervised domain adaptation (UDA) ( Kouw & Loog 2019 ) addresses the challenge of transferring predictive models from a labeled source domain to an unlabeled target domain under distributional shifts ( Koh et al. 2021 ; Sagawa et al. 2022 ) . In this area, research methods aim to reduce domain discrepancy by aligning feature distributions, using statistical measures such as maximum mean discrepancy (MMD) ( Tzeng et al. 2014 ) and higher-order moment matching (HoMM) ( Chen et al. 2020 ) . Deep adaptation frameworks, such as deep adaptation network (DAN) ( Long et al. 2015 ) and domain-adversarial neural network (DANN) ( Ganin et al. 2016 ) , are also popularly used due to their strong empirical performance. There are also other approaches that integrate reconstruction objectives to disentangle domain-invariant and domain-specific components ( Ghifary et al. 2016 ) . These approaches often assume access to a representative and diverse set of source examples. However, real-world datasets may violate this assumption in systematic and non-random ways. In this work, we focus on a more challenging and practically relevant UDA setting where a structured subpopulation is entirely missing from the source domain . Specifically, we consider binary label Y and a binary background or environment variable A , and study the case where one subpopulation—defined by a particular combination of Y and A —is unobserved in the source. This structured missingness is not merely a sampling artifact, but often reflects real-world constraints in data collection. For instance, in the widely studied Waterbirds dataset ( Sagawa et al. 2019 ) , waterbirds ( Y=1 ) photographed in water environments ( A=1 ) can be rare or entirely absent due to the difficulty of capturing such images in the wild. This issue arises in many other disciplines as well. In healthcare, certain patient subgroups—defined jointly by disease status and demographics—may be underrepresented or absent in historical datasets due to restrictive inclusion criteria or changes in clinical practice over time. When such models are applied to broader populations, unobserved subgroups can suffer from systematic mispredictions. This structured missingness ( Mitra et al. 2023 ) fundamentally changes some statistical properties when comparing the source and target domains, and, if unaddressed, can lead to severely biased estimation and unreliable prediction in the target domain. These structured gaps pose new challenges that are not adequately addressed by conventional UDA techniques, which motivates our work. To tackle this challenge, we develop a theoretical framework that accounts for the structured absence of a subpopulation, such as (Y=1,A=1) , in the source domain. Our key idea is to model how prediction in the target domain can still be recovered by relating it to the observable parts of the source and target data. Under a mild assumption that the distribution of features X given (Y,A) stays the same across domains, we derive closed-form expressions for making accurate predictions in the target domain. These expressions depend on the proportions of different subgroups in the target, which are unknown. To estimate them, we propose a practical method based on distribution matching that avoids modeling complex feature distributions directly. Specifically, we frame the problem as estimating finite-dimensional mixture proportions under structured conditional invariance, and propose a KL-divergence-based objective that can be optimized using only observable quantities. We also provide theoretical guarantees, showing that our approach yields statistically consistent estimates and deriving upper bounds on the prediction error of the resulting target-domain classifiers. Overall, our framework provides the first rigorous characterization of model adaptation under structured subpopulation absence, and enables robust domain adaptation in such a challenging scenario. We validate our approach through experiments on both synthetic and real-world datasets. We simulate domain adaptation scenarios where one subpopulation is systematically excluded from the source data and evaluate our method against baseline approaches that do not account for this missing group. Across a range of settings, our method consistently achieves higher accuracy and F1 scores, particularly on the subpopulation absent from the source. These results highlight the practical value of explicitly modeling structured missingness and demonstrate that our approach leads to more reliable predictions in the target domain. To summarize, this paper makes the following novel contributions: • We consider a new unsupervised domain adaptation setting where an entire label-background subpopulation is missing from the source domain, a scenario motivated by real-world data collection constraints. • We develop a theoretical framework that enables accurate prediction in the target domain by estimating subpopulation proportions through distribution matching, and we provide rigorous guarantees and error bounds for our method. • We demonstrate the effectiveness of our approach on both synthetic and real-world datasets. Our method outperforms standard baselines that ignore structured missingness, particularly in recovering performance on the unobserved subpopulation. 2 Problem Setup and Notation In our UDA setting, Y\in\{0,1\} denotes the binary label, which is observed in the source domain but not in the target. Let A\in\{0,1\} be a binary background or environment variable and {\bf X}\in{\bf R}^{q} a vector of all other attributes. Let R\in\{0,1\} be a domain indicator, with R=1 corresponding to the source and R=0 to the target. In our notation, we consistently use the order of (R,Y,A) for indicator function I_{\{\cdot\}} , sample size n_{\{\cdot\}} , and population probability p_{\{\cdot\}} . We define \pi=\hbox{pr}(R=1) . For y=1,0 , a=1,0 , we define \alpha_{ya}=\hbox{pr}(Y=y,A=a\mid R=1) , and \beta_{ya}=\hbox{pr}(Y=y,A=a\mid R=0) . For clarity, the total source sample size is n_{1}=n_{101}+n_{110}+n_{100} , and the target sample size is n_{0}=n_{0\cdot 1}+n_{0\cdot 0} , so that the total sample size is n=n_{1}+n_{0} . Table 1 summarizes the observed data structure and key notation. Table 1: Data structure and key notation used throughout the paper. R Y A {\bf X} Sample Size Proportion Prediction Models Source 1 1 1 0 1 0 1 0 0 ✓ ✓ ✓ n_{101} n_{110} n_{100} p_{101}=\alpha_{01}\pi p_{110}=\alpha_{10}\pi p_{100}=\alpha_{00}\pi \xi_{1}({\bf x})=\hbox{pr}(Y=1\mid{\bf X}={\bf x},A=1,R=1) \xi_{0}({\bf x})=\hbox{pr}(Y=1\mid{\bf X}={\bf x},A=0,R=1) \xi({\bf x})=\hbox{pr}(Y=1\mid{\bf X}={\bf x},R=1) Target 0 ? 1 ✓ n_{0\cdot 1} p_{0\cdot 1}=(\beta_{11}+\beta_{01})(1-\pi) \eta_{1}({\bf x})=\hbox{pr}(Y=1\mid{\bf X}={\bf x},A=1,R=0) \eta_{0}({\bf x})=\hbox{pr}(Y=1\mid{\bf X}={\bf x},A=0,R=0) \eta({\bf x})=\hbox{pr}(Y=1\mid{\bf X}={\bf x},R=0) 0 ? 1 ✓ 0 ? 0 ✓ n_{0\cdot 0} p_{0\cdot 0}=(\beta_{10}+\beta_{00})(1-\pi) 0 ? 0 ✓ In our context, we have \alpha_{10}+\alpha_{01}+\alpha_{00}=1,\quad\alpha_{11}=0,\quad\text{and}\quad 0<\alpha_{10},\alpha_{01},\alpha_{00}<1 . The parameters can be consistently estimated by \displaystyle\widehat{\alpha}_{10}=n_{110}/n_{1},\quad\widehat{\alpha}_{01}=n_{101}/n_{1},\quad\widehat{\alpha}_{00}=n_{100}/n_{1},\quad\widehat{\pi}=n_{1}/n. (1) More formally, \alpha_{11}=0 is the following structured missingness condition: \hbox{pr}(Y=1,A=1\mid R=1)=0. (2) Note that this assumption is made without loss of generality, as alternative combinations–such as (Y=0,A=1) , (Y=1,A=0) , or (Y=0,A=0) –can be similarly assumed to have zero probability. To characterize the distributional connection between the two domains, we impose a structured conditional invariance assumption: \displaystyle p({\bf X}\mid Y,A,R=1)=p({\bf X}\mid Y,A,R=0)=p({\bf X}\mid Y,A)\equiv p_{ya}({\bf X}), (3) that is, the conditional distribution of features {\bf X} given (Y,A) remains the same across domains. This can be regarded as a conditional version, or, more nuanced version, of label shift where the marginal distribution of labels (now, the combination of both label and background) varies across domains (e.g., Du Plessis & Sugiyama 2014 ; Garg et al. 2020 ; Iyer et al. 2014 ; Lipton et al. 2018 ; Nguyen et al. 2016 ; Tasche 2017 ; Tian et al. 2023 ; Zhang et al. 2013 ). It indicates, conditional on background A , the label shift assumption holds. Mathematically, it states that p({\bf X}|Y,A,R=1)=p({\bf X}|Y,A,R=0) . It is equivalent to p(R|{\bf X},Y,A)=p(R|Y,A) , the independence between R and {\bf X} , conditional on (Y,A) . In practice, this assumption may be suitable in many applications. Below we give two examples to illustrate the rationality of this assumption. For instance, we aim to predict user clicks on advertisements for a new batch of users (target domain, R=0 ) using historical data (source domain, R=1 ). Conditional on the advertisement type A and whether the user clicks Y , the distribution of browsing behavior features {\bf X} is assumed to remain stable across time periods. This is because user clicks are fundamentally determined by ad content and user interests, not by the time period in which data are collected. As another example, suppose we have datasets from two hospitals ( R=1 indicates the source hospital and R=0 indicates the target hospital). Here, {\bf X} represents imaging features, Y is the disease type, and A denotes patient attributes such as gender or age group. Then, conditional on the disease type Y and demographic attributes A , the distribution of imaging features {\bf X} is expected to remain the same across hospitals. This is because imaging characteristics for a given disease and demographic group are not systematically altered by the hospital. The main difference between hospitals lies in sampling proportions rather than in conditional distributions. This framework captures real-world scenarios in which a certain label-background subpopulation is absent from the source domain. For example, in the Waterbirds dataset, waterbirds on water backgrounds (label Y=1 , background A=1 ) are rarely observed–or even completely absent–in the training set, making the adaptation to target domains particularly challenging. For illustration purposes, Table 2 below shows the three observed subpopulations in the source as well as the four subpopulations in the target in two real-world datasets. Table 2: Illustrations in Waterbirds and CelebA datasets. Note that the (Y=1,A=1) combination does not exist in the source domain but does in the target domain. Dataset Source Data Target Data (Y,A) (0,1) (1,0) (0,0) (1,1) (0,1) (1,0) (0,0) Waterbirds Y=0:Landbird A=1:Water background Y=1:Waterbird A=0:Land background Y=0:Landbird A=0:Land background Y=1:Waterbird A=1:Water background Y=0:Landbird A=1:Water background Y=1:Waterbird A=0:Land background Y=0:Landbird A=0:Land background CelebA Y=0:Blond hair A=1:Male Y=1:Dark hair A=0:Female Y=0: Blond hair A=0:Female Y=1:Dark hair A=1:Male Y=0:Blond hair A=1:Male Y=1: Dark hair A= 0:Female Y=0:Blond hair A=0:Female 3 Proposed Methodology Our goal in this work is to correctly identify and successfully implement, under our UDA setting, the two background-specific prediction models \eta_{1}({\bf x}) and \eta_{0}({\bf x}) and the overall prediction model \eta({\bf x}) , in the target domain. All of the three models were precisely defined in Table 1 . 3.1 The naive benchmark As the benchmark, one may naively apply the three source domain prediction models \xi_{1}({\bf x}) , \xi_{0}({\bf x}) , and \xi({\bf x}) to the target. First, one can use the observed data to implement the overall source domain prediction model \xi({\bf x}) and one background-specific prediction model \xi_{0}({\bf x}) as \displaystyle\xi({\bf x})=\hbox{pr}(Y=1\mid{\bf x},R=1),\mbox{ and }\xi_{0}({\bf x})=\hbox{pr}(Y=1\mid{\bf x},R=1,A=0). (4) Afterwards, even though the subpopulation (Y=1,A=1) is entirely absent in the source, still one can compute the other background-specific prediction model \displaystyle\xi_{1}({\bf x}) \displaystyle=\frac{\xi({\bf x})-\xi_{0}({\bf x})\{1-\tau_{1}({\bf x})\}}{\tau_{1}({\bf x})},\mbox{ where } (5) \displaystyle\tau_{1}({\bf x}) \displaystyle=\hbox{pr}(A=1\mid{\bf X}={\bf x},R=1), (6) can also be implemented using the observed data. 3.2 Model adaptation from source to target The most challenging aspect of this work is to adapt the model for the A=1 background since the component (Y=1,A=1) is entirely absent in the source. Nevertheless, we can still correctly derive the three prediction models for the target domain, as shown below. Proposition 1 . Define the model \tau_{0}({\bf x})=\hbox{pr}(A=1\mid{\bf X}={\bf x},R=0) and the model \displaystyle\kappa({\bf x})=\hbox{pr}(R=1\mid{\bf x},A=1), (7) both of which can be implemented using the observed data in our UDA setting. Then the three prediction models in the target domain are given by: \displaystyle\eta_{1}({\bf x}) \displaystyle=1-\frac{\beta_{01}}{\alpha_{01}}\cdot\frac{1-\pi}{\pi}\cdot\frac{\kappa({\bf x})}{1-\kappa({\bf x})},\quad\eta_{0}({\bf x})=\frac{\frac{\beta_{10}}{\alpha_{10}}\xi_{0}({\bf x})}{\frac{\beta_{10}}{\alpha_{10}}\xi_{0}({\bf x})+\frac{\beta_{00}}{\alpha_{00}}\{1-\xi_{0}({\bf x})\}},\mbox{ and } (8) \displaystyle\eta({\bf x}) \displaystyle=\eta_{1}({\bf x})\tau_{0}({\bf x})+\eta_{0}({\bf x})\{1-\tau_{0}({\bf x})\}. The proof of this result is provided in Appendix S.1 . Proposition 1 illustrated that, in general, the naive method presented in Section 3.1 fails. There are no explicit relations between \eta_{1}({\bf x}) and \xi_{1}({\bf x}) or between \eta({\bf x}) and \xi({\bf x}) . For the relation between \eta_{0}({\bf x}) and \xi_{0}({\bf x}) , they coincide only in the special case that \beta_{10}/\alpha_{10}=\beta_{00}/\alpha_{00} , which corresponds to a proportionality condition between the class-conditional densities across domains. Outside of this narrow scenario, the naive approach systematically misestimates the target posterior, leading to biased predictions. This result also implies that model adaptation fundamentally relies on estimating the proportions of key subgroups in the target population. In particular, for individuals with A=1 , one only needs to estimate \beta_{01} , while for those with A=0 , it suffices to estimate the ratio \beta_{10}/\beta_{00} . Denote {\boldsymbol{\beta}}=(\beta_{10},\beta_{00})^{\rm T} . It can be seen that, accurate estimation of the parameter {\boldsymbol{\beta}} in the target domain enables valid model adaptation across domains. Before developing methods for estimating {\boldsymbol{\beta}} in Section 3.4 , we first present some model identification considerations. 3.3 Model identification considerations The identifiability structure of our problem closely resembles that of the open set label shift (OSLS) framework ( Garg et al. 2022 ) . Note that our target distribution consists of a mixture over four joint distributions: \hbox{pr}(Y=1,A=1) , \hbox{pr}(Y=1,A=0) , \hbox{pr}(Y=0,A=0) , and \hbox{pr}(Y=0,A=1) . By treating the joint label (Y,A) as the response, this setting can be viewed as a special case of the OSLS framework. However, our setup is considerably simpler due to the availability of the auxiliary variable A in the target domain. As a result, we can restrict attention to the subset A=1 , thereby discarding the A=0 portion of the distribution. This reduction simplifies the problem to recovering \hbox{pr}(Y=1,A=1) from a mixture of \hbox{pr}(Y=1,A=1) and \hbox{pr}(Y=0,A=1) , given direct access to \hbox{pr}(Y=0,A=1) . This is a canonical positive-unlabeled (PU) learning problem. Identifiability in this setting is governed by the standard anchor set condition (see Definition 8 of Ramaswamy et al. 2016 ): there exists a measurable subset {\bf x}_{\mathrm{anchor}}\in\mathcal{X} such that \displaystyle p({\bf X}\in{\bf x}_{\mathrm{anchor}}|Y=0,A=1)>0\quad\text{and}\quad\frac{p({\bf X}\in{\bf x}_{\mathrm{anchor}}|Y=1,A=1)}{p({\bf X}\in{\bf x}_{\mathrm{anchor}}|Y=0,A=1)}=0. This condition ensures that the positive class (Y=1,A=1) has no support on a subset of the feature space that is occupied by the negative class (Y=0,A=1) , which is necessary for identifiability. Under the assumption ( 3 ), the primary difficulty arises from the fact that the component p_{11}({\bf x}) , corresponding to the subgroup (Y=1,A=1) , is not directly observable in either the source or target domain. To elucidate this observation, we denote {\bf p}_{0}({\bf x})=\{p_{10}({\bf x}),p_{00}({\bf x})\}^{\rm T} , and then the observed data log-likelihood of one generic observation in our UDA setting is proportional to: \displaystyle I_{110}{\rm log}p_{10}({\bf x})+I_{101}{\rm log}p_{01}({\bf x})+I_{100}{\rm log}p_{00}({\bf x}) \displaystyle+I_{0\cdot 1}{\rm log}\left\{\beta_{11}p_{11}({\bf x})+(1-\beta_{11}-{\boldsymbol{\beta}}^{\top}\mathbf{1})p_{01}({\bf x})\right\}+I_{0\cdot 0}{\rm log}\left\{{\boldsymbol{\beta}}^{\top}{\bf p}_{0}({\bf x})\right\}. In this formulation, the parameter with finite dimension is {\boldsymbol{\beta}} . The model involves four nonparametric nuisance components: p_{11}({\bf x}) , p_{10}({\bf x}) , p_{01}({\bf x}) , and p_{00}({\bf x}) . Lemma 1 . Assume \beta_{11}=0 and p_{10}({\bf x})\neq p_{00}({\bf x}) , then all components except p_{11}({\bf x}) are identifiable. Assume 0<\beta_{11}<1 and is known, and p_{10}({\bf x})\neq p_{00}({\bf x}) , then all components in the model are identifiable. The proof of Lemma 1 is provided in Appendix S.1 . The identification conditions in Lemma 1 are intuitive and reasonable. If \beta_{11}=0 , it degenerates to the situation that the source and target domains have the same support on both label Y and background A , then the component p_{11}({\bf x}) is no longer relevant. Also, if p_{10}({\bf x})=p_{00}({\bf x}) , the subpopulations of (Y=1,A=0) and (Y=0,A=0) become indistinguishable, and hence the individual probabilities \beta_{10} and \beta_{00} are not separately identifiable. Overall, these conditions are natural to ensure the problem is well-posed. 3.4 Estimating parameters of interest To estimate the parameter {\boldsymbol{\beta}} , we consider the distribution of attributes {\bf x} in the subpopulation defined by (R=0,A=0) . By the law of total probability, we have \displaystyle p({\bf x}\mid R=0,A=0)\hbox{pr}(R=0,A=0)=p_{10}({\bf x})\,\beta_{10}(1-\pi)+p_{00}({\bf x})\,\beta_{00}(1-\pi), (9) subject to the constraint \displaystyle\hbox{pr}(R=0,A=0)=\beta_{10}(1-\pi)+\beta_{00}(1-\pi). (10) Note that the distribution p({\bf x}\mid R=0,A=0) is identifiable from the target population. The distributions p_{10}({\bf x}) and p_{00}({\bf x}) can be consistently estimated from the source population subgroups (R=1,Y=1,A=0) and (R=1,Y=0,A=0) , respectively. Thus, the parameters {\boldsymbol{\beta}}=(\beta_{00},\beta_{10})^{\rm T} can be estimated by minimizing a suitable discrepancy measure between the two sides of equation ( 9 ), such as an L_{2} norm or a divergence-based criterion (e.g., Kullback–Leibler divergence), subject to the constraint in equation ( 10 ). Therefore, we reformulate the estimation of {\boldsymbol{\beta}} as a constrained distribution matching problem: \displaystyle\widehat{\boldsymbol{\beta}}=\mbox{argmin}_{{\boldsymbol{\beta}}}D\left\{\widehat{p}({\bf x}\mid R=0,A=0)\middle\|\{\widehat{p}_{10}({\bf x})\beta_{10}+\widehat{p}_{00}({\bf x})\beta_{00}\}/\widehat{\hbox{pr}}(A=0|R=0)\right\}, (11) subject to \widehat{\hbox{pr}}(A=0|R=0)=\beta_{10}+\beta_{00} , where D denotes a discrepancy measure between probability distributions over the covariate space \mathcal{X} . Among various choices for D , we adopt the Kullback–Leibler (KL) divergence due to its favorable analytical and computational properties. To facilitate optimization, we relax the constraint in ( 11 ) and reformulate the objective under KL divergence, as summarized in the following lemma. Lemma 2 . Let D be the Kullback–Leibler divergence. Then the solution \widehat{\beta}_{10} to the minimization problem ( 11 ) is given by \displaystyle\arg\max_{\beta_{10}}\widehat{E}\left({\rm log}[\widehat{\xi}_{0}({\bf X})\widehat{b}_{1}^{-1}\beta_{10}+\{1-\widehat{\xi}_{0}({\bf X})\}(1-\widehat{b}_{1})^{-1}(\widehat{\varrho}-\beta_{10})]\middle|R=0,A=0\right), (12) where, for simplicity, b_{1}=\hbox{pr}(Y=1|R=1,A=0) , \varrho=\hbox{pr}(A=0|R=0) and \widehat{E} represents the empirical average. The proof of Lemma 2 is provided in Appendix S.1 . A key advantage of minimizing the KL divergence is that it circumvents the need to explicitly estimate the generative models p_{10}({\bf x}) and p_{00}({\bf x}) , which are often difficult to model accurately in high dimensions. Instead, it suffices to estimate one background-specific prediction model \xi_{0}({\bf x}) using standard classification techniques on the source domain restricted to A=0 . The above method adopts the idea of distribution matching. Alternatively, one may consider matching only certain moments rather than the full distribution. Due to space constraints, we defer the details to Appendix S.1 . Algorithm 1 Implementation details of our proposed method. 1: Observed source domain data \{({\bf X}_{i},Y_{i},A_{i},R_{i}=1)\}_{i=1}^{n_{1}} and target domain data \{({\bf X}_{i},A_{i},R_{i}=0)\}_{i=1}^{n_{0}} . 2: Estimated benchmark prediction models \widehat{\xi}({\bf x}) , \widehat{\xi}_{1}({\bf x}) and \widehat{\xi}_{0}({\bf x}) , proposed prediction models for the target \widehat{\eta}({\bf x}) , \widehat{\eta}_{1}({\bf x}) and \widehat{\eta}_{0}({\bf x}) ; and subpopulation proportions \widehat{\alpha}_{ya} , \widehat{\beta}_{ya} . 3: Estimate \xi({\bf x}) (defined in ( 4 )) using data \{({\bf X}_{i},Y_{i},R_{i}=1):i=1,\cdots,n_{1}\} , as \widehat{\xi}({\bf x}) ; 4: Estimate \xi_{0}({\bf x}) (defined in ( 4 )) using data \{({\bf X}_{i},Y_{i},A_{i}=0,R_{i}=1):i=1,\cdots,n_{1}\} , as \widehat{\xi}_{0}({\bf x}) ; 5: Estimate \tau_{r}({\bf x}) (defined in ( 6 )) using data \{({\bf X}_{i},A_{i},R_{i}=r):i=1,\cdots n_{r}\},r=0,1 , as \widehat{\tau}_{r}({\bf x}) ; 6: Estimate \xi_{1}({\bf x}) following equation ( 5 ), as \widehat{\xi}_{1}({\bf x}) ; 7: Estimate \kappa({\bf x}) (defined in ( 7 )) using data \{({\bf X}_{i},R_{i},A_{i}=1):i=1,\cdots n\} , as \widehat{\kappa}({\bf x}) ; 8: Estimate {\boldsymbol{\beta}} and \alpha_{y,a} following equations ( 12 ) and ( 1 ), as \widehat{\boldsymbol{\beta}} and \widehat{\alpha}_{ya} for (y,a)\in\{0,1\} ; 9: Estimate \eta_{1}({\bf x}) , \eta_{0}({\bf x}) and \eta({\bf x}) following equation ( 8 ), as \widehat{\eta}_{1}({\bf x}) , \widehat{\eta}_{0}({\bf x}) and \widehat{\eta}({\bf x}) . Finally, based on all of the above discussions, we summarize the implementation details of our proposed method in Algorithm 1 . 3.5 Downstream tasks With any loss function \ell(\cdot) , for the background-specific prediction model with A=0 , the conditional risk is \displaystyle E[\ell\{h({\bf X}),Y\}\mid R=0,A=0]=E[\ell\{h({\bf X}),Y\}\,w(Y)\mid R=1,A=0], (13) where, for simplicity, we write w(y)=\frac{\hbox{pr}(y\mid R=0,A=0)}{\hbox{pr}(y\mid R=1,A=0)} . One can derive that w(1)=\frac{\beta_{10}(\alpha_{00}+\alpha_{10})}{\alpha_{10}(\beta_{00}+\beta_{10})} and w(0)=\frac{\beta_{00}(\alpha_{00}+\alpha_{10})}{\alpha_{00}(\beta_{00}+\beta_{10})} . To evaluate the performance of the prediction model, it can be approximated as \widehat{E}[\ell\{h({\bf X}),Y\}\,\widehat{w}(Y)\mid R=1,A=0] . Furthermore, the model can be fine-tuned specifically for the target subgroup by minimizing the reweighted empirical risk: \displaystyle\widehat{h}_{\widehat{w}}\in\arg\min_{h\in\mathcal{F}}\widehat{E}[\ell\{h({\bf X}),Y\}\,\widehat{w}(Y)\mid R=1,A=0], (14) where \mathcal{F} is a suitable function class. For the interest of space, for the other two prediction models, we only present the relations analogous to ( 13 ) without elaborations. For the background-specific prediction model with A=1 , one can derive E[\ell\{h({\bf X}),Y\}|R=0,A=1] as \displaystyle E[\ell\{h({\bf X}),Y=1\}|R=0,A=1]-E\left(\left[\ell\{h({\bf X}),Y=1\}-\ell\{h({\bf X}),Y=0\}\right]|Y=0,A=1\right)\frac{\beta_{01}}{\beta_{01}+\beta_{11}}. For the overall prediction model, the conditional risk E[\ell\{h({\bf X}),Y\}|R=0] is \displaystyle E[\ell\{h({\bf X}),Y\}\,w(Y)\mid R=1,A=0](\beta_{10}+\beta_{00})+E[\ell\{h({\bf X}),Y=1\}|R=0,A=1](\beta_{01}+\beta_{11}) \displaystyle-E\left(\left[\ell\{h({\bf X}),Y=1\}-\ell\{h({\bf X}),Y=0\}\right]|Y=0,A=1\right)\beta_{01}. 4 Theoretical Results For the interest of space, we only present the results for the background-specific prediction model with A=0 . The results for the other two prediction models are parallel and can be similarly developed. To facilitate the analysis, we begin by formally defining the population-level (expected) objective function: \displaystyle{\mathfrak{L}}(\xi_{0},b_{1},\beta_{10},\varrho)=E\left({\rm log}[\xi_{0}({\bf X})b_{1}^{-1}\beta_{10}+\{1-\xi_{0}({\bf X})\}(1-b_{1})^{-1}(\varrho-\beta_{10})]\middle|R=0,A=0\right), with its empirical version \widehat{{\mathfrak{L}}}(\xi_{0},b_{1},\beta_{10},\varrho) . Assumption 1 . Define {\boldsymbol{f}}({\bf x})=\{f_{0}({\bf x}),f_{1}({\bf x})\}^{\rm T} , where f_{0}({\bf x})={\rm log}\{\xi_{0}({\bf x})\}-\frac{1}{2}[{\rm log}\{\xi_{0}({\bf x})\}+{\rm log}\{1-\xi_{0}({\bf x})\}] and f_{1}({\bf x})={\rm log}\{1-\xi_{0}({\bf x})\}-\frac{1}{2}[{\rm log}\{\xi_{0}({\bf x})\}+{\rm log}\{1-\xi_{0}({\bf x})\}] , and the corresponding estimate is \{\widehat{f}_{k}({\bf x})\}_{k=0}^{1} . There exist a constant c>0 and a sequence r_{n_{1\cdot 0}}\to 0 such that, for almost every {\bf x} , we have \displaystyle\hbox{pr}\left(\|\widehat{{\boldsymbol{f}}}({\bf x})-{\boldsymbol{f}}({\bf x})\|_{2}>t\right)\leq\exp\left\{-t^{2}/(c^{2}r_{n_{1\cdot 0}}^{2})\right\},\quad\forall\ t>0. Theorem 1 . Suppose Assumption 1 holds. Define \chi_{n}=r_{n_{1\cdot 0}}\sqrt{{\rm log}(n_{0\cdot 0})}+n_{1\cdot 0}^{-1/2}+n_{0\cdot 0}^{-1/2} . Then, there exists a constant c_{10}>0 such that for any \delta>0 , with probability at least 1-6\delta , we have \displaystyle\|\widehat{\boldsymbol{\beta}}-\boldsymbol{\beta}\|_{1}\leq c_{10}\chi_{n}\sqrt{{\rm log}(1/\delta)}. The proof of Theorem 1 is provided in Appendix S.2 . Theorem 1 establishes the consistency of the estimator \widehat{{\boldsymbol{\beta}}} , provided that r_{n_{1\cdot 0}}\sqrt{{\rm log}(n_{0\cdot 0})}\to 0 as n_{1\cdot 0},n_{0\cdot 0}\to\infty . Next, we establish a generalization bound for the fitted model ( 14 ), which is obtained via weighted empirical risk minimization over the source subgroup. Let \mathcal{F} denote the hypothesis class of classifiers. For any h\in\mathcal{F} and a weight function w(y):y\rightarrow{\bf R} , we define the population-level weighted loss and its empirical counterpart based on the source subgroup data as follows: \displaystyle{\mathcal{L}}_{1}(h,w) \displaystyle= \displaystyle E\left[\ell\{h({\bf X}),Y\}w(Y)\big|A=0,R=1\right], \displaystyle\widehat{\mathcal{L}}_{1}(h,w) \displaystyle= \displaystyle\widehat{E}\left[\ell\{h({\bf X}),Y\}w(Y)\big|A=0,R=1\right]. We also define the population loss on the target subgroup as: {\mathcal{L}}_{0}(h)=E\left[\ell\{h({\bf X}),Y\}\big|R=0,A=0\right] . Clearly, {\mathcal{L}}_{1}(h,w)={\mathcal{L}}_{0}(h) . To establish our generalization bound, we utilize the concept of Rademacher complexity ( Bartlett & Mendelson 2002 ) , denoted as \mathcal{R}_{n}(\mathcal{G}) (see Appendix S.2 for details), and impose the following assumption on the loss function: Assumption 2 . The loss function \ell is uniformly bounded; that is, there exists a constant B>0 such that \displaystyle|\ell\{h({\bf x}),y\}|\leq B\ \text{for any}\ h\in\mathcal{F},{\bf x}\in\mathcal{X}\subset{\bf R}^{q},\text{and}\ y\in\{0,1\}. We now present the generalization bound for the learned model, with its proof provided in Appendix S.2 . Proposition 2 . Under Assumptions 1 and 2 , let \widehat{h}_{\widehat{w}}=\mbox{argmin}_{h\in\mathcal{F}}\widehat{\mathcal{L}}_{1}(h,\widehat{w}) be the classifier obtained by minimizing the reweighted empirical risk on the source subgroup. Then, there exist constants c,d>0 such that, with probability at least 1-7\delta , the following generalization bound holds: \displaystyle{\mathcal{L}}_{0}(\widehat{h}_{\widehat{w}})-\min_{h\in\mathcal{F}}{\mathcal{L}}_{0}(h)\leq 2\mathcal{R}_{n_{1\cdot 0}}(\mathcal{G})+dB\|\widehat{\boldsymbol{\beta}}-{\boldsymbol{\beta}}\|_{1}+c\left\{\sqrt{\frac{{\rm log}(1/\delta)}{n_{1\cdot 0}}}+\sqrt{\frac{{\rm log}(1/\delta)}{n_{0}}}\right\}, where \mathcal{G}=\{w(y)\ell\{h({\bf x}),y\}:h\in\mathcal{F}\} , and \mathcal{R}_{n_{1\cdot 0}}(\mathcal{G}) denotes its Rademacher complexity as defined in Appendix S.2 . 5 Experiments We conduct extensive experiments on both synthetic and real-world datasets. Due to space limitations, we present the results on the Waterbirds dataset here and provide additional results in Appendix S.3 . The Waterbirds dataset ( Sagawa et al. 2019 ) consists of 11,788 images. The label Y=1 denotes a waterbird and Y=0 landbird. The background A=1 corresponds to a water background and A=0 a land background. It yields four label–background subpopulations, as summarized in Table 3 . Table 3: Empirical joint distribution of (Y,A) in the Waterbirds dataset, with varied values of a , b and c , 00 , we obtain p_{11}({\bf x})=\widetilde{p}_{11}({\bf x}) . Finally, ( S.1 ) leads to (\beta_{10}-\widetilde{\beta}_{10})p_{10}({\bf x})=(\widetilde{\beta}_{00}-\beta_{00})p_{00}({\bf x}) , which can only hold if \beta_{10}=\widetilde{\beta}_{10} and \widetilde{\beta}_{00}=\beta_{00} since p_{10}({\bf x})\neq p_{00}({\bf x}) . This completes the proof. ∎ Proof of Lemma 2 . \displaystyle D\left\{p({\bf x}|R=0,A=0)\middle\|\sum_{k=0}^{1}p({\bf x}|Y=k,A=0)\beta_{k0}\frac{1-\pi}{\hbox{pr}(R=0,A=0)}\right\} \displaystyle= \displaystyle\int p({\bf x}|R=0,A=0){\rm log}\frac{p({\bf x}|R=0,A=0)}{\sum_{k=0}^{1}p({\bf x}|Y=k,A=0)\beta_{k0}\frac{1-\pi}{\hbox{pr}(R=0,A=0)}}{{\bf d}}{\bf x} \displaystyle= \displaystyle\int p({\bf x}|R=0,A=0){\rm log}\frac{p({\bf x}|R=0,A=0)}{\sum_{k=0}^{1}p({\bf x}|Y=k,A=0)\beta_{k0}\frac{1-\pi}{\hbox{pr}(R=0,A=0)}}{{\bf d}}{\bf x} \displaystyle= \displaystyle\int p({\bf x}|R=0,A=0){\rm log}\frac{p({\bf x}|R=0,A=0)}{p({\bf x}|R=1,A=0)}{{\bf d}}{\bf x} \displaystyle-\int p({\bf x}|R=0,A=0){\rm log}\frac{\sum_{k=0}^{1}p({\bf x}|Y=k,A=0)\beta_{k0}\frac{1-\pi}{\hbox{pr}(R=0,A=0)}}{p({\bf x}|R=1,A=0)}{{\bf d}}{\bf x} \displaystyle= \displaystyle\int p({\bf x}|R=0,A=0){\rm log}\frac{p({\bf x}|R=0,A=0)}{p({\bf x}|R=1,A=0)}{{\bf d}}{\bf x} \displaystyle-\int p({\bf x}|R=0,A=0){\rm log}\sum_{k=0}^{1}\frac{\hbox{pr}(Y=k|{\bf x},R=1,A=0)\beta_{k0}(1-\pi)\hbox{pr}(R=1,A=0)}{\hbox{pr}(R=1,Y=k,A=0)\hbox{pr}(R=0,A=0)}{{\bf d}}{\bf x}. Minimizing the above equation is equivalent to maximizing \displaystyle\mbox{argmax}_{{\boldsymbol{\beta}}}E\left\{{\rm log}\sum_{k=0}^{1}\hbox{pr}(Y=k|{\bf x},R=1,A=0)\frac{\beta_{k0}}{\hbox{pr}(Y=k|R=1,A=0)}\middle|R=0,A=0\right\}, subject to \hbox{pr}(R=0,A=0)=\beta_{10}(1-\pi)+\beta_{00}(1-\pi) . We enforce this restriction as a constraint in the distribution matching problem: where D is a discrepancy between probability distributions on \mathcal{X} . Define \displaystyle{\mathfrak{L}}(\xi_{0},b_{1},\beta_{10},\varrho)=E\left({\rm log}[\xi_{0}({\bf X})b_{1}^{-1}\beta_{10}+\{1-\xi_{0}({\bf X})\}(1-b_{1})^{-1}(\varrho-\beta_{10})]\middle|R=0,A=0\right). Its empirical version is \displaystyle\widehat{{\mathfrak{L}}}(\xi_{0},b_{1},\beta_{10},\varrho)=\widehat{E}\left({\rm log}[\xi_{0}({\bf X})b_{1}^{-1}\beta_{10}+\{1-\xi_{0}({\bf X})\}(1-b_{1})^{-1}(\varrho-\beta_{10})]\middle|R=0,A=0\right). ∎ An Alternative Approach for Estimating {\boldsymbol{\beta}} In the main text, we explore the use of distribution matching for estimating {\boldsymbol{\beta}} . Alternatively, it is sufficient to only consider some moments instead of the whole distribution. For any measurable function {\bf m}({\bf x}) , the law of total expectation yields the identity: \displaystyle E\{{\bf m}({\bf x})\mid R=0,A=0\}\hbox{pr}(R=0,A=0) (S.2) \displaystyle= \displaystyle E\{{\bf m}({\bf x})\mid 1,0\}\beta_{10}(1-\pi)+E\{{\bf m}({\bf x})\mid 0,0\}\beta_{00}(1-\pi). Rewriting equation ( S.2 ), we obtain the following linear system: \displaystyle(1-\pi)p_{0\cdot 0}^{-1}\left[E\{{\bf m}({\bf x})\mid 1,0\},E\{{\bf m}({\bf x})\mid 0,0\}\right]{\boldsymbol{\beta}}=E\{{\bf m}({\bf x})\mid R=0,A=0\}, which leads to the expression \displaystyle{\boldsymbol{\beta}}=(1-\pi)^{-1}p_{0\cdot 0}\left[E\{{\bf m}({\bf x})\mid 1,0\},E\{{\bf m}({\bf x})\mid 0,0\}\right]^{-1}E\{{\bf m}({\bf x})\mid R=0,A=0\}, provided that the 2\times 2 matrix \left[E\{{\bf m}({\bf x})\mid 1,0\},E\{{\bf m}({\bf x})\mid 0,0\}\right] is invertible. To use the idea of moment matching, one has the flexibility of choosing different moments {\bf m}({\bf x}) . Certainly, a further research question of interest is to identify the optimal choice of this moment function, say, {\bf m}_{\rm opt}({\bf x}) , by borrowing the semiparametric techniques ( Bickel et al. 1993 , Tsiatis 2006 ) . S.2 Proofs and More Details in Section 4 Firstly, note that the tail bound described in Assumption 1 is intended to hold uniformly for every n_{1\cdot 0} when estimating \widehat{f}_{k} for k=0,1 . In other words, for each subsample size n_{1\cdot 0} , we have a r_{n_{1\dot{0}}} such that the corresponding estimators \widehat{f}_{k} for k=0,1 are required to satisfy the stated concentration inequality. This inequality is analogous to Hoeffding’s inequality and provides a non-asymptotic concentration bound on the estimation error. Similar assumptions have also been adopted in recent work (e.g., Maity et al. 2022 , Tsybakov & Audibert 2007 ). We next define the Rademacher complexity ( Bartlett & Mendelson 2002 ) that has been frequently used in machine learning literature to establish a generalization bound. Instead of considering the Rademacher complexity on \mathcal{F} we define the class of weighted losses \mathcal{G}(\ell,\mathcal{F})=[w(x,y)\ell\{g(x),y\}:g\in\mathcal{F}] and n\in N we define its Rademacher complexity measure as \displaystyle\mathcal{R}_{n}(\mathcal{G}):=E_{u_{i},v_{i}}\left(E_{\xi_{i}}\left[\sup_{h\in\mathcal{F}}\frac{1}{n}\sum_{i=1}^{n}\xi_{i}w(u_{i},v_{i})\ell\{g(u_{i}),v_{i}\}\right]\right), where \{\xi_{i}\}_{i=1}^{n} are i.i.d. Rademacher random variables, taking values \pm 1 with equal probability 1/2 . Proof of Theorem 1 . For a probabilistic classifier: \{\xi_{0}({\bf x}),1-\xi_{0}({\bf x})\}:\mathcal{X}\rightarrow\Delta^{2} , and the parameter {\boldsymbol{\beta}}^{\rm T}=(\beta_{10},\beta_{00}) and b_{1}=\hbox{pr}(Y=1|R=1,A=0) , we define the centered logit function {\boldsymbol{f}}:\mathcal{X}\rightarrow{\bf R}^{2} as f_{0}({\bf x})={\rm log}\xi_{0}({\bf x})-\frac{1}{2}[{\rm log}\xi_{0}({\bf x})+{\rm log}\{1-\xi_{0}({\bf x})\}] and f_{1}({\bf x})={\rm log}\{1-\xi_{0}({\bf x})\}-\frac{1}{2}[{\rm log}\xi_{0}({\bf x})+{\rm log}\{1-\xi_{0}({\bf x})\}] . We define the functions \mu(f_{0},b_{1})=\xi_{0}({\bf x})b_{1}^{-1}-\{1-\xi_{0}({\bf x})\}(1-b_{1})^{-1} and \omega(f_{0},b_{1},\beta_{10},\varrho)=\xi_{0}({\bf x})b_{1}^{-1}\beta_{10}+\{1-\xi_{0}({\bf x})\}(1-b_{1})^{-1}(\varrho-\beta_{10}) , and notice that the objective is \displaystyle\widehat{L}(f_{0},b_{1},\beta_{10},\varrho)=\widehat{E}\left\{{\rm log}\omega(f_{0},b_{1},\beta_{10},\varrho)|R=0,A=0\right\}, whereas the true objective is \displaystyle L(f_{0},b_{1},\beta_{10},\varrho)=E\left\{{\rm log}\omega(f_{0},b_{1},\beta_{10},\varrho)|R=0,A=0\right\}, We see that the first-order optimality conditions in estimating \widehat{\beta}_{10} are \displaystyle 0 \displaystyle= \displaystyle\partial_{\beta_{10}}\widehat{L}(\widehat{f_{0}},\widehat{b}_{1},\widehat{\beta}_{10},\widehat{\varrho}) (S.3) \displaystyle= \displaystyle\partial_{\beta_{10}}\left[\widehat{E}\left\{{\rm log}\omega(\widehat{f}_{0},\widehat{b}_{1},\widehat{\beta}_{10},\widehat{\varrho})\middle|R=0,A=0\right\}\right] \displaystyle= \displaystyle\widehat{E}\left[\frac{\partial_{\beta_{10}}\{\omega(\widehat{f}_{0},\widehat{b}_{1},\widehat{\beta}_{10},\widehat{\varrho})\}}{\omega(\widehat{f}_{0},\widehat{b}_{1},\widehat{\beta}_{10},\widehat{\varrho})}\middle|R=0,A=0\right]. Similarly, the first order optimality condition at truth (for \beta_{10} ) are \displaystyle 0 \displaystyle= \displaystyle\partial_{\beta_{10}}{L}({f_{0}},{b_{1}},{\beta}_{10},\varrho) \displaystyle= \displaystyle\partial_{\beta_{10}}\left[{E}\left\{{\rm log}\omega({f}_{0},{b}_{1},\beta_{10},\varrho)\middle|R=0,A=0\right\}\right] \displaystyle= \displaystyle{E}\left[\frac{\partial_{\beta_{10}}\{\omega(f_{0},b_{1},\beta_{10},\varrho)\}}{\omega(f_{0},b_{1},\beta_{10},\varrho)}\middle|R=0,A=0\right]. We decompose ( S.3 ) using the Taylor expansion and obtain: \displaystyle 0=\partial_{\beta_{10}}\widehat{L}(f_{0},\widehat{b}_{1},\widehat{\beta}_{10},\widehat{\varrho})+\langle\widehat{f}_{0}-f_{0},\partial_{f_{0}}\partial_{\beta_{10}}\widehat{L}(\widetilde{f}_{0},\widehat{b}_{1},\widehat{\beta}_{10},\widehat{\varrho})\rangle where \widetilde{f}_{0} is a function in the bracket [f_{0},\widehat{f}_{0}] , i.e. for every {\bf x} , \widetilde{f}_{0}({\bf x}) is a number between \widehat{f}_{0}({\bf x}) and f_{0}({\bf x}) . Bound on \langle\widehat{f}_{0}-f_{0},\partial_{f_{0}}\partial_{\beta_{10}}\widehat{L}(\widetilde{f}_{0},\widehat{b}_{1},\widehat{\beta}_{10},\widehat{\varrho})\rangle : To bound the term, we define \zeta_{0}=\widehat{f}_{0}-f_{0} and notice that \displaystyle\langle\zeta_{0},\partial_{f_{0}}\partial_{\beta_{10}}\widehat{L}(\widetilde{f}_{0},\widehat{b}_{1},\widehat{\beta}_{10},\widehat{\varrho})\rangle \displaystyle= \displaystyle\left\langle\zeta_{0},\partial_{f_{0}}\left[\widehat{E}\left\{\frac{\mu(\widetilde{f}_{0},\widehat{b}_{1})}{\omega(\widetilde{f}_{0},\widehat{b}_{1},\widehat{\beta}_{10},\widehat{\varrho})}\middle|R=0,A=0\right\}\right]\right\rangle \displaystyle= \displaystyle\widehat{E}\left(\zeta_{0}\frac{2\widetilde{\xi}_{0}(1-\widetilde{\xi}_{0})}{\omega(\widetilde{f}_{0},\widehat{b}_{1},\widehat{\beta}_{10},\widehat{\varrho})}\left[\widehat{b}_{1}^{-1}+(1-\widehat{b}_{1})^{-1}\right.\right. \displaystyle\left.\left.-\frac{\mu(\widetilde{f}_{0},\widehat{b}_{1})}{\omega(\widetilde{f}_{0},\widehat{b}_{1},\widehat{\beta}_{10},\widehat{\varrho})}\left\{\widehat{b}_{1}^{-1}\widehat{\beta}_{10}-(1-\widehat{b}_{1})^{-1}(\widehat{\varrho}-\widehat{\beta}_{10})\right\}\right]\middle|R=0,A=0\right). The derivative in third equality in the above display is calculated in Lemma 3 . Assume \varrho-\epsilon>\beta_{10}>\epsilon>0 and 1-\epsilon_{1}>b_{1}>\epsilon_{1}>0 , i.e., there exist a c_{1}>0 such that \left|\frac{2\widetilde{\xi}_{0}(1-\widetilde{\xi}_{0})}{\omega(\widetilde{f}_{0},\widehat{b}_{1},\widehat{\beta}_{10},\widehat{\varrho})}\left[\widehat{b}_{1}^{-1}+(1-\widehat{b}_{1})^{-1}-\frac{\mu(\widetilde{f}_{0},\widehat{b}_{1})}{\omega(\widetilde{f}_{0},\widehat{b}_{1},\widehat{\beta}_{10},\widehat{\varrho})}\left\{\widehat{b}_{1}^{-1}\widehat{\beta}_{10}-(1-\widehat{b}_{1})^{-1}(\widehat{\varrho}-\widehat{\beta}_{10})\right\}\right]\right|\beta_{10}>\epsilon>0 and 1-\epsilon_{1}>b_{1}>\epsilon_{1}>0 , i.e., there exist a c_{2}>0 such that \left|\left[\frac{-\xi_{0}({\bf x})\widetilde{b}_{1}^{-2}-\{1-\xi_{0}({\bf x})\}(1-\widetilde{b}_{1})^{-2}}{\omega({f}_{0},\widetilde{b}_{1},\widehat{\beta}_{10},\widehat{\varrho})}-\frac{\mu(f_{0},\widetilde{b}_{1})}{\omega({f}_{0},\widetilde{b}_{1},\widehat{\beta}_{10},\widehat{\varrho})}\frac{-\xi_{0}({\bf x})\widetilde{b}_{1}^{-2}\widehat{\beta}_{10}+\{1-\xi_{0}({\bf x})\}(1-\widetilde{b}_{1})^{-2}(\widehat{\varrho}-\widehat{\beta}_{10})}{\omega({f}_{0},\widetilde{b}_{1},\widehat{\beta}_{10},\widehat{\varrho})}\right]\right|0 such that for any \delta>0 with probability at least 1-\delta it holds \displaystyle|\widehat{b}_{1}-b_{1}|=|\widehat{\hbox{pr}}(Y=1|R=1,A=0)-\hbox{pr}(Y=1|R=1,A=0)|\leq c_{3}\sqrt{\frac{{\rm log}(1/\delta)}{n_{1\cdot 0}}}. Bound on \partial_{\beta_{10}}\widehat{L}({f}_{0},{b}_{1},\widehat{\beta}_{10},\widehat{\varrho})-\partial_{\beta_{10}}\widehat{L}({f}_{0},{b}_{1},\widehat{\beta}_{10},\varrho) . Using the taylor expansion, we have \displaystyle\partial_{\beta_{10}}\widehat{L}({f}_{0},{b}_{1},\widehat{\beta}_{10},\widehat{\varrho})-\partial_{\beta_{10}}\widehat{L}({f}_{0},{b}_{1},\widehat{\beta}_{10},\varrho)=\langle\widehat{\varrho}-\varrho,\partial_{\varrho}\partial_{\beta_{10}}\widehat{L}(f_{0},{b}_{1},\widehat{\beta}_{10},\widetilde{\varrho})\rangle \displaystyle= \displaystyle\widehat{E}\left[(\widehat{\varrho}-\varrho)\frac{-\mu(f_{0},b_{1})\{1-\xi_{0}({\bf x})\}(1-b_{1})^{-1}}{\omega^{2}({f}_{0},{b}_{1},\widehat{\beta}_{10},\widetilde{\varrho})}\middle|R=0,A=0\right]. Assume \varrho-\epsilon>\beta_{10}>\epsilon>0 and 1-\epsilon_{1}>b_{1}>\epsilon_{1}>0 , i.e., there exist a c_{4}>0 such that \left|\frac{-\mu(f_{0},b_{1})\{1-\xi_{0}({\bf x})\}(1-b_{1})^{-1}}{\omega^{2}({f}_{0},{b}_{1},\widehat{\beta}_{10},\widetilde{\varrho})}\right|0 such that for any \delta>0 with probability at least 1-\delta it holds \displaystyle|\widehat{\varrho}-\varrho|=|\widehat{\hbox{pr}}(A=0|R=0)-\hbox{pr}(A=0|R=0)|\leq c_{5}\sqrt{\frac{{\rm log}(1/\delta)}{n_{0}}}. The term \partial_{\beta_{10}}\widehat{L}(f_{0},\widehat{b}_{1},\widehat{\beta}_{10},\widehat{\varrho}) : We have \displaystyle\partial_{\beta_{10}}\widehat{L}(f_{0},\widehat{b}_{1},\widehat{\beta}_{10},\widehat{\varrho})-\partial_{\beta_{10}}\widehat{L}(f_{0},{b}_{1},\widehat{\beta}_{10},\varrho)+\partial_{\beta_{10}}\widehat{L}(f_{0},{b}_{1},\widehat{\beta}_{10},\varrho) \displaystyle= \displaystyle\partial_{\beta_{10}}\widehat{L}(f_{0},{b}_{1},\widehat{\beta}_{10},\varrho)+O_{p}(|\widehat{b}_{1}-b_{1}|+|\widehat{\varrho}-\varrho|). Now, we study the term \partial_{\beta_{10}}\widehat{L}(f_{0},{b}_{1},\widehat{\beta}_{10},\varrho) , use strong convexity of -L(f_{0},{b}_{1},\beta_{10},\varrho) with \beta_{10} and the convergence of the loss that \displaystyle\sup_{\beta_{10}\in(0,\varrho)}|\widehat{L}(f_{0},{b}_{1},\beta_{10},\varrho)-L(f_{0},{b}_{1},\beta_{10},\varrho)|\xrightarrow{n_{0\cdot 0}\rightarrow\infty}0 for \beta_{10}\in(0,\varrho) in Wellner et al. 2013 (see Corollary 3.2.3) to conclude that \widehat{\beta}_{10}\rightarrow\beta_{10} in probability and hence \widehat{\beta}_{10} is a consistent estimator for \beta_{10} . Following the consistency of \widehat{\beta}_{10} we see that for sufficiently large n_{0\cdot 0} , we have |\widehat{\beta}_{10}-\beta_{10}|\leq\delta_{\beta} ( \delta_{\beta} is chosen bound by \frac{\beta_{10}}{2}\wedge\frac{\varrho-\beta_{10}}{2} ) with probability at least 1-\delta and on the event it holds: \widehat{\beta}_{10}\in[\beta_{10}-\delta_{\beta},\beta_{10}+\delta_{\beta}] . We define empirical process \displaystyle Z_{n_{0\cdot 0}}=\sup_{\beta\in[\beta_{10}-\delta_{\beta},\beta_{10}+\delta_{\beta}]}|\partial_{\beta}\widehat{L}(f_{0},{b}_{1},\beta,\varrho)-\partial_{\beta}L(f_{0},{b}_{1},\beta,\varrho)| for which we shall provide a high probability upper bound. We denote Z_{n_{0\cdot 0}}(\beta)=\partial_{\beta}\widehat{L}(f_{0},{b}_{1},\beta,\varrho)-\partial_{\beta}L(f_{0},{b}_{1},\beta,\varrho) and notice that \displaystyle\partial_{\beta}\widehat{L}(f_{0},{b}_{1},\beta,\varrho)-\partial_{\beta}L(f_{0},{b}_{1},\beta,\varrho) \displaystyle= \displaystyle\widehat{E}\left\{\frac{\mu(f_{0},b_{1})}{\omega(f_{0},b_{1},\beta,\varrho)}\middle|R=0,A=0\right\}-{E}\left\{\frac{\mu(f_{0},b_{1})}{\omega(f_{0},b_{1},\beta,\varrho)}\middle|R=0,A=0\right\}:=A(\beta) where to bound A(\beta) we notice that \frac{\mu(f_{0},b_{1})}{\omega(f_{0},b_{1},\beta,\varrho)} are i.i.d. and bounded by c_{0} ( \beta^{-1}+(\varrho-\beta)^{-1}\leq\frac{2}{\beta_{10}}+\frac{2}{\varrho-\beta_{10}}\leq c_{0} for all {\bf x}\in\mathcal{X} ) and hence sub-gaussian. We apply Hoeffding’s concentration inequality for a sample mean if i.i.d. sub-gaussian random variables and obtain a constant c_{6}>0 such that for any \delta>0 with probability at least 1-\delta it holds \displaystyle A(\beta) \displaystyle= \displaystyle\widehat{E}\left\{\frac{\mu(f_{0},b_{1})}{\omega(f_{0},b_{1},\beta,\varrho)}\middle|R=0,A=0\right\}-{E}\left\{\frac{\mu(f_{0},b_{1})}{\omega(f_{0},b_{1},\beta,\varrho)}\middle|R=0,A=0\right\} \displaystyle\leq c_{0}c_{6}\sqrt{\frac{{\rm log}(1/\delta)}{n_{0\cdot 0}}}. Use chained arguments for \ell_{1} with interval length 2\delta_{\beta} we obtain a uniform bound as the following: there exists a constant c_{7}>0 such that for any \delta>0 with probability at least 1-\delta if it holds \displaystyle\sup_{\beta\in[\beta_{10}-\delta_{\beta},\beta_{10}+\delta_{\beta}]}A(\beta)\leq c_{0}c_{6}c_{7}\sqrt{\frac{{\rm log}(1/\delta)}{n_{0\cdot 0}}}. Therefore, with probability at least 1-\delta , we have \displaystyle Z_{n_{0\cdot 0}}\leq c_{0}c_{6}c_{7}\sqrt{\frac{{\rm log}(1/\delta)}{n_{0\cdot 0}}}. Returning to the first order optimality condition for estimating \widehat{\beta}_{10} we notice that \displaystyle 0 \displaystyle= \displaystyle(\widehat{\beta}_{10}-\beta_{10})\left\{\partial_{\beta_{10}}\widehat{L}(f_{0},\widehat{b}_{1},\widehat{\beta}_{10},\widehat{\varrho})+\langle\widehat{f}_{0}-f_{0},\partial_{f_{0}}\partial_{\beta_{10}}\widehat{L}(\widetilde{f}_{0},\widehat{b}_{1},\widehat{\beta}_{10},\widehat{\varrho})\rangle\right\} \displaystyle= \displaystyle(\widehat{\beta}_{10}-\beta_{10})\left\{\partial_{\beta_{10}}\widehat{L}(f_{0},\widehat{b}_{1},\widehat{\beta}_{10},\widehat{\varrho})-\partial_{\beta_{10}}\widehat{L}(f_{0},b_{1},\widehat{\beta}_{10},\varrho)+\partial_{\beta_{10}}\widehat{L}(f_{0},b_{1},\widehat{\beta}_{10},\varrho)\right. \displaystyle\left.+\langle\widehat{f}_{0}-f_{0},\partial_{f_{0}}\partial_{\beta_{10}}\widehat{L}(\widetilde{f}_{0},\widehat{b}_{1},\widehat{\beta}_{10},\widehat{\varrho})\rangle\right\} \displaystyle= \displaystyle(\widehat{\beta}_{10}-\beta_{10})\partial_{\beta_{10}}L(f_{0},b_{1},\widehat{\beta}_{10},\varrho) \displaystyle+(\widehat{\beta}_{10}-\beta_{10})\left\{\partial_{\beta_{10}}\widehat{L}(f_{0},\widehat{b}_{1},\widehat{\beta}_{10},\widehat{\varrho})-\partial_{\beta_{10}}\widehat{L}(f_{0},b_{1},\widehat{\beta}_{10},\varrho)+Z_{n_{0\cdot 0}}(\widehat{\beta}_{10})\right. \displaystyle\left.+\langle\widehat{f}_{0}-f_{0},\partial_{f_{0}}\partial_{\beta_{10}}\widehat{L}(\widetilde{f}_{0},\widehat{b}_{1},\widehat{\beta}_{10},\widehat{\varrho})\rangle\right\}. We combine it with the first order optimality condition for {\boldsymbol{\beta}} to obtain \displaystyle(\widehat{\beta}_{10}-\beta_{10})\left\{\partial_{\beta_{10}}L(f_{0},b_{1},\widehat{\beta}_{10},\varrho)-\partial_{\beta_{10}}L(f_{0},b_{1},\beta_{10},\varrho)\right\} \displaystyle+(\widehat{\beta}_{10}-\beta_{10})\left\{\partial_{\beta_{10}}\widehat{L}(f_{0},\widehat{b}_{1},\widehat{\beta}_{10},\widehat{\varrho})-\partial_{\beta_{10}}\widehat{L}(f_{0},b_{1},\widehat{\beta}_{10},\varrho)+Z_{n_{0\cdot 0}}(\widehat{\beta}_{10})\right. \displaystyle\left.+\langle\widehat{f}_{0}-f_{0},\partial_{f_{0}}\partial_{\beta_{10}}\widehat{L}(\widetilde{f}_{0},\widehat{b}_{1},\widehat{\beta},\widehat{\varrho})\rangle\right\}=0, which can be rewritten as \displaystyle-(\widehat{\beta}_{10}-\beta_{10})\left\{\partial_{\beta_{10}}L(f_{0},b_{1},\widehat{\beta}_{10},\varrho)-\partial_{\beta_{10}}L(f_{0},b_{1},\beta_{10},\varrho)\right\} (S.4) \displaystyle= \displaystyle(\widehat{\beta}_{10}-\beta_{10})\left\{\partial_{\beta_{10}}\widehat{L}(f_{0},\widehat{b}_{1},\widehat{\beta}_{10},\widehat{\varrho})-\partial_{\beta_{10}}\widehat{L}(f_{0},b_{1},\widehat{\beta}_{10},\varrho)+Z_{n_{0\cdot 0}}(\widehat{\beta}_{10})\right. \displaystyle\left.+\langle\widehat{f}_{0}-f_{0},\partial_{f_{0}}\partial_{\beta_{10}}\widehat{L}(\widetilde{f}_{0},\widehat{b}_{1},\widehat{\beta}_{10},\widehat{\varrho})\rangle\right\}. Using the strong convexity of function -L at \beta_{10} , we obtain that the left-hand side in the above equation is lower bounded as \displaystyle-(\widehat{\beta}_{10}-\beta_{10})\left\{\partial_{\beta_{10}}L(f_{0},b_{1},\widehat{\beta}_{10},\varrho)-\partial_{\beta_{10}}L(f_{0},b_{1},\beta_{10},\varrho)\right\}\geq\mu(\widehat{\beta}_{10}-\beta_{10})^{2}. (S.5) Let \mathcal{E} be the event on which the following hold: • |\widehat{\beta}_{10}-\beta_{10}|\leq\delta_{\beta} . • |\langle\widehat{f}_{0}-f_{0},\partial_{f_{0}}\partial_{\beta_{10}}\widehat{L}(\widetilde{f}_{0},\widehat{b}_{1},\widehat{\beta}_{10},\widehat{\varrho})\rangle|\leq cc_{1}r_{n_{1\cdot 0}}\sqrt{{\rm log}(n_{0\cdot 0}){\rm log}(1/\delta)} . • Z_{n_{0\cdot 0}}\leq c_{0}c_{6}c_{7}\sqrt{\frac{{\rm log}(1/\delta)}{n_{0\cdot 0}}} . • |\partial_{\beta_{10}}\widehat{L}(f_{0},\widehat{b}_{1},\widehat{\beta}_{10},\widehat{\varrho})-\partial_{\beta_{10}}\widehat{L}(f_{0},b_{1},\widehat{\beta}_{10},\varrho)|\leq(c_{2}c_{3}+c_{4}c_{5})\left\{\sqrt{\frac{{\rm log}(1/\delta)}{n_{1\cdot 0}}}+\sqrt{\frac{{\rm log}(1/\delta)}{n_{0}}}\right\} . We notice that the event \mathcal{E} has probability 1-5\delta . Under the event there exists a c_{8}>0 such that the right-hand side in ( S.4 ) is upper bounded as \displaystyle\left|(\widehat{\beta}_{10}-\beta_{10})\left\{\partial_{\beta_{10}}\widehat{L}(f_{0},\widehat{b}_{1},\widehat{\beta}_{10},\widehat{\varrho})-\partial_{\beta_{10}}\widehat{L}(f_{0},b_{1},\widehat{\beta}_{10},\varrho)+Z_{n_{0\cdot 0}}(\widehat{\beta}_{10})\right.\right. (S.6) \displaystyle\left.\left.+\langle\widehat{f}_{0}-f_{0},\partial_{f_{0}}\partial_{\beta_{10}}\widehat{L}(\widetilde{f_{0}},\widehat{b}_{1},\widehat{\beta}_{10},\varrho)\rangle\right\}\right| \displaystyle\leq \displaystyle|\widehat{\beta}_{10}-\beta_{10}|\left\{|\partial_{\beta_{10}}\widehat{L}(f_{0},\widehat{b}_{1},\widehat{\beta}_{10},\widehat{\varrho})-\partial_{\beta_{10}}\widehat{L}(f_{0},b_{1},\widehat{\beta}_{10},\varrho)|+|Z_{n_{0\cdot 0}}(\widehat{\beta}_{10})|\right. \displaystyle\left.+|\langle\widehat{f}_{0}-f_{0},\partial_{f_{0}}\partial_{\beta_{10}}\widehat{L}(\widetilde{f}_{0},\widehat{b}_{1},\widehat{\beta}_{10},\widehat{\varrho})\rangle|\right\} \displaystyle\leq \displaystyle c_{8}\left\{r_{n_{1\cdot 0}}\sqrt{{\rm log}(n_{0\cdot 0}){\rm log}(1/\delta)}+\sqrt{\frac{{\rm log}(1/\delta)}{n_{1\cdot 0}}}+\sqrt{\frac{{\rm log}(1/\delta)}{n_{0}}}+\sqrt{\frac{{\rm log}(1/\delta)}{n_{0\cdot 0}}}\right\}|\widehat{\beta}_{10}-\beta_{10}|. Combining the bounds ( S.5 ) and ( S.6 ) for left and right hand sides we obtain a c_{10}>0 such that on the event \mathcal{E} it holds \displaystyle|\widehat{\beta}_{10}-\beta_{10}|\leq c_{10}\left\{r_{n_{1\cdot 0}}\sqrt{{\rm log}(n_{0\cdot 0}){\rm log}(1/\delta)}+\sqrt{\frac{{\rm log}(1/\delta)}{n_{1\cdot 0}}}+\sqrt{\frac{{\rm log}(1/\delta)}{n_{0}}}+\sqrt{\frac{{\rm log}(1/\delta)}{n_{0\cdot 0}}}\right\}. Further, sine A_{i} is bound random variable, then we can obtain a constant c_{9}>0 such that for any \delta>0 with probability at least 1-\delta it holds \displaystyle|\widehat{\beta}_{00}-\beta_{00}|=|(\widehat{\varrho}-\widehat{\beta}_{10})-(\varrho-\beta_{10})|\leq|\widehat{\varrho}-\varrho|+|\widehat{\beta}_{10}-\beta_{10}|\leq c_{9}\sqrt{\frac{{\rm log}(1/\delta)}{n_{0}}}+|\widehat{\beta}_{10}-\beta_{10}|. In summary, we have a constant c_{10}>0 such that for any \delta>0 with probability at least 1-6\delta it holds \displaystyle\|\widehat{\boldsymbol{\beta}}-{\boldsymbol{\beta}}\|_{1}\leq c_{10}\left\{r_{n_{1\cdot 0}}\sqrt{{\rm log}(n_{0\cdot 0}){\rm log}(1/\delta)}+\sqrt{\frac{{\rm log}(1/\delta)}{n_{1\cdot 0}}}+\sqrt{\frac{{\rm log}(1/\delta)}{n_{0}}}++\sqrt{\frac{{\rm log}(1/\delta)}{n_{0\cdot 0}}}\right\}. ∎ Lemma 3 . (Derivatives).Th following holds: • \partial_{f_{0}}(\xi_{0})=2\xi_{0}(1-\xi_{0}) ; • \partial_{f_{0}}\{\mu(f_{0},b_{1})\}=\partial_{f_{0}}(\xi_{0})\{b_{1}^{-1}+(1-b_{1})^{-1}\} ; • \partial_{f_{0}}\{\omega(f_{1},b_{1},\beta_{10},\varrho)\}=\partial_{f_{0}}(\xi_{0})\{b_{1}^{-1}\beta_{10}-(1-b_{1})^{-1}(\varrho-\beta_{10})\} ; • \partial_{f_{0}}\left\{\frac{\mu(f_{0},b_{1})}{\omega(f_{0},b_{1},\beta_{10},\varrho)}\right\}=\frac{2\xi_{0}(1-\xi_{0})}{\omega(f_{0},b_{1},\beta_{10},\varrho)}\left[b_{1}^{-1}+(1-b_{1})^{-1}-\frac{\mu(f_{0},b_{1})\{b_{1}^{-1}\beta_{10}-(1-b_{1})^{-1}(\varrho-\beta_{10})\}}{\omega(f_{0},b_{1},\beta_{10},\varrho)}\right] . Proof. \displaystyle\partial_{f_{0}}\xi_{0}=\partial_{f_{0}}\left(\frac{e^{f_{0}}}{e^{f_{0}}+e^{-f_{0}}}\right)=\frac{e^{f_{0}}\left(e^{f_{0}}+e^{-f_{0}}\right)-e^{f_{0}}\left(e^{f_{0}}-e^{-f_{0}}\right)}{\left(e^{f_{0}}+e^{-f_{0}}\right)^{2}}=2\xi_{0}(1-\xi_{0}), \displaystyle\partial_{f_{0}}\{\mu(f_{0},b_{1})\}=\partial_{f_{0}}(\xi_{0})\{b_{1}^{-1}+(1-b_{1})^{-1}\}, \displaystyle\partial_{f_{0}}\{\omega(f_{0},b_{1},\beta_{10},\varrho)\}=\partial_{f_{0}}(\xi_{0})b_{1}^{-1}\beta_{10}-\partial_{f_{0}}(\xi_{0})(1-b_{1})^{-1}(\varrho-\beta_{10}) \displaystyle=\partial_{f_{0}}(\xi_{0})\{b_{1}^{-1}\beta_{10}-(1-b_{1})^{-1}(\varrho-\beta_{10})\}. Thus, \displaystyle\partial_{f_{0}}\left\{\frac{\mu(f_{0},b_{1})}{\omega(f_{0},b_{1},\beta_{10},\varrho)}\right\} \displaystyle= \displaystyle\frac{\partial_{f_{0}}(\xi_{0})[\{b_{1}^{-1}+(1-b_{1})^{-1}\}\omega(f_{0},b_{1},\beta_{10},\varrho)-\mu(f_{0},b_{1})\{b_{1}^{-1}\beta_{10}-(1-b_{1})^{-1}(\varrho-\beta_{10})\}]}{\omega^{2}(f_{0},b_{1},\beta_{10},\varrho)} \displaystyle= \displaystyle\frac{\partial_{f_{0}}(\xi_{0})}{\omega(f_{0},b_{1},\beta_{10},\varrho)}\left[b_{1}^{-1}+(1-b_{1})^{-1}-\frac{\mu(f_{0},b_{1})\{b_{1}^{-1}\beta_{10}-(1-b_{1})^{-1}(\varrho-\beta_{10})\}}{\omega(f_{0},b_{1},\beta_{10},\varrho)}\right] \displaystyle= \displaystyle\frac{2\xi_{0}(1-\xi_{0})}{\omega(f_{0},b_{1},\beta_{10},\varrho)}\left[b_{1}^{-1}+(1-b_{1})^{-1}-\frac{\mu(f_{0},b_{1})\{b_{1}^{-1}\beta_{10}-(1-b_{1})^{-1}(\varrho-\beta_{10})\}}{\omega(f_{0},b_{1},\beta_{10},\varrho)}\right]. ∎ Proof of Proposition 2 . Define w(y)=\frac{pr(y|A=0,R=0)}{pr(y|A=0,R=1)} , \displaystyle{\mathcal{L}}_{0}(h) \displaystyle= \displaystyle{\mathrm{E}}[\ell\{h({\bf X}),Y\}|R=0,A=0] \displaystyle= \displaystyle\int\ell\{h({\bf X}),Y\}p({\bf x},y|A=0,R=0){\bf d}{\bf x}{\bf d}y \displaystyle= \displaystyle\int\ell\{h({\bf X}),Y\}\frac{p({\bf x},y|A=0,R=0)}{p({\bf x},y|A=0,R=1)}p({\bf x},y|A=0,R=1){\bf d}{\bf x}{\bf d}y \displaystyle= \displaystyle\int\ell\{h({\bf x}),y\}\frac{pr(y|A=0,R=0)}{pr(y|A=0,R=1)}\hbox{pr}({\bf x},y|A=0,R=1){\bf d}{\bf x}{\bf d}y \displaystyle= \displaystyle{\mathrm{E}}\left[\ell\{h({\bf X}),Y\}w(Y)\big|A=0,R=1\right]=:{\mathcal{L}}_{1}(h,w). Let {\mathcal{L}}_{1}(h,w)={\mathrm{E}}\left[\ell\{h({\bf X}),Y\}w(Y)\big|A=0,R=1\right] , then we have \displaystyle{\mathcal{L}}_{0}(\widehat{h})-{\mathcal{L}}_{0}(h) \displaystyle= \displaystyle{\mathcal{L}}_{1}(\widehat{h},w)-{\mathcal{L}}_{1}(h,w) (S.7) \displaystyle= \displaystyle\underbrace{{\mathcal{L}}_{1}(\widehat{h},w)-\widehat{\mathcal{L}}_{1}(\widehat{h},w)}_{(a)}+\underbrace{\widehat{\mathcal{L}}_{1}(\widehat{h},w)-\widehat{\mathcal{L}}_{1}(\widehat{h},\widehat{w})}_{(b)} \displaystyle+\underbrace{\widehat{\mathcal{L}}_{1}(\widehat{h},\widehat{w})-\widehat{\mathcal{L}}_{1}(h,\widehat{w})}_{\leq 0}+\underbrace{\widehat{\mathcal{L}}_{1}(h,\widehat{w})-\widehat{\mathcal{L}}_{1}(h,w)}_{(c)}+\underbrace{\widehat{\mathcal{L}}_{1}(h,w)-{\mathcal{L}}_{1}(h,w)}_{(d)}, where \widehat{h}\equiv\widehat{h}_{\widehat{w}} . Uniform bound on (a) To control (a) in ( S.7 ) we establish a concentration bound on the following generalization error \displaystyle\sup_{g\in\mathcal{F}}\{{\mathcal{L}}_{1}(g,w)-\widehat{\mathcal{L}}_{1}(g,w)\} \displaystyle= \displaystyle\sup_{g\in\mathcal{F}}\left\{E\left[\ell\{g({\bf X}),Y\}w(Y)\big|A=0,R=1\right]-\widehat{E}\left[\ell\{g({\bf X}),Y\}w(Y)\big|A=0,R=1\right]\right\} \displaystyle= \displaystyle:F({\bf Z}_{1:n_{1\cdot 0}}) where, for i>1 we denote {\bf Z}_{1:i}=({\bf Z}_{1},\cdots,{\bf Z}_{i}) and {\bf Z}_{i}=({\bf X}_{i},Y_{i}) . First, we use a modification of McDiarmid concentration inequality to bound F({\bf Z}_{1:n_{1\cdot 0}}) in terms of its expectation and a O_{p}(1/\sqrt{n_{1\cdot 0}}) term, as elucidated in the following lemma. Lemma 4 . There exists a constant c_{1}>0 such that with probability at least 1-\delta the following holds \displaystyle F({\bf Z}_{1:n_{1\cdot 0}})\leq E\{F({\bf Z}_{1:n_{1\cdot 0}})\}+c_{1}\sqrt{\frac{{\rm log}(1/\delta)}{n_{1\cdot 0}}}. (S.8) The proof is similar to Lemma A.3 of Maity et al. 2022 , so we omit it. Next, we use a symmetrization argument (see Wellner et al. 2013 , Chapter 2, Lemma 2.3.1) to bound the expectation E\{F({\bf Z}_{1:n_{1\cdot 0}})\} by the Rademacher complexity of the hypothesis class \mathcal{G} , i.e., \displaystyle E\{F({\bf Z}_{1:n_{1\cdot 0}})\}\leq 2\mathcal{R}_{n_{1\cdot 0}}(\mathcal{G}). (S.9) Combining ( S.8 ) and ( S.9 ) we obtain \displaystyle(a)\leq 2\mathcal{R}_{n_{1\cdot 0}}(\mathcal{G})+c_{1}\sqrt{\frac{{\rm log}(1/\delta)}{n_{1\cdot 0}}} (S.10) with probability at least 1-\delta . Uniform bound on (b) and (c) Denoting {\bf Z}_{i}=({\bf X}_{i},Y_{i}) and \ell_{g}({\bf Z}_{i})=\ell\{g({\bf X}_{i}),Y_{i}\} we notice that for any g\in\mathcal{F} we have \displaystyle|\widehat{\mathcal{L}}_{1}(g,w)-\widehat{\mathcal{L}}_{1}(g,\widehat{w})| \displaystyle= \displaystyle|\widehat{\mathrm{E}}\left[\ell\{g({\bf X}),Y\}\left\{w(Y)-\widehat{w}(Y)\right\}\mid A=0,R=1\right]|\leq\frac{\|\ell_{g}\|_{\infty}}{n_{1\cdot 0}}\sum_{i=1}^{n_{1\cdot 0}}\left|w(y_{i})-\widehat{w}(y_{i})\right|. Since w(y)-\widehat{w}(y) is a sub-gaussian random variable, we use sub-gaussian concentration to establish that for some constant c_{2}>0 , \displaystyle\text{for\ any}\ g\in\mathcal{F},|\widehat{\mathcal{L}}_{1}(g,w)-\widehat{\mathcal{L}}_{1}(g,\widehat{w})|\leq\|\ell_{g}\|_{\infty}\left\{{\mathrm{E}}_{Y}|w(Y)-\widehat{w}(Y)|+c_{2}\sqrt{\frac{{\rm log}(1/\delta)}{n_{1\cdot 0}}}\right\} with probability at least 1-\delta . This provides a simultaneous bound (on the same probability event) for both (b) and (c) with g=\widehat{h} and g=h . Further, by Lemma 5 , for some constants C_{1} and C_{2} and any g\in\mathcal{F} , we have \displaystyle|\widehat{\mathcal{L}}_{1}(g,w)-\widehat{\mathcal{L}}_{1}(g,\widehat{w})| (S.11) \displaystyle\leq \displaystyle\|\ell_{g}\|_{\infty}\left\{C_{1}\|\widehat{\boldsymbol{\beta}}-{\boldsymbol{\beta}}\|_{1}+C_{2}\left(\sqrt{\frac{{\rm log}(1/\delta)}{n_{0}}}+\sqrt{\frac{{\rm log}(1/\delta)}{n_{1}}}\right)+c_{2}\sqrt{\frac{{\rm log}(1/\delta)}{n_{1\cdot 0}}}\right\} with probability at least 1-5\delta . Uniform bound on (d) We note that \displaystyle\widehat{\mathcal{L}}_{1}(h,w)-{\mathcal{L}}_{1}(h,w) \displaystyle= \displaystyle\widehat{E}\left[\ell\{h({\bf X}),Y\}w(Y)\big|A=0,R=1\right]-E\left[\ell\{h({\bf X}),Y\}w(Y)\big|A=0,R=1\right] where [\ell\{h({\bf X}_{i}),Y_{i}\}w(Y_{i})]_{i=1}^{n_{1\cdot 0}} are i.i.d sub-gaussian random variables. Using Hoeffding concentration bound we conclude that there exists a constant c_{3}>0 such that for any \delta>0 the following holds with probability at least 1-\delta , \displaystyle\widehat{\mathcal{L}}_{1}(h,w)-{\mathcal{L}}_{1}(h,w)\leq c_{3}\sqrt{\frac{{\rm log}(1/\delta)}{n_{1\cdot 0}}}. (S.12) Finally, using ( S.10 ) on (a) (which is true on an event of probability \geq 1-\delta ), ( S.11 ) on (b) and (c) (simultaneously true on an event of probability 1-5\delta ), and ( S.12 ) on (d) (holds on an event of probability \geq 1-\delta ) we conclude that with probability at least 1-7\delta the following holds \displaystyle{\mathcal{L}}_{0}(\widehat{h}_{\widehat{w}})-{\mathcal{L}}_{0}(h)\leq 2\mathcal{R}_{n_{1\cdot 0}}(\mathcal{G})+CB\|\widehat{\boldsymbol{\beta}}-{\boldsymbol{\beta}}\|_{1}+c\left\{\sqrt{\frac{{\rm log}(1/\delta)}{n_{1\cdot 0}}}+\sqrt{\frac{{\rm log}(1/\delta)}{n_{0}}}+\sqrt{\frac{{\rm log}(1/\delta)}{n_{1}}}\right\}. where c=c_{1}+\|\ell_{g}\|_{\infty}(C_{2}+c_{2})+c_{3} . ∎ Lemma 5 . Assume |\beta_{i0}/\alpha_{i0}|\leq B_{1} for any i=0,1 . There exist constants C,c_{1},c_{2} , such that with probability at least 1-4\delta , \displaystyle|\widehat{w}(y)-w(y)|\leq CB_{1}\|\widehat{\boldsymbol{\beta}}-{\boldsymbol{\beta}}\|_{1}+CB_{1}(c_{1}+c_{2})\left(\sqrt{\frac{{\rm log}(1/\delta)}{n_{0}}}+\sqrt{\frac{{\rm log}(1/\delta)}{n_{1}}}\right). Proof. \displaystyle|\widehat{w}(y)-w(y)|=\left|\frac{\widehat{\hbox{pr}}(y|A=0,R=0)}{\widehat{\hbox{pr}}(y|A=0,R=1)}-\frac{\hbox{pr}(y|A=0,R=0)}{\hbox{pr}(y|A=0,R=1)}\right| \displaystyle= \displaystyle\left|\frac{\widehat{\hbox{pr}}(y,A=0|R=0)}{\widehat{\hbox{pr}}(y,A=0|R=1)}\frac{\widehat{\hbox{pr}}(A=0|R=1)}{\widehat{\hbox{pr}}(A=0|R=0)}-\frac{\hbox{pr}(y,A=0|R=0)}{\hbox{pr}(y,A=0|R=1)}\frac{\hbox{pr}(A=0|R=1)}{\hbox{pr}(A=0|R=0)}\right| \displaystyle\leq \displaystyle\left|\left\{\frac{\widehat{\hbox{pr}}(y,A=0|R=0)}{\widehat{\hbox{pr}}(y,A=0|R=1)}-\frac{\hbox{pr}(y,A=0|R=0)}{\hbox{pr}(y,A=0|R=1)}\right\}\frac{\widehat{\hbox{pr}}(A=0|R=1)}{\widehat{\hbox{pr}}(A=0|R=0)}\right| \displaystyle+\left|\frac{\hbox{pr}(y,A=0|R=0)}{\hbox{pr}(y,A=0|R=1)}\left\{\frac{\widehat{\hbox{pr}}(A=0|R=1)}{\widehat{\hbox{pr}}(A=0|R=0)}-\frac{\hbox{pr}(A=0|R=1)}{\hbox{pr}(A=0|R=0)}\right\}\right|. For the first term, we have \displaystyle\left|\frac{\widehat{\beta}_{y0}\alpha_{y0}-\beta_{y0}\widehat{\alpha}_{y0}}{\alpha_{y0}\widehat{\alpha}_{y0}}\frac{n_{1\cdot 0}}{n_{0\cdot 0}}\frac{n_{0}}{n_{1}}\right| \displaystyle= \displaystyle\left|\frac{(\widehat{\beta}_{y0}-\beta_{y0})\alpha_{y0}+\beta_{y0}(\alpha_{y0}-\widehat{\alpha}_{y0})}{\alpha_{y0}\widehat{\alpha}_{y0}}\frac{n_{1\cdot 0}}{n_{0\cdot 0}}\frac{n_{0}}{n_{1}}\right| \displaystyle\leq \displaystyle\left|\frac{y\alpha_{y0}}{\alpha_{y0}\widehat{\alpha}_{y0}}\frac{n_{1\cdot 0}}{n_{0\cdot 0}}\frac{n_{0}}{n_{1}}\right||\widehat{\beta}_{10}-\beta_{10}|+\left|\frac{(1-y)\alpha_{y0}}{\alpha_{y0}\widehat{\alpha}_{y0}}\frac{n_{1\cdot 0}}{n_{0\cdot 0}}\frac{n_{0}}{n_{1}}\right||\widehat{\beta}_{00}-\beta_{00}| \displaystyle+\left|\frac{y\beta_{y0}}{\alpha_{y0}\widehat{\alpha}_{y0}}\frac{n_{1\cdot 0}}{n_{0\cdot 0}}\frac{n_{0}}{n_{1}}\right|(\alpha_{10}-\widehat{\alpha}_{10})+\left|\frac{(1-y)\beta_{y0}}{\alpha_{y0}\widehat{\alpha}_{y0}}\frac{n_{1\cdot 0}}{n_{0\cdot 0}}\frac{n_{0}}{n_{1}}\right|(\alpha_{00}-\widehat{\alpha}_{00}) \displaystyle\leq \displaystyle CB_{1}(\|\widehat{\boldsymbol{\beta}}-{\boldsymbol{\beta}}\|_{1}+|\widehat{\alpha}_{00}-\alpha_{00}|+|\widehat{\alpha}_{10}-\alpha_{10}|). Here C is some constant. Since Y_{i} and A_{i} are sub-gaussian random variables, we use sub-gaussian concentration to establish that for some constant c>0 , \displaystyle|\widehat{\alpha}_{00}-\alpha_{00}|+|\widehat{\alpha}_{10}-\alpha_{10}|\leq c\left\{\sqrt{\frac{{\rm log}(1/\delta)}{n_{1}}}\right\} with probability at least 1-2\delta . For the second term, we have \displaystyle\left|\frac{\beta_{y0}}{\alpha_{y0}}\frac{\hbox{pr}(A=0|R=1)\widehat{\hbox{pr}}(A=0|R=0)-\hbox{pr}(A=0|R=0)\widehat{\hbox{pr}}(A=0|R=1)}{\hbox{pr}(A=0|R=0)\widehat{\hbox{pr}}(A=0|R=0)}\right| \displaystyle\leq \displaystyle\left|\frac{\beta_{y0}}{\alpha_{y0}}\right|\frac{\hbox{pr}(A=0|R=1)}{\hbox{pr}(A=0|R=0)\widehat{\hbox{pr}}(A=0|R=0)}\left|\{\widehat{\hbox{pr}}(A=0|R=0)-\hbox{pr}(A=0|R=0)\}\right| \displaystyle+\left|\frac{\beta_{y0}}{\alpha_{y0}}\right|\frac{\hbox{pr}(A=0|R=0)}{\hbox{pr}(A=0|R=0)\widehat{\hbox{pr}}(A=0|R=0)}\left|\{\hbox{pr}(A=0|R=1)-\widehat{\hbox{pr}}(A=0|R=1)\}\right| \displaystyle\leq \displaystyle\left|\frac{\beta_{y0}}{\alpha_{y0}}\right|\frac{p_{1\cdot 0}(1-\pi)n_{0}}{p_{0\cdot 0}\pi n_{0\cdot 0}}\left|\{\widehat{\hbox{pr}}(A=0|R=0)-\hbox{pr}(A=0|R=0)\}\right| \displaystyle+\left|\frac{\beta_{y0}}{\alpha_{y0}}\right|\frac{n_{0}}{n_{0\cdot 0}}\left|\{\hbox{pr}(A=0|R=1)-\widehat{\hbox{pr}}(A=0|R=1)\}\right| \displaystyle\leq \displaystyle CB_{1}(\left|\{\widehat{\hbox{pr}}(A=0|R=0)-\hbox{pr}(A=0|R=0)\}\right|+\left|\{\hbox{pr}(A=0|R=1)-\widehat{\hbox{pr}}(A=0|R=1)\}\right|). Here C is some constant. Since A_{i} is a sub-gaussian random variable, we use sub-gaussian concentration to establish that for some constant c>0 , \displaystyle\left|\{\widehat{\hbox{pr}}(A=0|R=0)-\hbox{pr}(A=0|R=0)\}\right|+\left|\{\hbox{pr}(A=0|R=1)-\widehat{\hbox{pr}}(A=0|R=1)\}\right| \displaystyle\leq \displaystyle c\left\{\sqrt{\frac{{\rm log}(1/\delta)}{n_{0}}}+\sqrt{\frac{{\rm log}(1/\delta)}{n_{1}}}\right\} with probability at least 1-2\delta . ∎ Remark 1 . Proposition 2 indicates that the generalization bound depends on the estimation error \|\widehat{\boldsymbol{\beta}}-{\boldsymbol{\beta}}\|_{1} , which can be directly controlled based on the conditions listed in Assumption 1 , implying that different estimation procedures for {\boldsymbol{\beta}} will yield different upper bounds. In Theorem 1 , we established an upper bound for the estimation error of \widehat{{\boldsymbol{\beta}}} , which directly leads to a refined generalization bound for the learned classifier \widehat{h}_{\widehat{w}} . Specifically, for any \delta>0 , with probability at least 1-13\delta , the following inequality holds: \displaystyle{\mathcal{L}}_{0}(\widehat{h}_{\widehat{w}})-\min_{h\in\mathcal{F}}{\mathcal{L}}_{0}(h)\leq 2\mathcal{R}_{n_{1\cdot 0}}(\mathcal{G})+dBc_{10}\chi_{n}\sqrt{{\rm log}(1/\delta)}+c\left\{\sqrt{\frac{{\rm log}(1/\delta)}{n_{1\cdot 0}}}+\sqrt{\frac{{\rm log}(1/\delta)}{n_{0}}}\right\}, where c_{10} is the constant appearing in Theorem 1 , and \alpha_{n} characterizes the convergence rate of \widehat{{\boldsymbol{\beta}}} . S.3 Synthetic Data Results We consider a structured data-generating process in which the covariates {\bf X}\in{\bf R}^{4} are drawn from a distribution conditioned on a latent pair (Y,A) , where Y\in\{0,1\} denotes the class label and A\in\{0,1\} denotes the background. The generation begins by sampling (Y,A) according to a predefined distribution. In the source domain, we consider (Y,A)\in\{(0,0),(0,1),(1,0)\} , each occurring with probability 1/3 . The covariates {\bf X}\in{\bf R}^{4} are generated as {\bf X}\sim N(\boldsymbol{\mu}_{\rm{YA}},{\bf I}_{4}) , where \boldsymbol{\mu}_{\rm{YA}} denotes the mean vector for each combination and {\bf I}_{4} is the 4\times 4 identity matrix. The stratum (1,1) is excluded from the source. In the target domain, all four combinations (Y,A)\in\{0,1\}^{2} appear with equal probability 1/4 , and {\bf X} is drawn from the same distribution N(\boldsymbol{\mu}_{\rm{YA}},{\bf I}_{4}) with distinct means: \displaystyle\boldsymbol{\mu}_{00}=(1,0,0,0)^{\rm T},\quad\boldsymbol{\mu}_{01}=(0,0,1,0)^{\rm T},\quad\boldsymbol{\mu}_{10}=(0,1,0,0)^{\rm T},\quad\boldsymbol{\mu}_{11}=(0,0,0,1)^{\rm T}. For model estimation, we utilize the known data-generating distribution to compute the conditional probability models required by both our proposed estimators and the benchmark method. Specifically, we calculate the five key conditional probabilities needed for implementation: \xi_{0}({\bf x}) , \xi({\bf x}) , \tau_{0}({\bf x}) , \tau_{1}({\bf x}) , and \kappa({\bf x}) , which together determine the models \eta_{0}({\bf x}) , \eta_{1}({\bf x}) and \eta({\bf x}) for our method, and \xi_{0}({\bf x}) , \xi_{1}({\bf x}) and \xi({\bf x}) for the benchmark. Additionally, the parameters \{\beta_{ya}:y=0,1;a=0,1\} and \{\alpha_{ya}:y=0,1;a=0,1\} as known. The classification threshold is set to 0.5 , consistent with the standard Bayesian decision rule—that is, a sample is classified as positive if the predicted probability exceeds 0.5 . To assess the performance of the proposed estimators, we conduct 100 simulations for each configuration and report the results using box plots that compare \{\widehat{\eta}_{1}({\bf x}),\widehat{\xi}_{1}({\bf x})\} and \{\widehat{\eta}({\bf x}),\widehat{\xi}({\bf x})\} across varying sample sizes. The left panel of Figure 2 illustrates the performance of \{\widehat{\eta}_{1}({\bf x}),\widehat{\xi}_{1}({\bf x})\} for n_{0}=1000 and 6000 , with n_{1} ranging from 1000 to 8000 . The right panel of Figure 2 shows the corresponding performance of \{\widehat{\eta}({\bf x}),\widehat{\xi}({\bf x})\} under the same settings. Performance is evaluated using two standard metrics: accuracy and F 1 score. In both cases, the proposed estimators consistently outperform the benchmark estimators. Moreover, as n_{0} increases, the variance of the estimators decreases, suggesting improved stability and reliability. In particular, for the F 1 score of \widehat{\eta}({\bf x}) , performance steadily improves as n_{0} increases, further demonstrating the robustness and effectiveness of the proposed method. Comparable patterns are also observed when n_{1} is fixed at 1000 and 6000 while n_{0} varies from 1000 to 8000 , as shown in Figure 3 . Figure 2: The left panel displays the performance of the F 1 score and accuracy for \eta_{1}({\bf x}) and \xi_{1}({\bf x}) across different scenarios, while the right panel presents the corresponding results for \eta({\bf x}) and \xi({\bf x}) . Figure 3: The left panel displays the performance of the F 1 score and accuracy for \eta_{1}({\bf x}) and \xi_{1}({\bf x}) across different scenarios, while the right panel presents the corresponding results for \eta({\bf x}) and \xi({\bf x}) . S.4 Additional Benchmark Data Results Figure 4: Performance comparison of our proposed estimator \eta_{0}({\bf x}) , and the benchmark method \xi_{0}({\bf x}) under the setting a=0.5 with either c=0.5 and varying b or b=0.5 and varying c . Figure 5: Performance comparison of our proposed estimators \eta_{1}({\bf x}) , \eta({\bf x}) , and the benchmark method \xi_{1}({\bf x}) , \xi({\bf x}) under the setting a=0.7 with either c=0.5 and varying b or b=0.5 and varying c . Figure 6: Performance comparison of our proposed estimator \eta_{0}({\bf x}) , and the benchmark method \xi_{0}({\bf x}) under the setting a=0.7 with either c=0.5 and varying b or b=0.5 and varying c . In addition to the estimators analyzed in the main text, we further evaluate the performance of the proposed estimator \widehat{\eta}_{0}({\bf x}) and its corresponding benchmark \widehat{\xi}_{0}({\bf x}) . Figure 4 presents the results with a=0.5 in the source domain and systematically vary the remaining subclass inclusion rates by setting either b=0.5 with c\in\{0.1,0.2,\ldots,0.9\} , or c=0.5 with b\in\{0.1,0.2,\ldots,0.9\} . Performance is assessed using the F 1 score and accuracy across 50 independent repetitions. The proposed estimator \widehat{\eta}_{0}({\bf x}) consistently demonstrates superior performance compared to the benchmark \widehat{\xi}_{0}({\bf x}) , achieving higher accuracy and F 1 scores across all configurations. Similar results are observed when a=0.7 in Figures 5 and 6 , further validating the robustness of our method. S.5 Discussions and Conclusions In this paper, we introduce a novel unsupervised domain adaptation setting where an entire label-background subpopulation is absent from the source domain, a scenario motivated by real-world data collection constraints. Despite this structured missingness, we show that accurate prediction in the target domain is still achievable. We develop a theoretical framework that enables such prediction by estimating subpopulation proportions in the target through distribution matching. We provide rigorous guarantees, including statistical consistency as well as upper bounds on the target-domain prediction error. Empirically, our method outperforms standard baselines that overlook structured missingness, especially in prediction performance for the unobserved subpopulation. Overall, our framework provides a rigorous characterization of model adaptation under subpopulation structured missingness, and enables robust domain adaptation in such a challenging scenario. Our theoretical framework is built upon structured conditional invariance and mixture proportion estimation. These tools naturally generalize to multi-class labels for n_{y} species and multi-level (or even continuous) environment variables for n_{a} species. In fact, the identification strategy and distribution-matching estimation carry over to larger joint label-environment spaces, though at the cost of heavier notation and more complex optimization. Technically, at this general multi-label and multi-background situation, the model identification considerations (see discussion in Section 3.3 ) becomes more complex. At this situation, one can identify both \hbox{pr}({\bf X},A=a|R=0) as well as \hbox{pr}(A=a|R=0) , which in total 2n_{a}-1 quantities, while one has in total n_{y}n_{a} unknown quantities, including \hbox{pr}(Y=y,A=a|R=0) and the unobservable subpopulation distribution \hbox{pr}({\bf X}|Y=1,A=1) . To make sure this model is identifiable, one needs to make (n_{y}-2)n_{a}+1 anchor set assumptions. For example, when n_{y}=3 and n_{a}=2 , 3 anchor set assumptions are needed. Interestingly, as long as the label is binary n_{y}=2 , one anchor set assumption is sufficient if only one subpopulation is missing in the source. In the setting we consider in the paper, n_{y}=n_{a}=2 , so we only need to make one anchor set assumption.