ODD: Overlap-aware Estimation of Model Performance under Distribution Shift

Aayush Mishra, Anqi Liu · 2025

Read ODD: Overlap-aware Estimation of Model Performance under Distribution Shift by Aayush Mishra, Anqi Liu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-14978.txt.

Introduction

Aayush Mishra and Anqi Liu improve how to guess a model's error rate on data from a new domain, in this 2025 paper. Safe systems need that guess before deployment, when no labels exist. A leading method pits classifiers against each other to bound the error. The authors spot a flaw: the fight wastes itself in the region where old and new data overlap, where disagreement should stay low.

Their fix, called ODD, only counts disagreement outside the overlap. Domain classifiers estimate how much the two data worlds share. The new bound then tracks true performance better than the older one while staying a valid bound. Tests across many benchmarks show smaller estimation error. Code and results are posted openly for reuse.

Catalog record

CREATORAayush Mishra, Anqi Liu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE62 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-14978

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

ODD: Overlap-aware Estimation of Model Performance under Distribution Shift Aayush Mishra, Anqi Liu Abstract Reliable and accurate estimation of the error of an ML model in unseen test domains is an important problem for safe intelligent systems. Prior work uses disagreement discrepancy ( Dis 2 ) to derive practical error bounds under distribution shifts. It optimizes for a maximally disagreeing classifier on the target domain to bound the error of a given source classifier. Although this approach offers a reliable and competitively accurate estimate of the target error, we identify a problem in this approach which causes the disagreement discrepancy objective to compete in the overlapping region between source and target domains. With an intuitive assumption that the target disagreement should be no more than the source disagreement in the overlapping region due to high enough support, we devise Overlap-aware Disagreement Discrepancy ( ODD ). Our ODD -based bound uses domain-classifiers to estimate domain-overlap and better predicts target performance than Dis 2 . We conduct experiments on a wide array of benchmarks to show that our method improves the overall performance-estimation error while remaining valid and reliable. Our code and results are available on GitHub . Figure 1 : Given a source domain {\mathcal{S}} , and a classifier \hat{h} trained in this domain, we aim to predict the performance of \hat{h} in a target domain {\mathcal{T}} without labels . Rosenfeld and Garg 2023 learn a worst-case critic \bar{h} , which maximally disagrees with \hat{h} in {\mathcal{T}} while agreeing with \hat{h} in {\mathcal{S}} ( Dis 2 ), to bound this performance. But this optimization leads to a competition in the overlapping region. ODD discounts disagreement in the overlapping region making \bar{h} agree with \hat{h} in this region. We show that ODD tightens the gap between true and predicted performance compared to Dis 2 , while remaining reliable. 1 Introduction The ability of machine learning models to know when they do not know, is an important characteristic to make them safe for deployment, especially in high-stakes applications like the medical domain. Modern neural networks have an incredible capacity to learn complex functions but they are prone to catastrophic errors on inputs outside of their training distributions. Hence, it is crucial to be able to predict the performance of these models on distributionally shifted test domains. Many works have attempted to address this problem of test performance prediction [ Ben-David et al. 2006 , Ben-David et al. 2010a , Mansour et al. 2009 , Ben-David et al. 2010b ] . These methods provide uniform convergence bounds which are often vacuous in practice because we are interested in bounding the error of a single hypothesis. Other recent works attempt to use unlabeled test samples to make point-wise (per hypothesis) prediction of performance bounds in neural networks [ Lu et al. 2023 , Baek et al. 2022 , Garg et al. 2022 , Guillory et al. 2021 ] . Although these methods achieve low performance prediction error on average, they lack reliability and often overestimate the performance, especially under large distribution shift (when reliability is most important). To address these challenges, Rosenfeld and Garg 2023 proposed Disagreement Discrepancy ( Dis 2 ), which provides almost provable performance bounds using unlabeled test samples. It trains a critic that minimizes its disagreement with a given classifier on the source distribution while maximizing its disagreement on the target domain under a sufficiently expressive hypothesis class. This allows Dis 2 to assume a worst-case shift in the target domain while remaining faithful to the trained classifier in the source domain. This approach gives non-vacuous bounds that almost always remain valid. In this work, we find that Dis 2 can be further improved using domain-overlap awareness. The agreement with source and disagreement with target creates a tension in the region of domain overlap, resulting in unstable optimization, which leads to more pessimistic critics than necessary. We are motivated by the intuition that if a classifier was trained on labeled samples from the target domain, its support in the overlapping region would be similar to what the source trained classifier had. Hence, we propose to discount the disagreement of the critic with target overlapping samples through a new training objective. Leveraging domain classifiers for estimate domain-overlap, our Overlap-aware Disagreement Discrepancy ( ODD ) removes the instability of optimization in the overlapping region and results in practically tighter performance bounds than Dis 2 . We visually illustrate our method in Figure 1 . In summary: • We derive a general version of the Dis 2 bound using the notion of ideal joint hypothesis, and show that theoretical performance bounds obtained using ODD are as tight as those obtained using Dis 2 . • We design an ODD -based disagreement loss to find more optimistic critics for practically estimating the performance bounds. • On several real datasets and training method combinations, ODD -based bounds are tighter than Dis 2 -based bounds, and still maintain reliable coverage. 2 The general Dis 2 bound Setup: We follow the notation setup used by Rosenfeld and Garg 2023 . Let {\mathcal{S}},{\mathcal{T}} denote the source and target distributions, respectively, over labeled inputs (x,y)\in{\mathcal{X}}\times{\mathcal{Y}} , and let \hat{{\mathcal{S}}} , \hat{\mathcal{T}} denote the empirically observed sets (with cardinality n_{S} and n_{T} ) of samples from these distributions. In the target domain {\mathcal{T}} , we observe only the covariates and not the labels. We let p_{{\mathcal{S}}} and p_{{\mathcal{T}}} denote the marginal distributions of covariates in the source and target domains. We consider classifiers h:{\mathcal{X}}\to\mathbb{R}^{|{\mathcal{Y}}|} which output a vector of logits ( h(x)_{y} denotes the logits of class y in this vector), and let \hat{h} denote the particular classifier (trained on \hat{{\mathcal{S}}} ) under study for which we want to bound the error in the target domain. We use {\mathcal{H}} to denote a hypothesis class of such classifiers. For a domain {\mathcal{D}} on {\mathcal{X}} , let \epsilon_{{\mathcal{D}}}(h,h^{\prime}):=\mathbb{E}_{x\sim p_{\mathcal{D}}}[\mathbf{1}\{\argmax_{y}h(x)_{y}\neq\argmax_{y}h^{\prime}(x)_{y}\}] denote the one-hot disagreement between any classifiers h and h^{\prime} on {\mathcal{D}} . The labeling function: Let y^{*}_{\mathcal{S}} and y^{*}_{\mathcal{T}} denote the true labeling functions in the source and target domains, respectively. Rosenfeld and Garg 2023 assume a fixed y^{*} to represent the true labeling function for all domains. In contrast, we use the notion of ideal joint hypothesis [ Ben-David et al. 2010a ] to analyze adaptability in the general case. Definition 2.1 . The ideal joint hypothesis is defined as: \displaystyle y^{*}:=\argmin_{h\in{\mathcal{H}}}\epsilon_{{\mathcal{S}}}(h,y^{*}_{\mathcal{S}})+\epsilon_{{\mathcal{T}}}(h,y^{*}_{\mathcal{T}}) (1) with the corresponding joint risk defined as \lambda:=\epsilon_{{\mathcal{S}}}(y^{*})+\epsilon_{{\mathcal{T}}}(y^{*}) . For brevity, we overload \epsilon_{{\mathcal{D}}}(h) to mean \epsilon_{{\mathcal{D}}}(h,y^{*}_{\mathcal{D}}) , i.e. the 0-1 error of classifier h on distribution {\mathcal{D}} . If \lambda is high, no h trained on the source domain can be expected to perform well on the target domain (low adaptability). Now, Rosenfeld and Garg 2023 define disagreement discrepancy ( Dis 2 ) as follows. Definition 2.2 . Dis 2 \Delta(h,h^{\prime}) is the disagreement between any h and h^{\prime} on {\mathcal{T}} minus their disagreement on {\mathcal{S}} : \displaystyle\Delta(h,h^{\prime}):=\epsilon_{{\mathcal{T}}}(h,h^{\prime})-\epsilon_{{\mathcal{S}}}(h,h^{\prime}). (2) This immediately implies the following lemma: Lemma 2.3 . For any classifier h , \epsilon_{{\mathcal{T}}}(h)\leq\epsilon_{{\mathcal{S}}}(h)+\Delta(h,y^{*})+\lambda . The proof can be found in Appendix A . This gives us a method to bound the target risk in terms of source risk and the discrepancy term \Delta . However, as y^{*}

Read the complete text