Density-Ratio Losses for Post-Hoc Learning to Defer

Alexander Soen, Ragnar Thobaben, Joakim Jaldén, Richard Nock · 2026

Read Density-Ratio Losses for Post-Hoc Learning to Defer by Alexander Soen, Ragnar Thobaben, Joakim Jaldén, Richard Nock (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-19557.txt.

Introduction

Soen and team recast post-hoc learning to defer through ideal distributions, reweightings under which a model attains low loss. They define deferral by the density ratio between a model's ideal and an expert's ideal, then derive density-ratio losses for scorers via class-probability estimation. Deferral decisions come from thresholding the scorer, so rates adjust without retraining. For KL-based ideals the rules recover Chow's rule and link to a Bayes posterior. Tests show competitive results with greater robustness across dataset settings.

Catalog record

CREATORAlexander Soen, Ragnar Thobaben, Joakim Jaldén, Richard Nock
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE106868
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.19557

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Density-Ratio Losses for Post-Hoc Learning to Defer Alexander Soen, Ragnar Thobaben, Joakim Jaldén, Richard Nock Abstract We study post-hoc Learning to Defer (L2D) through the lens of ideal distributions: divergence-regularized reweightings of the data distribution under which a model attains low loss. We define deferral via the density-ratio between a model’s and an expert’s ideals. Using the reduction from density-ratio estimation to class-probability estimation, we derive the DR CPE losses for post-hoc L2D scorers. Deferral decisions are then made by thresholding the scorer, allowing deferral rates to be adjusted without retraining. For KL-based ideal distributions, our deferral rules recovers Chow’s rule under the original distribution and a connection to an expert-tilted Bayes posterior—which incorporates the expert’s performance—depending on if the ideal distributions are joint or marginal distributions. Experimentally, our approach is competitive compared to common baselines and more robust across dataset settings. More broadly, our results cast post-hoc L2D as density-ratio learning between ideal distributions, bridging Chow-style rules, expert comparison, and elucidating connections to related learning settings including anomaly detection. 1 Introduction Machine learning (ML) models are now embedded in many tasks we encounter every day. As these systems are deployed in increasingly high-stakes domains, including healthcare ( Esteva et al. 2017 ; Kadampur and Al Riyaee 2020 ; Zoabi et al. 2021 ; Ma et al. 2024 ; Singhal et al. 2025 ) and finance ( Burrell 2016 ; Yousefi et al. 2019 ; Li et al. 2023 ) , it is crucial that they make predictions only when their outputs are reliable. In such high-stakes decision-making systems, ideally, a synthesis of both ML prediction and human expertise can be used ( Topol 2019 ) : ML models can defer to experts whenever their own predictions are deemed unreliable, and the burden on human experts can be reduced by leveraging ML models. Dual to the problem of predicting responsibly, the rise of huge ML models and edge deployment has created strong demand for systems that improve efficiency by routing only difficult inputs to a larger model while handling easier cases with a smaller model ( Viola and Jones 2001 ; Mamou et al. 2022 ; Varshney and Baral 2022 ; Khalili et al. 2022 ; Dohan et al. 2022 ; Gupta et al. 2024 ; Narasimhan et al. 2025 ) . Learning to defer (L2D) proposes a solution to these problems by modifying the standard supervised learning setting to allow (smaller) models to defer their predictions to an upstream (potentially human) expert ( Madras et al. 2018 ) . To allow models to abstain from predictions, learning to reject (L2R) was initially proposed ( Chow 1957 ; Chow 1970 ; Cortes et al. 2016 ) , where rejection is learned without access to the downstream expert used at inference. A useful categorization of these approaches are by how abstention is represented. In score-based approaches, abstention is derived from the predictor’s own scores, encompassing classical reject-option rules, convex-surrogate formulations, and confidence-threshold methods ( Chow 1957 ; Chow 1970 ; Herbei and Wegkamp 2006 ; Bartlett and Wegkamp 2008 ; Yuan and Wegkamp 2010 ; Cao et al. 2022 ; El-Yaniv et al. 2010 ; Geifman and El-Yaniv 2017 ; Geifman and El-Yaniv 2019 ; Ni et al. 2019 ) . In predictor-rejector approaches, a separate rejector is learned ( Cortes et al. 2016 ; Mao et al. 2024a ) . Finally, reduction-based approaches cast rejection as a related supervised learning problem ( Charoenphakdee et al. 2021 ; Ramaswamy et al. 2018 ) . L2D extends this picture by incorporating an expert into training ( Madras et al. 2018 ) . Here too, one can distinguish score-based formulations, where deferral is encoded through shared scores or defer classes ( Mozannar and Sontag 2020 ; Verma and Nalisnick 2022 ; Mao et al. 2024b ) , from predictor-rejector formulations with a separate deferral function ( Okati et al. 2021 ; Mozannar et al. 2023 ; Mao et al. 2023 ) . A second, orthogonal distinction is between end-to-end methods and post-hoc (two-stage) methods. The post-hoc regime is especially important since retraining modern pretrained models can be prohibitively expensive. We focus on post-hoc L2D ( Kag et al. 2022 ; Jitkrittum et al. 2023 ) (also called two-stage L2D ( Mao et al. 2023 ) ), where the base model is fixed, and only the deferral rule is learned. In this setting, simple score-based heuristics can fail when downstream experts are specialized or under distribution shift ( Jitkrittum et al. 2023 ) , while many existing methods still amount to estimating pointwise expert-comparison targets, which aim to predict when the expert will outperform the model ( Kag et al. 2022 ; Jitkrittum et al. 2023 ) . A desirable property in this regime is for deferral models to be adaptable to different rates of deferral without full retraining. Recently, a distributional perspective on post-hoc L2R was proposed ( Soen et al. 2024 ; Soen 2026 ) . Its central object is an ideal distribution : a divergence-regularized reweighting of the data distribution under which a fixed predictor attains low loss. Rejection is then defined by thresholding a density-ratio, using either a marginal construction over \mathcal{X} ( Soen et al. 2024 ) or a joint construction over \mathcal{X}\times\mathcal{Y} that is later marginalized to \mathcal{X} ( Soen 2026 ) . Extending this framework to post-hoc L2D is nontrivial: the resulting rules are essentially plug-in and depend on the Bayes class-posterior, while a direct translation would additionally require pointwise access to the expert at test time. In this paper, we make the following contributions ( Fig. 1 summarizes our overall approach): • L2D via ideal distributions : We introduce a distributional formulation of post-hoc L2D based on ideal distributions. Unlike L2R, we consider a pair of ideal distributions, one for the model h and one for the expert h^{(\textup{\rm{e}})} . Deferral is then defined by thresholding the density-ratio between these ideal distributions—naturally separating a scorer from a deferral threshold; which allows the deferral rate to be changed without retraining (see Definitions 3.1 and 3.2 ). • Marginal versus joint ideals : Our framework accommodates both marginal and joint ideal distributions. For KL-ideal distributions, we show that the marginal rule recovers Chow’s rule w.r.t. the data distribution, whereas the joint rule corresponds to a Chow-style decision under an expert-tilted distribution. This tilt is practically meaningful as it augments the expert model’s performance into the optimal deferral. We further relate the induced learning objectives (see Theorems 3.5 and 4.4 ). • The DR CPE losses : Using the reduction from Density-Ratio Estimation (DRE) to Class-Probability Estimation (CPE), we derive a family of DR CPE post-hoc deferral losses. This further connects our method to expert-comparison deferral estimation ( Kag et al. 2022 ; Jitkrittum et al. 2023 ) and anomaly detection ( Steinwart et al. 2005 ) (see Definition 4.2 ). • Empirical performance : Our DR CPE approach performs competitively against other L2D baselines and is also more robust against different dataset corruption combinations than these baselines. L2D Objective Equation 1 Post-hoc Deferral \mathcal{L}(h,r) , fixed h Ideal Distributions Definition 3.1 Model & Expert Ideals \textup{{Q}}_{\textup{\rm m}},\;\textup{{Q}}^{(\textup{\rm{e}})}_{\textup{\rm m}}\;/\;\textup{{Q}}_{\textup{\rm j}},\;\textup{{Q}}^{(\textup{\rm{e}})}_{\textup{\rm j}} Comparing Ideals Definition 3.2 Density-Ratio Deferral \llbracket(\textup{{d}}\textup{{Q}}/\textup{{d}}\textup{{Q}}^{(\textup{\rm{e}})})(x)\leq\tau\rrbracket The

Read the complete text