Avoiding Structural Failure Modes in Tabular Fair SSL: Online Primal-Dual Allocation under Confidence Gating

Hangchuan Liang 1 and Changchun Li 1,2 · 2026

Read Avoiding Structural Failure Modes in Tabular Fair SSL: Online Primal-Dual Allocation under Confidence Gating by Hangchuan Liang 1 and Changchun Li 1,2 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-16446.txt.

Introduction

Liang and Li spot a conflict in tabular fair semi-supervised learning: under confidence-gated pseudo-labels, fairness rules trigger Masking Collapse and Trivial Saturation. They propose Online Primal-Dual Allocation, an online system setting fairness and stability costs using breach, risk, and pseudo-label health signals. On Adult, ACSIncome, and COMPAS, OPDA eases degenerate regimes seen under static weighting and single-signal rivals. On Adult and COMPAS it yields working points matching the static frontier; on ACSIncome it preserves utility.

Catalog record

CREATORHangchuan Liang 1 and Changchun Li 1,2
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE35484
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.16446

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Avoiding Structural Failure Modes in Tabular Fair SSL: Online Primal-Dual Allocation under Confidence Gating Hangchuan Liang 1 and Changchun Li 1,2 Abstract Semi-supervised learning (SSL) enables prediction with limited labels, but high-stakes tabular applications (medical, credit, recidivism) require statistical fairness guarantees. We identify a structural conflict in tabular fair SSL through a diagnostic stress test: under confidence-gated pseudo-labeling, moment-matching fairness regularizers can trigger two failure modes—Masking Collapse (fairness erodes confidence, starving pseudo-labels) and Trivial Saturation (drift to constant predictors). We propose Online Primal-Dual Allocation (OPDA), an online controller that schedules fairness and entropy-based stability penalties using violation, risk, and pseudo-label health signals, avoiding per-dataset selection of a fixed fairness weight within this diagnostic regime. On the evaluated tabular benchmarks (Adult, ACSIncome, COMPAS), OPDA mitigates the degenerate regimes observed under static weighting and simple single-signal adaptive baselines. On Adult and COMPAS, it yields non-degenerate operating points competitive with the empirical static- λ \lambda frontier; on ACSIncome, it preserves utility with a wider fairness-utility spread. Relative to OPDA-lite, the full controller mainly shifts the operating point toward higher utility on ACSIncome, while Adult highlights the fairness–utility trade-off between the two variants. These results position OPDA as a calibration-free controller for non-degenerate operating points in tabular fair SSL without per-dataset tuning. 1 Introduction Consider high-stakes tabular applications such as medical decision support, credit scoring, and recidivism prediction, where labeled data is scarce due to expensive expert annotations, yet regulatory compliance mandates statistical fairness guarantees across demographic groups. Semi-supervised learning (SSL) enables prediction with limited labels, but modern pseudo-label SSL relies on confidence gating : pseudo-labels are retained only when predictions exceed threshold \tau [ 22 ] . However, fairness regularizers enforce moment matching across groups, systematically suppressing confidence and disabling the pseudo-labeling mechanism. Scope. This work focuses on tabular multi-output fair SSL, motivated by three factors: (1) Prevalence in high-stakes applications : tabular data dominates medical decision support, credit scoring, and recidivism prediction, where both label scarcity and fairness constraints are critical [ 16 , 9 , 1 ] ; (2) Isolation of failure mechanisms : the multi-label structure ( L{>}1 ) allows us to isolate and verify the predicted failure modes without confounding factors from high-dimensional representations; (3) Computational efficiency : tabular benchmarks enable extensive ablations and sensitivity analyses that would be prohibitively expensive on image data. Accordingly, our empirical evaluation uses a diagnostic stress-test setting to isolate and verify the failure modes, but the identified mechanisms (Masking Collapse, Trivial Saturation) are fundamental to confidence-gated fair SSL, and OPDA’s multi-signal design is applicable to standard single-label settings. We identify two structural failure modes . Type I (Masking Collapse): fairness pressure concentrates predictions near decision boundaries, pseudo-label coverage q_{t} collapses, yielding gradient starvation. Type II (Trivial Saturation): training drifts toward constant predictors with near-zero fairness violation but severely degraded utility. Both failures arise from non-stationary coupling between pseudo-label selection and constraint evaluation, rendering static weighting brittle. Figure 1 illustrates these causal pathways. Figure 1: Causal mechanisms of structural failures in fair SSL. High fairness pressure diverges into two pathways: Type I (Masking Collapse) erodes confidence and starves gradients; Type II (Trivial Saturation) collapses predictions to constants with degraded utility. We formalize these pathologies from three perspectives. First, under confidence-gated SSL, sufficiently strong moment-matching penalties admit constant solutions with vanishing gradients (Proposition 1; Appendix A). Second, for SimFair [ 18 ] , fairness enforcement is strictly sign-conflicting with entropy-based confidence sharpening in logit space (Proposition 2; Appendix B). Third, we provide convex-surrogate analysis of OPDA’s outer-loop dynamics with sublinear-regret guarantees (Appendix G). This distinguishes our approach from multi-objective methods (PCGrad [ 24 ] , MGDA [ 21 ] ) that assume stationary objectives. Fair SSL under confidence gating exhibits endogenous non-stationarity: constraint functions V_{t}(\theta) and H_{t}(\theta) depend on evolving pseudo-label mask M_{t}(\theta) . OPDA tracks a moving equilibrium by adapting dual weights epoch-by-epoch using online observables. We propose Online Primal-Dual Allocation (OPDA) to resolve this structural deadlock. OPDA uses bilevel budget–allocation parameterization: \lambda_{v}^{(t)}=B_{t}\pi_{t} and \lambda_{h}^{(t)}=B_{t}(1-\pi_{t}) . We update (B_{t},\pi_{t}) using online observables including fairness violation ( v_{t} ), risk proxy ( r_{t} ), pseudo-label health signals ( q_{t},p_{t},\mathrm{ESS}_{t} ), and gradient alignment. Budget dynamics implement noise-robust knee-seeking; allocation dynamics are conflict-aware and anti-starvation-guaranteed. OPDA runs with the same default configuration across all datasets (supplementary Appendix D). Contributions. • Mechanism diagnosis. We identify two failure modes in confidence-gated tabular fair SSL and formalize sufficient local mechanisms: vanishing-gradient neighborhoods (Proposition 1; Appendix A) and exact logit-space sign conflict (Proposition 2; Appendix B). • Pseudo-label-health-aware controller. We propose OPDA, an epoch-level budget-allocation controller that schedules fairness and stability pressure using online observables, with a single default configuration across the evaluated tabular settings. • Empirical evidence in tabular stress tests. Across Adult, ACSIncome, and COMPAS, OPDA mitigates degenerate regimes observed under static weighting and naive single-signal controllers, while producing competitive operating points in a diagnostic stress-test setting. Code availability. Code is available at https://anonymous.4open.science/r/OPDA-BB0C . 2 Related Work Semi-Supervised Learning. Modern SSL uses consistency regularization with confidence-gated pseudo-labeling [ 22 , 26 , 7 ] . The unsupervised loss is masked when predictions fall below threshold \tau , introducing switch-like dependency. In multi-label settings, gating is applied element-wise [ 23 , 5 ] . Most SSL methods assume external regularizers do not systematically disable the unlabeled objective. Our analysis reveals moment-matching pressure can suppress confidence and deactivate pseudo-label masks. Statistical Fairness via Moment Matching. Group fairness notions (DP, EOp) [ 25 , 12 ] control disparities across sensitive groups. Differentiable surrogates use moment matching or distributional discrepancy [ 11 , 15 ] . We adopt SimFair [ 18 ] as representative instantiation. Crucially, constraint evaluation and pseudo-label selection share evolving predictions, making constraint functions endogenously non-stationary . OPDA schedules dual pressure using online observables rather than assuming fixed constraint landscape. Fairness in Semi-Supervised Learning. Prior fair SSL work uses primal–dual updates [ 6 ] , group-aware re-weighting [ 14 , 20 ] , or representation-level fairness [ 19 , 3 ] . These approaches focus on reducing bias given pseudo-labels. We address an orthogonal concern: strong moment-matching pressure can destabilize pseudo-labeling itself, yielding Masking Collapse or Trivial Saturation. Dynamic Weighting and Feedback Control. Multi-objective methods (GradNorm [ 8 ] , PCGrad [ 24 ] , MGDA [ 21 ] ) adjust weights based on gradient statistics. However, they operate on gradients alone and do not monitor mechanism health. In fair SSL, pseudo-label availability can degrade catastrophically when fairness pressure suppresses confidence. OPDA operates at epoch granularity and explicitly tracks pseudo-label health signals ( q_{t},p_{t},\mathrm{ESS}_{t} ) to detect SSL mechanism failure before gradient pathology. We frame OPDA as feedback control [ 27 , 4 ] that tracks a moving equilibrium (Proposition 3; Appendix C of the supplementary material). OPDA separates total dual budget from allocation, updating both using online observables. This provides a bridge to online-optimization interpretation with regret guarantees (Appendix G). 3 The OPDA Framework To resolve the structural deadlock between moment-matching fairness and confidence-gated pseudo-labeling, we propose Online Primal-Dual Allocation (OPDA) . OPDA treats each epoch as an online round and adaptively schedules two dual weights: fairness penalty and entropy-based stability penalty, using online observables ( v_{t},r_{t},q_{t},p_{t},\mathrm{ESS}_{t} , gradient alignment). Why entropy-based stability? FixMatch-style confidence gating retains

Read the complete text