A Model Ensemble-Based Post-Processing Framework for Fairness-Aware Prediction

Zhouting Zhao, Tin Lok James Ng · 2026

Read A Model Ensemble-Based Post-Processing Framework for Fairness-Aware Prediction by Zhouting Zhao, Tin Lok James Ng (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-18838.txt.

Introduction

Zhao and Ng propose a post-processing framework that makes predictions fairer by ensemble blending. The method sits after training, so it needs no access to model internals. It works across tasks, model types, and fairness definitions. Tests span classification, regression, and survival analysis. Fairness improves while accuracy holds steady or dips only slightly in their runs. The ensemble view lets users trade a small amount of raw score for large fairness gains. The authors present it as a general tool for fairness-aware prediction tasks.

Catalog record

CREATORZhouting Zhao, Tin Lok James Ng
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE62725
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.18838

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

A Model Ensemble-Based Post-Processing Framework for Fairness-Aware Prediction Zhouting Zhao, Tin Lok James Ng Abstract Striking an optimal balance between predictive performance and fairness continues to be a fundamental challenge in machine learning. In this work, we propose a post-processing framework that facilitates fairness-aware prediction by leveraging model ensembling. Designed to operate independently of any specific model internals, our approach is widely applicable across various learning tasks, model architectures, and fairness definitions. Through extensive experiments spanning classification, regression, and survival analysis, we demonstrate that the framework effectively enhances fairness while maintaining, or only minimally affecting, predictive accuracy. keywords Fairness-aware prediction, Post-processing framework, Model ensembling 1 Introduction As machine learning systems increasingly influence decisions in critical domains, ensuring their fairness has become a vital concern 5 . Algorithmic models trained on historical or biased data risk perpetuating or amplifying existing inequalities, raising ethical, social, and legal challenges. Fairness considerations are particularly important across various application domains. For example, classification models are widely used in loan approvals, hiring decisions, and criminal justice risk assessments. Regression models inform salary predictions and insurance pricing. Clustering techniques play a key role in customer segmentation and healthcare group analysis, while survival analysis is crucial for estimating patient survival times or employee turnover. In simple terms, fairness in machine learning refers to the idea that a model’s predictions should not systematically favor or disadvantage certain individuals or groups defined by sensitive attributes such as gender, race, or age. Fairness can be measured using various quantitative criteria that assess disparities in model outcomes between these groups (e.g., differences in predicted probabilities, false positive rates, or expected values). The specific notion of fairness considered often depends on the task and the ethical or policy context of the application. Various fairness metrics and strategies to mitigate unfairness have been proposed across multiple tasks, including classification 56 ; 17 ; 32 , regression 20 ; 8 ; 2 , clustering 13 ; 36 ; 38 , and survival analysis 50 ; 35 ; 46 ; 58 . Strategies for mitigating unfairness can be broadly categorized into three main approaches: pre-processing, in-processing, and post-processing 43 ; 40 ; 11 , each with its own advantages and limitations. Pre-processing methods modify the input data to reduce bias before model training; in-processing approaches intervene during model training by incorporating fairness constraints or regularization terms; and post-processing methods adjust the model outputs to improve fairness after training. The key advantage of pre-processing methods, such as reweighing 30 and disparate impact remover 19 , lies in their model-agnostic nature, as they function independently of the training process and can be easily applied to various algorithms. However, modifying the dataset to remove biases can lead to a loss of valuable information, potentially reducing model performance. Additionally, such modifications may introduce unintended biases or distort the original data distribution, which can negatively impact downstream tasks. In-processing techniques embed fairness objectives directly into model optimization by incorporating additional fairness constraints or regularization terms 57 ; 32 ; 22 . While these methods can effectively balance fairness and predictive performance, they often lead to increased computational complexity. Unlike pre-processing methods, in-processing approaches are typically model-specific, meaning a fairness intervention designed for one model architecture may not easily transfer to another, limiting flexibility. Post-processing methods for fairness are techniques applied after a machine learning model has been trained and its predictions generated 45 . These methods adjust the outputs to meet specific fairness criteria without modifying the model or the training data. This makes them model-agnostic and relatively easy to apply. However, many post-processing approaches are tailored to specific tasks (e.g., binary classification) or fairness notions (e.g., demographic parity), limiting their applicability to broader problem settings such as regression or survival analysis. To overcome these limitations, Tifrea et al. 51 proposed FRAPPÉ (Fairness Framework for Post-Processing Everything), a general post-processing framework that transforms fairness-aware in-processing methods into post-processing ones. By introducing an additive correction term based on all features—rather than relying on group-specific transformations—FRAPPÉ supports broader fairness constraints and is applicable to both classification and regression. Another benefit of FRAPPÉ is that it does not rely on sensitive attributes during inference. Although FRAPPÉ provides significant advantages over other post-processing fairness methods, it is reasonable to question whether applying an additive linear correction to a trained model is truly the most effective approach. This raises the possibility that more suitable alternatives may exist. Indeed, FRAPPÉ operates under the assumption that fairness can be improved by applying a linear perturbation to the outputs of a trained model. In this work, we propose such an alternative based on model ensembling: specifically, we consider taking a weighted average of a pre-trained complex model and a simpler model. This approach blends the predictions from both models, promoting fairness by tuning the ensemble weights and the parameters of the simpler model, while keeping the original trained model unchanged. Moreover, while FRAPPÉ is suitable for binary classification and regression tasks, extending it to the increasingly important domain of survival analysis (also known as time-to-event prediction) is non-trivial. Survival analysis has become a critical area in machine learning, especially in fields like healthcare, finance, and engineering, where predicting when an event will occur is as important as predicting if it will occur. Unlike standard classification or regression tasks, survival models produce time-dependent outputs, such as survival curves or hazard functions, which makes it challenging to apply simple additive post-processing adjustments effectively. More specifically, fairness in survival analysis often involves maintaining parity across demographic groups over time or balancing expected survival probabilities, goals that are not easily addressed through FRAPPÉ’s current additive framework. In contrast, we demonstrate that our proposed ensemble-based approach naturally extends to survival analysis, offering a more flexible and principled solution for fairness in this critical setting. Our proposed ensemble approach is inspired by the principles of mixture modeling and the mixture-of-experts paradigm 28 . In mixture modeling, the mixture weights are fixed across all input features, whereas in the mixture-of-experts framework, these weights vary based on the input features. In our framework, the pre-trained model remains fixed, and the learning process focuses solely on estimating the mixture weights and the parameters of a simpler auxiliary model. This design offers practical advantages, as both the mixture weights and the simpler model typically involve more tractable functional forms, making the optimization process more efficient and less computationally demanding. This framework enables flexible model combination while preserving interpretability and modularity. Like FRAPPÉ, our method is model-agnostic, supports a wide range of fairness definitions, and does not require access to sensitive attributes at inference time. Furthermore, our experimental results demonstrate that it effectively navigates the trade-off between fairness and predictive performance. In contrast to FRAPPÉ, however, our approach extends naturally to survival analysis tasks, broadening its applicability to a wider array of time-dependent prediction settings. In certain scenarios, two separate pre-trained models may be available: one optimized for predictive performance and another designed to promote fairness. The fairness-oriented model might be trained on pre-processed inputs to mitigate bias or built using a simpler model with a reduced, carefully chosen feature set. Our proposed ensemble method can be readily adapted to this setting, where both models are pre-trained. The objective is

Read the complete text