From Models to Systems: A Comprehensive Fairness Framework for Compositional Recommender Systems
Brian Hsu, Cyrus DiCiccio, Natesh S. Pillai, Hongseok Namkoong · 2024
Read From Models to Systems: A Comprehensive Fairness Framework for Compositional Recommender Systems by Brian Hsu, Cyrus DiCiccio, Natesh S. Pillai, Hongseok Namkoong (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-04655.txt.
Introduction
Brian Hsu and co-authors frame fairness for whole recommender systems in a 2024 paper. Real recommenders chain many models, from search to scoring to serving, yet fairness checks tend to grade each model alone. Rules like the EU AI Act push for a system level view of harm and gain.
Their frame scores fairness by the end value each user group gets from the full chain. Math results show why model level checks can miss system level gaps. They adapt black box tuning tools to lift total value and equity at once. Tests on fake and real data show the joint path beats model by model fixes.
Catalog record
| CREATOR | Brian Hsu, Cyrus DiCiccio, Natesh S. Pillai, Hongseok Namkoong |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 64 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2412-04655
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
From Models to Systems: A Comprehensive Fairness Framework for Compositional Recommender Systems Brian Hsu, Cyrus DiCiccio, Natesh S. Pillai, Hongseok Namkoong Abstract Fairness research in machine learning often centers on ensuring equitable performance of individual models. However, real-world recommendation systems are built on multiple models and even multiple stages, from candidate retrieval to scoring and serving, which raises challenges for responsible development and deployment. This system-level view, as highlighted by regulations like the EU AI Act, necessitates moving beyond auditing individual models as independent entities. We propose a holistic framework for modeling system-level fairness, focusing on the end-utility delivered to diverse user groups, and consider interactions between components such as retrieval and scoring models. We provide formal insights on the limitations of focusing solely on model-level fairness and highlight the need for alternative tools that account for heterogeneity in user preferences. To mitigate system-level disparities, we adapt closed-box optimization tools (e.g., BayesOpt) to jointly optimize utility and equity. We empirically demonstrate the effectiveness of our proposed framework on synthetic and real datasets, underscoring the need for a system-level framework. 1 Introduction The prevailing focus in algorithmic fairness is on bias measurement and mitigation for individual prediction models as the unit of analysis [ 5 , 34 , 13 , 52 ] . However, industrial applications of ML rarely train and serve a single model in isolation: individual models are components of a broader system. The recent EU AI act defining its scope of a system as " a machine-based system designed to operate with varying levels of autonomy and that may exhibit adaptiveness after deployment and that, for explicit or implicit objectives, infers, from the input it receives, how to generate outputs such as predictions, content, recommendations, or decisions that can influence physical or virtual environments ." This system-level perspective raises several questions for responsible development and deployment of recommendation systems. Are fairness notions for individual models sufficient to provide system-level equity? We study system-level fairness in industrial recommendation systems, which are composed of multiple layers of ML models. In Figure 1 , we illustrate a schema utilized by many of the largest tech companies in the world. Using a job recommendation system as a running example, the ultimate goal is hiring, as measured by the ‘confirmed hire rate’ (see the left side of Figure 2 ). However, this system-level objective is notably misaligned with the short-term predictions of individual models (e.g., clicks, views, applies). In turn, the fairness properties of those individual models may also be inadequate in addressing fairness at the system level. This discrepancy is exacerbated in practice since the aforementioned system design allows going beyond individual model predictions to integrate additional business logic such as priors on user preferences, known importance of different characteristics, prioritizing freshness of items. We propose a system-level fairness framework for industrial recommendation engines that analyzes the entire pipeline, from retrieval to serving, rather than focusing on individual model fairness. This unified approach enables tracking bias propagation across components and its impact on utility disparities between user groups, particularly under preference heterogeneity ("distribution shifts"). We focus on the ultimate intent of the system, and using job recommendations as context, we develop a framework for measuring fairness through hiring outcome disparities. Figure 1 : AI Recommendation System Serving Pipeline. Recommendations for feeds, ads, and social networking are generated from a multi-step process involving multiple ML models. An upstream process first fetches potentially relevant items via a candidate retrieval model, often called a “first pass ranker” (FPR), reducing the item set from millions to hundreds/thousands using scalable methods like approximate nearest neighbors [ 32 ] . Then, each model f_{k} scores the items independently on based on probability of \{ View, Click, Apply \} —this stage of ML models (red) are the overwhelming focus of fairness literature and audits. Finally, to surface the most relevant items, a "second pass ranker" (SPR) combines these individual models through a weighted sum \sum_{k}\alpha_{k}f_{k} . While the SPR is simple, its intuitiveness has led to its ubiquity, with the world’s largest platforms such as Meta [ 50 ] , LinkedIn [ 36 ] , Microsoft [ 2 ] , X/Twitter [ 48 ] , Snapchat [ 46 ] , Pinterest [ 39 ] , and Spotify [ 27 ] stating or suggesting that they use a variant of this overarching system. Multi-objective black-box optimization for system-level fairness In most settings, the performance of individual ML models can be optimized "off-line" based on previously collected user data using standard tools like cross-validation. On the other hand, the FPR and SPR stages (Figure 1 ) require "online" experimentation (A/B testing) to collect user feedback on the quality of weights/parameters \alpha . In the latter, weights are typically tuned through manual trial & error or black-box optimization methods such as Bayesian Optimization (BO) [ 19 ] . BO allows optimizing over noisy user feedback without derivative information, and is commonly used in online platforms (e.g., Meta [ 28 ] and LinkedIn [ 1 ] ). We go beyond identifying the source of disparities in utility, and formulate the overall system design as a multi-objective optimization problem balancing social welfare and fairness. Since it is difficult to model system-level objectives using a particular functional form, we treat them as a black-box and model it using a flexible Gaussian process. We use a simple but effective variant of a Bayesian Optimization (BO) algorithm to simultaneously maximize social welfare minus the disparity between the utility across groups. While the algorithms we leverage are well known, our formulation demonstrates how familiar tools from black-box optimization can be utilized in a practical and meaningful way to improve system-level fairness. To further contextualize this in our job-recommendation setting, suppose that job preferences differ across demographic groups for jobs where one group prefers seeing attractive sounding jobs (click-worthy jobs), while another group prefers jobs of better background fit (apply-worthy jobs). When we have one model for clicks and one for applies and serve recommendations as a weighted linear combination of these model outputs, the "population weights" are unknown and are typically chosen "globally" in the sense that all users receive the same weights. Yet, the ideal weights from a user experience perspective largely depend on individual preference, which traditional fairness metrics fail to capture. While weights can be personalized to certain demographic groups, this introduces disparate treatment concerns [ 30 , 43 ] and thus it is common practice to select a single global weight \alpha . As we demonstrate on the right side of Figure 2 , these global design choices have a tendency to tailor to the preferences of majority groups when using off-the-shelf tools. In Section 4 , we formulate a black-box optimization problem over global weights that avoids starkly benefiting one group over others. While our specific fair BO methodology is straightforward, it underscores the critical role that adaptive experimentation methodologies like BO can play in achieving system-level fairness for industrial applications. Figure 2 : (Left) Proxy and metric tracking (Right) Issues of vanilla BayesOpt Related work on viewer-side fairness in compositional systems In this work, we focus on viewer-side fairness , which studies the disparity in utility a recommender system provides to