Improving Minimax Group Fairness in Sequential Recommendation
Krishna Acharya, David Wardrope, Timos Korres, Aleksandr Petrov, Anders Uhrenholt · 2025
Read Improving Minimax Group Fairness in Sequential Recommendation by Krishna Acharya, David Wardrope, Timos Korres, Aleksandr Petrov, Anders Uhrenholt (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-18117.txt.
Introduction
Krishna Acharya and co-authors work on fairness in systems that suggest the next item a user may like, based on what they chose before. A system trained to do well on average can serve keen fans of the main stream far better than fans of niche fare.
The team try three training methods that guard against the worst outcomes for any group. Two need group labels and cope poorly when users sit in more than one group. The third needs no labels and handles such overlap well. In tests on two real data sets, all three beat plain training, and the third came out best.
Catalog record
| CREATOR | Krishna Acharya, David Wardrope, Timos Korres, Aleksandr Petrov, Anders Uhrenholt |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 32 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-18117
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Improving Minimax Group Fairness in Sequential Recommendation Krishna Acharya, David Wardrope, Timos Korres, Aleksandr Petrov, Anders Uhrenholt Abstract Training sequential recommenders such as SASRec with uniform sample weights achieves good overall performance but can fall short on specific user groups. One such example is popularity bias, where mainstream users receive better recommendations than niche content viewers. To improve recommendation quality across diverse user groups, we explore three Distributionally Robust Optimization(DRO) methods: Group DRO, Streaming DRO, and Conditional Value at Risk (CVaR) DRO. While Group and Streaming DRO rely on group annotations and struggle with users belonging to multiple groups, CVaR does not require such annotations and can naturally handle overlapping groups. In experiments on two real-world datasets, we show that the DRO methods outperform standard training, with CVaR delivering the best results. Additionally, we find that Group and Streaming DRO are sensitive to the choice of group used for loss computation. Our contributions include (i) a novel application of CVaR to recommenders, (ii) showing that the DRO methods improve group metrics as well as overall performance, and (iii) demonstrating CVaR’s effectiveness in the practical scenario of intersecting user groups. Our code is available at https://github.com/krishnacharya/sequentialrec-fairness 1 Introduction Recommender systems play a crucial role in user-facing services, from ecommerce Smith and Linden (2017) ; Chen et al. (2019b) to video Covington et al. (2016) , music streaming Hansen et al. (2020) ; Bendada et al. (2023) and social networks Eksombatchai et al. (2018) ; Backstrom and Leskovec (2011) . Among recommender systems, sequential recommenders specialize in next-item prediction, i.e., deciding what to recommend next based on the sequence of items a user has previously interacted with. Transformer-based models Kang and McAuley (2018) ; Petrov and Macdonald (2023) ; Sun et al. (2019) excel here and have been deployed at scale Hansen et al. (2020) ; Bendada et al. (2023) . These model are usually trained using empirical risk minimization (ERM), i.e., by minimizing the loss uniformly for all examples in the training set. While standard training (ERM) performs well overall, it can be suboptimal for specific user groups Boratto et al. (2022) ; Li et al. (2021) ; Rahmani et al. (2022) , as models often learn correlations that apply broadly but not within certain groups Beutel et al. (2019) ; Li et al. (2023) . A common example is popularity bias, where mainstream users receive better recommendations than minorities. In this work, we focus on minimax group fairness Diana et al. (2021) ; Sagawa et al. (2020) , which minimizes the maximum loss across user groups, with the goal of improving metrics for all groups. This differs from traditional group fairness, which aims to equalize metrics across groups Li et al. (2022) ; Zeng et al. (2024) . We consider two types of user groups: popularity-based groups and sequence length groups. These choices are motivated by prior findings that recommendation quality differs based on the popularity of items a user interacts with Kowald et al. (2021) ; Kowald et al. (2020) ; Abdollahpouri et al. (2017) , and across users with different sequence lengths Volkovs et al. (2017) ; Lee et al. (2019) . Importantly, these user groups are chosen because they can be extracted for all datasets, and we expect the findings to generalize to other such attributes. Previous work Wen et al. (2022) improves minimax group fairness for a non-sequential retrieval model using Group DRO (GDRO) Sagawa et al. (2020) and Streaming DRO (SDRO) Wen et al. (2022) . However, both methods require predefined group annotations and are also unable to handle users belonging to multiple groups. Additionally, attributes such as age, ethnicity are protected under GDPR 1 1 1 General Data Protection Regulation https://gdpr-info.eu/ and not disclosed by users Grosso et al. (2020) . As a result, GDRO and SDRO are inherently limited in achieving fairness for such groups; in fact, focusing only on known attributes can amplify bias Chen et al. (2019a) . In contrast, Conditional Value at Risk DRO (CVaR) Levy et al. (2020) trains models to be robust to a wide range of shifts by identifying subsets of each training mini-batch with the highest losses and updating the model to minimize those. This approach does not require group annotations and dynamically up-weights the highest-loss examples in each mini-batch. In an orthogonal study, Singh et al. Singh et al. () investigate safe reinforcement learning and apply a CVaR objective to optimize worst-case reward trajectories. In contrast, we focus on improving minimax fairness across user groups in the standard setting of training a sequential recommender (SASRec Kang and McAuley (2018) ). In this paper, we evaluate the effectiveness of CVaR DRO alongside Group DRO and Streaming DRO. Our contributions are: 1. We demonstrate the effectiveness of Conditional Value at Risk DRO for SASRec, a transformer-based sequential recommender. To the best of our knowledge, this is the first application of CVaR DRO to recommender systems for addressing minimax group fairness. 2. Through an in-depth evaluation across group sizes, we show that the DRO methods improve NDCG scores on user groups while also achieving higher overall NDCG compared to standard training. Notably, CVaR, which requires no group information outperforms both group and streaming DRO. 3. We evaluate these methods in a practical scenario with users belonging to intersecting groups, a previously unexplored setup. Here too, the DRO methods outperform standard training, with CVaR often surpassing group and streaming DRO. We also highlight the sensitivity of the GDRO and SDRO results to the group selected for loss computation. Our experimental evidence suggests that practitioners should prioritize group-agnostic methods like CVaR over group-dependent approaches such as GDRO or SDRO. CVaR not only scales easily to multiple groups but also performs better. The paper is organised as follows: Section 2 provides background on sequential recommenders and the training methods; Section 3.2 contains experiments with varying group sizes on the Retailrocket dataset, Section 3.3 then evaluates the methods with intersecting user groups; Section 4 concludes the paper; Appendix A repeats the experiments in Section 3 on the Movielens-1M dataset. 2 Sequential recommenders and training methods In this section, we provide the necessary background on sequential recommenders and the training methods: standard training(empirical risk minimization); the class balanced (CB), inverse propensity weighted (IPW) baselines; and the three distributionally robust methods: Conditional Value at Risk(CVaR) DRO, group DRO and streaming DRO. 2.1 Sequential recommenders In sequential recommendation we want to predict the next item for each user u given H_{u}=(h_{u}^{1},\ldots h_{u}^{n}) , a chronological sequence of n items with which a user has interacted. Each h_{u}^{j} is an item from the item catalogue I . There have been several approaches based on Recurrent Neural Networks Hidasi et al. (2016) ; Yue et al. (2024) and Transformers Kang and McAuley (2018) ; Sun et al. (2019) towards this, but the main idea is similar: 1) Transform the user sequence H_{u} to an embedding \in\mathbb{R}^{d} , 2) Multiply this embedding by a matrix of learnt item embeddings W_{I}^{\theta}\in\mathbb{R}^{|I|\times d} to obtain scores for each item, 3) The items with the highest scores are sent as candidates to a downstream ranker. In the context of SASRec, a transformer decoder model, a user sequence H_{u} is first padded/truncated