Mind the Gaps: Auditing and Reducing Group Inequity in Large-Scale Mobility Prediction

Ashwin Kumar, Hanyu Zhang, David A. Schweidel, William Yeoh · 2025

Read Mind the Gaps: Auditing and Reducing Group Inequity in Large-Scale Mobility Prediction by Ashwin Kumar, Hanyu Zhang, David A. Schweidel, William Yeoh (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-26940.txt.

Introduction

Ashwin Kumar, Hanyu Zhang, David Schweidel, and William Yeoh audit models that predict where a person will go next. Such models support retail, travel, and public health tools, yet their social effects are little studied. Trained on a large movement dataset, the models prove less accurate for some racial and ethnic groups than for others.

To cut the gap, the team offers a sampling plan that adds training data with fairness in mind. A clustering step assigns proxy group labels while matching census shares for Asian, Black, Hispanic, and White users. The plan cuts total disparity by up to forty percent with little loss in overall accuracy, with the biggest gains early on.

Catalog record

CREATORAshwin Kumar, Hanyu Zhang, David A. Schweidel, William Yeoh
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE53 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2510-26940

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Mind the Gaps: Auditing and Reducing Group Inequity in Large-Scale Mobility Prediction Ashwin Kumar, Hanyu Zhang, David A. Schweidel, William Yeoh Abstract Next location prediction underpins a growing number of mobility, retail, and public-health applications, yet its societal impacts remain largely unexplored. In this paper, we audit state-of-the-art mobility prediction models trained on a large-scale dataset, highlighting hidden disparities based on user demographics. Drawing from aggregate census data, we compute the difference in predictive performance on racial and ethnic user groups and show a systematic disparity resulting from the underlying dataset, resulting in large differences in accuracy based on location and user groups. To address this, we propose Fairness-Guided Incremental Sampling (FGIS) , a group-aware sampling strategy designed for incremental data collection settings. Because individual-level demographic labels are unavailable, we introduce Size-Aware K-Means (SAKM) —a clustering method that partitions users in latent mobility space while enforcing census-derived group proportions. This yields proxy racial labels for the four largest groups in the state: Asian, Black, Hispanic, and White. Built on these labels, our sampling algorithm prioritizes users based on expected performance gains and current group representation. This method incrementally constructs training datasets that reduce demographic performance gaps while preserving overall accuracy. Our method reduces total disparity between groups by up to 40% with minimal accuracy trade-offs, as evaluated on a state-of-art MetaPath2Vec model and a transformer-encoder model. Improvements are most significant in early sampling stages, highlighting the potential for fairness-aware strategies to deliver meaningful gains even in low-resource settings. Our findings expose structural inequities in mobility prediction pipelines and demonstrate how lightweight, data-centric interventions can improve fairness with little added complexity, especially for low-data applications. 1 Introduction Next-location prediction has become a central task in applications ranging from mobility planning and retail analytics to public health surveillance. By forecasting where individuals are likely to go, these models support downstream services such as route recommendation, targeted advertising, and resource allocation. However, while accuracy remains the dominant benchmark for evaluating model performance, little attention has been paid to how predictive quality is distributed across different segments of the population. In this paper, we examine the fairness implications of large-scale mobility prediction. Specifically, we conduct the first comprehensive audit of state-of-the-art next-location prediction models trained on real-world data from millions of users. Our findings reveal consistent disparities in predictive accuracy across racial and ethnic groups, with some groups systematically receiving less accurate predictions than others. To support fairness analysis and intervention in the absence of individual-level demographic labels, we introduce a novel clustering algorithm called Size-Aware K-Means (SAKM). This method clusters users in latent mobility space while matching target group proportions derived from census data, yielding demographically grounded proxy labels. These clusters enable us to estimate group-level performance metrics and track disparities throughout training. Building on this foundation, we propose Fairness-Guided Incremental Sampling (FGIS), a lightweight data acquisition strategy for improving equity in low-resource prediction settings. FGIS prioritizes users from underrepresented or underperforming groups during data collection, balancing fairness and accuracy via a tunable tradeoff parameter. Importantly, this intervention operates purely at the data level—requiring no access to user features or modifications to model architecture. We evaluate our approach using two predictive models: a graph-based MetaPath2Vec model for statewide fairness auditing, and an additional transformer encoder model for controlled intervention experiments in a representative subregion (Tarrant County, Texas, United States). Our results show that FGIS can reduce group disparities by over 40% in early training stages with minimal impact on final accuracy. These gains are especially pronounced in low-data regimes, highlighting the value of fairness-aware sampling when data is limited or expensive to collect. Contributions: We summarize our key contributions: • Audit at scale: First large‐scale fairness audit on a SOTA location prediction model with 4.9 million users, uncovering up to 15% accuracy difference between groups. • SAKM proxy labels: A novel size‐constrained k -Means variant that enforces arbitrary census‐derived cluster sizes, enabling demographic fairness evaluation without individual attributes. • FGIS sampling: A plug-and-play batch sampling algorithm that over-samples underperforming groups, reducing early‐stage Total Demographic Parity Violations (TDPV) by over 40% with minimal overhead. • Empirical validation: Demonstrated across two architectures (MetaPath2Vec and Transformer) and multiple geographies, achieving equity gains with under 1% long-term accuracy trade-off. 2 Related Work Mobility and POI Prediction: Recent studies have demonstrated the value of deep learning for point-of-interest (POI) prediction tasks. Transformer-based models have shown strong performance when enriched with auxiliary information, such as travel mode, which helps improve next-location forecasting ( Hong, Martin, and Raubal 2022 ) . Other work has focused on the role of routine detection in understanding user behavior, with findings suggesting that consistent travel patterns can inform customer relationship strategies in ridesharing platforms ( Dew et al. 2024 ) . To alleviate the challenge of limited real-world data, synthetic datasets such as SynMob have been proposed, offering realistic GPS trajectories for robust model training ( Zhu et al. 2023 ) . Additionally, personalized destination prediction has been explored in contextless settings using transformer models trained on partial trajectories ( Tsiligkaridis et al. 2020 ) . We refer readers to a recent review by Graser et al. 2025 on the use of trajectory data for prediction tasks. Zhang, Zhang, and Schweidel 2025 present a recent approach to POI prediction, using a colocation network to identify and use similarities between users to more accurately determine visitation patterns. We will use the model from this paper for the bulk of our analyses. Algorithmic Fairness: Research on algorithmic fairness has produced a rich taxonomy of group‐ and individual‐level criteria. Group fairness notions quantify disparities in aggregate error or allocation rates across protected groups, with Demographic Parity (also called Statistical Parity) being one of the earliest and most widely adopted definitions. A predictor satisfies demographic parity when its positive‐prediction rate is identical for every group ( Dwork et al. 2012 ) . Follow-up work proposed alternative group metrics—most notably equalized odds and equality of opportunity , which require parity of error rates or true-positive rates conditional on the ground truth ( Hardt, Price, and Srebro 2016 ) . Complementary research advocates individual fairness , urging that “similar individuals be treated similarly,” though this is difficult to enforce when similarity measures are ill-defined. Fairness goals are shaped by modeling assumptions and data limitations ( Mitchell et al. 2021 ; Barocas, Hardt, and Narayanan 2023 ) . Demographic parity remains appealing in settings like mobility prediction, where ground-truth labels are limited, as it depends only on observed prediction disparities. We use demographic parity as a diagnostic tool, adapting it to the multi-group setting. Fairness in Active Learning: Fair active learning aims to select data points for labeling in a way that enhances model fairness. Early work in this area focused on balancing label acquisition to satisfy group fairness constraints in supervised settings ( Shekhar et al. 2021 ) . More recent studies have extended this to streaming scenarios ( Wang et al. 2023 ) and developed sampling methods that promote fairness without requiring group labels during training ( Pang et al. 2024 ) . Our setting differs significantly, as we treat it as a data acquisition problem, rather than a labeling problem. We do not assume access to user features

Read the complete text