Massive-STEPS: Massive Semantic Trajectories for Understanding POI Check-ins – Dataset and Benchmarks
Wilson Wongso, Hao Xue, Flora Salim · 2025
Read Massive-STEPS: Massive Semantic Trajectories for Understanding POI Check-ins – Dataset and Benchmarks by Wilson Wongso, Hao Xue, Flora Salim (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-11239.txt.
Introduction
Wilson Wongso, Hao Xue, and Flora Salim release a dataset on human movement in a 2025 paper. Modeling how people move between places of interest helps city planning and personal services. Past work leaned on old datasets from a narrow window and few places. Their dataset builds on an earlier trails collection and adds rich place information.
It spans fifteen cities across diverse regions and cultures. Check-in records cover two periods, one recent, over a full two years. They benchmark many movement models on it, both trained and untrained on the data. The dataset and code are public, aiming to make mobility research more reproducible and fair across world regions.
Catalog record
| CREATOR | Wilson Wongso, Hao Xue, Flora Salim |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 67 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-11239
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Massive-STEPS: Massive Semantic Trajectories for Understanding POI Check-ins – Dataset and Benchmarks Wilson Wongso, Hao Xue, Flora Salim Abstract Understanding human mobility through Point-of-Interest (POI) recommendation is increasingly important for applications such as urban planning, personalized services, and generative agent simulation. However, progress in this field is hindered by two key challenges: the over-reliance on older datasets from 2012-2013 and the lack of reproducible, city-level check-in datasets that reflect diverse global regions. To address these gaps, we present Massive-STEPS (Massive Semantic Trajectories for Understanding POI Check-ins), a large-scale, publicly available benchmark dataset built upon the Semantic Trails dataset and enriched with semantic POI metadata. Massive-STEPS spans 12 geographically and culturally diverse cities and features more recent (2017-2018) and longer-duration (24 months) check-in data than prior datasets. We benchmarked a wide range of POI recommendation models on Massive-STEPS using both supervised and zero-shot approaches, and evaluated their performance across multiple urban contexts. By releasing Massive-STEPS, we aim to facilitate reproducible and equitable research in human mobility and POI recommendation. The dataset and benchmarking code are available at: https://github.com/cruiseresearchgroup/Massive-STEPS . 1 Introduction Importance of Human Mobility Data and Modeling Human mobility data and modeling are essential for understanding how individuals interact with and move through physical spaces. This understanding enables a wide range of applications, including urban planning [ 63 ] , travel service recommendations [ 7 ] , improved commercial advertising strategies [ 59 ] , and Point-of-Interest (POI) recommendation [ 6 , 22 , 68 ] . Recently, human mobility data has become even more crucial with the increasing use of large language models (LLM) agents to simulate human-like behavior and routines [ 71 , 20 ] . However, while simulated human mobility data are starting to gain popularity [ 31 , 9 ] , they may not accurately reflect real-world human behavior [ 33 ] , highlighting the value of evaluating on real-world data. These advancements are enabled by and large with the rise of Location-based Social Networks (LBSNs), which generate vast amounts of spatio-temporal data through user check-ins [ 68 , 22 ] . This rich data source has allowed the development of POI recommendation systems that leverage users’ historical visiting behaviors to suggest relevant locations. Such systems enhance user engagement through personalization and provide commercial value to both users and businesses by aligning recommendations with individual preferences and available services [ 68 , 6 ] . Literature Gaps Our paper addresses three critical gaps in POI recommendation research and datasets, as detailed in Section 2.1 . First, as shown in Fig. 1 , the field remains dominated by studies focused on just two cities, New York and Tokyo, based on the Foursquare dataset curated in [ 57 ] . This dataset, collected in 2012-2013, raises concerns about its temporal quality, as many POIs may no longer exist and user behavior may have changed [ 61 ] . While some recent studies have expanded to other cities [ 65 , 28 , 7 ] , they often rely on the Global-scale Check-in Dataset (GSCD) [ 55 , 56 ] , which, despite its large coverage, is also from 2012-2013 and contains nearly 50% erroneous entries [ 29 ] . Second, most existing studies are difficult to reproduce, either due to the lack of clearly defined geographic boundaries or the unavailability of the datasets themselves, hindering fair comparison and replication. Finally, we join recent efforts [ 63 ] in advocating for the inclusion of low-resource and underrepresented cities in evaluation. Expanding beyond well-studied urban centers is essential for building more generalizable and universally applicable POI recommendation models. Table 1 summarizes these limitations in terms of geographic coverage, temporal span, and reproducibility. Table 1: Comparison of check-in datasets commonly used for POI recommendation tasks . GSCD [ 57 , 56 ] and Semantic Trails [ 29 ] are global datasets not grouped into individual cities, whereas others perform city-level grouping. † Replicable indicates whether city boundaries are clearly defined or can be reliably reconstructed. Dataset Scale xx Completeness xx Usability #cities Years #months POI Attributes Replicable † Open-source GSCD [ 57 , 56 ] Varies 2012-2013 17 Coordinates, Category N/A ✓ Semantic Trails [ 29 ] Varies 2012-2013, 2017-2018 24 Category N/A ✓ NYC and Tokyo [ 57 ] 2 2012-2013 11 Coordinates, Category ✓ ✓ Gowalla-CA [ 4 , 62 ] 1 2009-2010 21 Coordinates, Category ✓ ✓ AgentMove [ 7 ] 12 2012-2013 17 Coordinates, Category ✗ ✗ Massive-STEPS 12 2012-2013, 2017-2018 24 Coordinates, Category, Name, Address ✓ ✓ Massive-STEPS Dataset In this paper, we introduced the Massive Semantic Trajectories for Understanding POI Check-ins (Massive-STEPS) Dataset, derived from the Semantic Trails dataset (STD) [ 29 ] . Massive-STEPS includes high-quality check-ins from 2012-2013 and 2017-2018, providing more modern and updated POI check-in data. This supports longitudinal POI recommendation studies and addresses the limitations of older datasets commonly used in prior studies. The dataset covers 12 diverse cities across multiple regions, including East, West, and Southeast Asia, North and South America, Australia, the Middle East, and Europe. Notably, we placed a deliberate emphasis on under-explored regions by including cities such as Jakarta, Kuwait City, and Petaling Jaya, filling a key gap in POI recommendation research that has largely focused on major urban centers. We further enriched STD by aligning it with Foursquare’s Open Source Places dataset, incorporating metadata such as POI coordinates, POI names, and addresses—details unavailable in the original STD. Benchmark Tasks To demonstrate the utility of this dataset, we conducted an extensive benchmark on two tasks: (1) supervised POI recommendation and (2) zero-shot POI recommendation. Our benchmark covers a wide range of models, including traditional approaches, deep learning-based models, and more recent LLM-based methods. The goal of POI recommendation task is to predict a set of POIs that a user is likely to visit based on their current check-in trajectory and historical behavior. This reflects real-world applications such as personalized POI recommendations in location-based services. In addition, the scale of our dataset allows us to examine how urban features influence POI recommendation accuracy. Building on prior hypotheses, we propose a new insight: cities with more evenly distributed POI categories tend to be harder to model, as the absence of a dominant POI category makes user behavior less predictable. Contribution This paper introduces the Massive Semantic Trajectories for Understanding POI Check-ins (Massive-STEPS) dataset, addressing gaps in existing POI recommendation research. Current POI check-in datasets are often only from 2012-2013, skewed to a few cities, and lack semantic metadata, hindering the development of robust and globally applicable models. While datasets like GSCD and STD offer broad geographic coverage, they either suffer from an older timespan, contain erroneous data, or have missing information. Massive-STEPS overcomes these issues by providing high-quality check-ins from 2012-2013 and 2017-2018, improving temporal quality for longitudinal POI recommendation studies. The dataset spans 12 diverse cities across multiple regions, with a focus on low-resource cities overlooked in previous research. Additionally, Massive-STEPS is enriched with metadata through alignment with Foursquare’s Open Source Places, providing crucial details such as POI geographical coordinates, POI names, and addresses. We also conducted an extensive benchmark on both supervised and zero-shot POI recommendation tasks, evaluating a wide range of models, including traditional methods,