Artifacts of Idiosyncracy in Global Street View Data.
Tim Alpherts, Sennay Ghebreab, Nanne Van Noord · 2025
Read Artifacts of Idiosyncracy in Global Street View Data. by Tim Alpherts, Sennay Ghebreab, Nanne Van Noord (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-11046.txt.
Introduction
Tim Alpherts, Sennay Ghebreab, and Nanne Van Noord show that street view photo sets carry hidden biases from each city's layout, even where coverage looks dense, in a 2025 paper. Vision systems train on these photos as if they pictured cities evenly, yet earlier work found whole regions missing. The authors ask a subtler question: within covered cities, does the sampling still skew?
Measuring coverage patterns across twenty-eight cities worldwide, they uncover clear skews tied to local layout. They propose a way to grade such distributions so skews are visible before training. A case study of Amsterdam, with interviews, traces how collection quirks shape what the photos show. The authors urge builders to fix bias at its source.
Catalog record
| CREATOR | Tim Alpherts, Sennay Ghebreab, Nanne Van Noord |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 62 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-11046
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Artifacts of Idiosyncracy in Global Street View Data. Tim Alpherts, Sennay Ghebreab, Nanne Van Noord Abstract . Street view data is increasingly being used in computer vision applications in recent years. Machine learning datasets are collected for these applications using simple sampling techniques. These datasets are assumed to be a systematic representation of cities, especially when densely sampled. Prior works however, show that there are clear gaps in coverage, with certain cities or regions being covered poorly or not at all. Here we demonstrate that a cities’ idiosyncracies, such as city layout, may lead to biases in street view data for 28 cities across the globe, even when they are densely covered. We quantitatively uncover biases in the distribution of coverage of street view data and propose a method for evaluation of such distributions to get better insight in idiosyncracies in a cities’ coverage. In addition, we perform a case study of Amsterdam with semi-structured interviews, showing how idiosyncracies of the collection process impact representation of cities and regions and allowing us to address biases at their source. Conference: The 2025 ACM Conference on Fairness, Accountability, and Transparency; June 23–26, 2025; Athens, Greece The 2025 ACM Conference on Fairness, Accountability, and Transparency (FAccT ’25), June 23–26, 2025, Athens, Greece DOI: 10.1145/3715275.3732029 ISBN: 979-8-4007-1482-5/2025/06 CCS: Social and professional topics Geographic characteristics CCS: Information systems Geographic information systems CCS: Computing methodologies Scene understanding Figure 1 . Analysis of the available Google Street View in Johannesburg (middle) compared against a uniform prior over the road network (left) and a prior based on the mean household income over 2016-2021 ( Gauteng City-Region Observatory (2016), GCRO ; Gauteng City-Region Observatory (2022), GCRO ; Gauteng City-Region Observatory (2021), GCRO ; Hamann, 2024 ) (right). From the comparable Earth Mover’s distance (EMD) we can observe that the distribution of street view imagery is explained equally well by either prior. This highlights how the idiosyncrasies of a city propagate to the available street view data, and to AI applications trained on such data. Spatial distribution of Socio-Economic Statistics alongside spatial distribution of Google Street View images. Previous methods mark Johannesburg as having near perfect coverage. Idiosyncracies in driving patterns, data collection, or city dynamics can unknowingly create artifacts of inequality in street view datasets. † † cc-license: by 1. Introduction Since the introduction of Google Street View the AI community has looked to leverage street view images to train models. The promise of using computer vision to automate processes in the city or to support urban planners, in combination with the abundance of street view imagery has led to new fields of research and a torrent of urban vision papers. Computer vision models have been developed for tasks such as Visual Place Recognition ( Arandjelovic et al., 2018 ; Ibrahimi et al., 2021 ; Camara et al., 2019 ; Cao and Snavely, 2015 ; Torii et al., 2013 ; Gomez-Ojeda et al., 2015 ) , Visual Urban Analytics ( Alpherts et al., 2024 ; Ordonez and Berg, 2014 ; Suel et al., 2019 ; Naik et al., 2014 ; Arietta et al., 2014 ; Seresinhe et al., 2017 ; Dubey et al., 2016 ; Law et al., 2019 ; Gebru et al., 2017 ) , Urban Scene Change Detection ( Sakurada, 2018 ; Huang et al., 2024 ; Alcantarilla et al., 2016 ) , or for monitoring objects in the cityscape such as potholes ( Ma et al., 2022 ) , waste ( Sukel et al., 2020 ) , or trees ( Seiferling et al., 2017 ) . Moreover, Computer Vision models have been used to explore theories in Sociology regarding neighbourhood appearance and socio-economic indicators in the form of prediction of labels such as mean income ( Suel et al., 2019 ) , scenicness ( Seresinhe et al., 2017 ) , and theft ( Arietta et al., 2014 ) or crime rates ( Fu et al., 2018 ) . The datasets these models are trained on are constructed from providers such as Google Street View ( Weyand et al., 2020 ; Suel et al., 2019 ) or Mapillary ( Neuhold et al., 2017a ) . A crucial assumption underlying these studies is that collection of street view images follows a mechanistic approach and as a consequence the constructed datasets use sampling at fixed spatial intervals ( Muller et al., 2022 ; Groenen et al., 2022 ) to "get a contiguous visual representation of the city" ( Muller et al., 2022 ) . In this paper we question this assumption and show that that there are clear biases present within street view data. Previous studies into street view data have evaluated the representation of cities by street view providers with spatial coverage: they evaluated whether a road or intersection is covered within the street view imagery. Some cities have street view imagery on all streets while in other cities capturing is restricted to highways or major arteries ( Quinn and Alvarez León, 2019 ) . This binary coverage definition has led to the discovery of coverage differences between urban and rural areas ( Machicao et al., 2022 ) , partially due to the different infrastructure ( Kim and Jang, 2023 ) . The implications of these findings are that we may observe biases in tasks that are applied to both rural areas and urban areas. While prior studies discuss the issue of coverage biases they are constrained to noting that certain cities are partially covered. Large cities in which there is evidence of systematic coverage, such as Johannesburg ( Quinn and Alvarez León, 2019 ) , are found to have the highest coverage level and are as such considered suitable for computer vision methods. However, checking for whether a road has been covered disregards the potential of certain roads being covered more often than others. Parts of the city that are more easily accessible, or that lie near entrance points to other neighbourhoods might be covered more often due to the nature of the collection process. Previous works focused solely on spatial coverage, while not considering differences in the spatial distribution of coverage. When constructing machine learning datasets, depending on how the sampling is done (e.g., multiple images per location, or only the most recent image), the differences in coverage rates across neighbourhoods will be reflected in the resulting dataset. Such differences in coverage density may be reflective of underlying systemic biases which would then propagate to downstream applications trained upon this data. To investigate additional sources of bias in streetview imagery we focus, not on spatial coverage, but on the spatial distribution of coverage. We evaluate the coverage of street view providers with respect to what uniform road coverage would look like. We show how the distribution of street view data with respect to an uniform distribution affects a variety of global cities in different ways. We compare distance metrics for measuring the difference in distributions and we show that good coverage does not necessarily mean equal distribution of data. Our contributions are as follows: • We quantitatively uncover biases in the distribution of coverage of street view data. • We propose a method for evaluating the distribution of street view data, which gives insight into the