EMPLACE: Self-Supervised Urban Scene Change Detection
Tim Alpherts, Sennay Ghebreab, Nanne van Noord · 2025
Read EMPLACE: Self-Supervised Urban Scene Change Detection by Tim Alpherts, Sennay Ghebreab, Nanne van Noord (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-17716.txt.
Introduction
Cities change street by street, and a record of that change helps us read how lives shift with it. Tim Alpherts, Sennay Ghebreab, and Nanne van Noord build a self-taught method to spot such change in 2025. Past tools needed hand labels and a fixed list of what counts as change, which ties them to one city at a time.
The team amassed a data set of over 1.1 million street images, by far the field's largest. Their method trains a vision model with a loss that adapts as it learns, and needs no labels at all. It beats top rivals both as a base for later tuning and cold, with no tuning. A case study of Amsterdam shows it catches small and large shifts alike across the city.
Catalog record
| CREATOR | Tim Alpherts, Sennay Ghebreab, Nanne van Noord |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 32 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-17716
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
EMPLACE: Self-Supervised Urban Scene Change Detection Tim Alpherts, Sennay Ghebreab, Nanne van Noord Abstract Urban change is a constant process that influences the perception of neighbourhoods and the lives of the people within them. The field of Urban Scene Change Detection (USCD) aims to capture changes in street scenes using computer vision and can help raise awareness of changes that make it possible to better understand the city and its residents. Traditionally, the field of USCD has used supervised methods with small scale datasets. This constrains methods when applied to new cities, as it requires labour-intensive labeling processes and forces a priori definitions of relevant change. In this paper we introduce AC-1M the largest USCD dataset by far of over 1.1M images, together with EMPLACE, a self-supervising method to train a Vision Transformer using our adaptive triplet loss. We show EMPLACE outperforms SOTA methods both as a pre-training method for linear fine-tuning as well as a zero-shot setting. Lastly, in a case study of Amsterdam, we show that we are able to detect both small and large changes throughout the city and that changes uncovered by EMPLACE, depending on size, correlate with housing prices - which in turn is indicative of inequity. University of Amsterdam [email protected], [email protected], [email protected] Introduction Visual Urban Analytics (VUA) approaches have over the last decade shown potential to identify socio-economic inequity by combining computer vision techniques with street view imagery ( Suel et al. 2019 ; Naik et al. 2017 ) . It has been shown that visual appeal affects citizen well-being through aspects such as greenery ( Li et al. 2015 ) , perceived safety ( Naik et al. 2014 ; Ordonez and Berg 2014 ) , or liveliness ( Dubey et al. 2016 ) , as well as more direct definitions of liveability ( Joglekar et al. 2020 ; Muller et al. 2022 ; Batty 2019 ) . Proposed approaches predict either objective socio-economic metrics ( Suel et al. 2019 ; Suel et al. 2021 ; Law, Paige, and Russell 2019 ) or subjective perceived attributes ( Naik et al. 2014 ; Dubey et al. 2016 ) and show potential to support municipalities to keep a grasp on the state of their neighbourhoods ( Alpherts, van Noord, and Ghebreab 2023 ) . However all these approaches are static as they use a single temporal datapoint, i.e., a single image per location. As a consequence, a concept that is underexplored in VUA is the notion of urban change. Cities are constantly changing; expanding by adding new neighbourhoods and buildings, whilst existing environments decay and get renovated. Many of these changes require permits or are initiated by the municipality, which leads to awareness of these changes. However, there are also many changes to the urban environment that the municipality is not aware off - changes which can be predictive of the condition of the urban environment. Figure 1: Examples of various urban changes in Amsterdam uncovered through EMPLACE. In fact, recent works within VUA have shown the relationship between urban change and socio-demographic data, by investigating how socio-economic indicators predict neighbourhood improvement ( Naik et al. 2017 ) or proposing methods to use computer vision to detect building construction ( Huang et al. 2024 ) . The latter of these two approaches falls within the field of Urban Scene Change Detection (USCD), a subfield of computer vision that revolves around finding changes in sets of street view images. To further investigate the relationship between urban change and socio-demographic data we aim to extend VUA using USCD methods to explore visual changes in neighbourhoods. Unfortunately, current USCD methods are not well-equipped for this. USCD has mostly been used for specific domains such as detecting tsunami damage ( Sakurada and Okatani 2015 ) or autonomous driving ( Alcantarilla et al. 2016 ) , limiting their broader use within cities. Moreover, the existing datasets for USCD are relatively small, and use a variety of labelling techniques such as pixel-wise annotations ( Sakurada and Okatani 2015 ; Alcantarilla et al. 2016 ) , further limiting direct application or adaptation of existing methods. To study urban change from a VUA perspective it is necessary to detect change at scale throughout the entire city, whilst taking into account that the urban landscape differs tremendously between cities. This domain shift between cities is a challenge for existing USCD methods as they generally focus on discrete change , such as a building being constructed ( Huang et al. 2024 ) , which requires extensive manual labeling and an a priori definition of what is considered change. To overcome these limitations we propose a self-supervised learning approach that learns to detect urban change from unlabeled panoramic images. To enable self-supervised learning at city-scale we built the AC-1M (Amsterdam Change) dataset of over 1.1M images, the largest USCD dataset by a significant margin. Furthermore, we propose EMPLACE, a self-supervised approach using an adaptive triplet loss that learns local change features without the need for labelling procedures while being robust to fleeting changes such as cars, people, and lighting. We evaluate its efficacy as a pre-training method for linear fine-tuning and zero-shot, and find we outperform SOTA models in both settings. By using EMPLACE we overcome the need for costly labelling processes thereby allowing our model to capture the full extent of change across the urban landscape. Our contributions are as follows: 1. We build the AC-1M, the largest Urban Scene Change Detection dataset to date containing over 1.1M panoramas curated to be within a single meter of each other. 2. We introduce tEMPoraL urbAn Change lEarning (EMPLACE), a self-supervised method for learning change detection features robust to noise such as weather, people, and cars. We demonstrate EMPLACE’s potential in a zero-shot setting and as a pre-training method. 3. In a case study of Amsterdam we show that EMPLACE can find visual elements of change without an a priori definition of what constitutes it. We uncover both small and large visual elements and show that the size of visual change correlates differently with housing prices, demonstrating that visual change is indicative of socio-economic variation across cities. Related Work Visual Urban Analytics The field of Visual Urban Analytics has a myriad of studies that have shown that neighbourhood visuals provide insight into socio-economic indicators such as mean income ( Suel et al. 2019 ) , housing prices ( Law, Paige, and Russell 2019 ) or voting patterns ( Gebru et al. 2017 ) , as well as human perception such as liveliness ( Dubey et al. 2016 ) , scenicness ( Seresinhe, Preis, and Moat 2017 ) , uniqueness ( Ordonez and Berg 2014 ) , or perceived safety ( Naik et al. 2014 ) . While the predictive capability of these methods is solid, they use black box techniques and as such cannot uncover specific visual elements that influence socio-economic inequity ( Alpherts, van Noord, and Ghebreab 2023 ) . More useful examples such as trash detection ( Sukel, Rudinac, and Worring 2020 ) , pothole detection ( Ma et al. 2022 ; Koch and Brilakis 2011 ) , or quantifying greenery ( Seiferling et al. 2017 ) exist, but they are supervised: Using a predefined notion