From Bias to Accountability: How the EU AI Act Confronts Challenges in European GeoAI Auditing
Natalia Matuszczyk, Craig R. Barnes, S. Roy, Rohit Gupta, Bulent Ozel, Aniket Mitra · 2025
Read From Bias to Accountability: How the EU AI Act Confronts Challenges in European GeoAI Auditing by Natalia Matuszczyk, Craig R. Barnes, S. Roy, Rohit Gupta, Bulent Ozel, Aniket Mitra (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-18236.txt.
Introduction
Matuszczyk and five co-authors present a paper from twenty twenty-five on bias in geospatial AI and new European audit duties. Bias findings in location-based models are scattered across narrow studies. The team gather that evidence into one overview. Recurring bias types span representation, algorithm, and grouping issues. Each type is mapped to clauses of the European AI Act. Widely used location systems qualify as high-risk under the Act. Recent audit examples and detection methods are laid out.
Routine bias audits are urged even for well-kept datasets. Full high-risk duties bite in twenty twenty-seven. The study is the first to fuse this bias evidence with the Act. Exploratory limits are admitted openly.
Catalog record
| CREATOR | Natalia Matuszczyk, Craig R. Barnes, S. Roy, Rohit Gupta, Bulent Ozel, Aniket Mitra |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 45 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-18236
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
From Bias to Accountability: How the EU AI Act Confronts Challenges in European GeoAI Auditing Natalia Matuszczyk, Craig R. Barnes, S. Roy, Rohit Gupta, Bulent Ozel, Aniket Mitra Abstract Bias in geospatial artificial intelligence (GeoAI) models has been documented, yet the evidence is scattered across narrowly focused studies. We synthesize this fragmented literature to provide a concise overview of bias in GeoAI and examine how the EU’s Artificial Intelligence Act (EU AI Act) shapes audit obligations. We discuss recurring bias mechanisms, including representation, algorithmic and aggregation bias, and map them to specific provisions of the EU AI Act. By applying the Act’s high-risk criteria, we demonstrate that widely deployed GeoAI applications qualify as high-risk systems. We then present examples of recent audits along with an outline of practical methods for detecting bias. As far as we know, this study represents the first integration of GeoAI bias evidence into the EU AI Act context, by identifying high-risk GeoAI systems and mapping bias mechanisms to the Act’s Articles. Although the analysis is exploratory, it suggests that even well-curated European datasets should employ routine bias audits before 2027, when the AI Act’s high-risk provisions take full effect. 1 Introduction Geospatial artificial intelligence (GeoAI) now influences decisions about flood defense placement, measuring climate change impacts, and public health policy ( Mahmood, 2022a ) . Recent audits show rural buildings missed by global footprint datasets ( Gevaert et al., 2024a ) , and crime-prediction tools that perpetuate discrimination ( Richardson et al., 2019a ) . Despite this, European spatial data remain largely unexamined. Recent isolated audits of global land cover maps ( Venter et al., 2024a ) and Copernicus imperviousness data ( Strand, 2022a ) confirm representation bias, reveal significant estimation biases and geographic inaccuracies, yet each focuses on a single theme and stops short of engaging with regulatory implications. Since August 2024, the EU Artificial Intelligence Act (AI Act) has imposed tiered obligations on AI providers. Most GeoAI applications related to critical infrastructure, public services or law enforcement fall into the high-risk tier of Annex III. Articles 9-15 require that high-risk AI systems use representative data, document known and residual error, and ensure human oversight. Non-compliance can result in fines of up to 7% of global turnover. Yet publicly documented audits are still scarce, which this paper examines. Despite this regulatory urgency, the literature reveals substantial gaps. Most studies on geospatial bias are either domain‑specific (e.g. building‑footprint accuracy) or technology‑specific (e.g. geoparsing), leaving no accessible overview of how and why bias arises in GeoAI. While discrete audits now exist for individual INSPIRE and Copernicus layers, our study is the first to integrate those findings and link them to provisions of the EU AI Act. Specifically, this paper addresses existing gaps by: • Providing an overview of evidence for bias in geospatial AI, including implications for European datasets • Demonstrating how Articles 9-15 of the EU AI Act apply to the common types of bias in GeoAI • Offering practical examples of GeoAI audits to guide practitioners in identifying and mitigating bias. Together, these goals tackle the core puzzle: why, when bias is widely acknowledged, do routine GeoAI audits remain the exception rather than the norm? To achieve these objectives, the paper is structured as follows: Section 2 provides background on GeoAI and bias in machine learning. Section 3 discusses the evidence for the research gap in European data. Section 4 outlines the legal framework of the EU AI Act. Section 5 briefly touches upon the future outlook of General Purpose GeoAI. Section 6 presents empirical cases of bias detection in GeoAI audits, and Section 7 concludes with key findings and future research directions. 2 Background on bias 2.1 What is Geospatial AI? A frequently quoted but rarely verified claim says “about 80% of data is geospatial.” The phrase originated in GIS trade literature and, although subsequent estimates differ (Barocas et al., 2023), the anecdote rightly signals geodata’s pervasiveness. With so much decision-making linked to location, even a modest systematic bias can have far-reaching consequences. Geospatial Artificial Intelligence (GeoAI) is a new interdisciplinary field where geospatial data and artificial intelligence are used to understand and gain knowledge about the human environment and the Earth. As Gao et al., 2024a describes, three major forces led to the fast development of this field: the development of AI tools, the availability of geographical information, and compute availability. Geospatial technology allows for making data-informed decisions in fields from urban planning and environmental management to public health and national security ( World Health Organization, 2020a ; Gevaert et al., 2024a ) . Infrastructure for Spatial Information in Europe is a directive that drives the development of the EU-wide Spatial Data Infrastructure. Open Data Directive (2019/1024/EU) mandated that public and publicly-funded data with significant socioeconomic potential, like meteorological, statistical, and geospatial datasets, must be available for free. Figure 1 gives an overview of the data in the INSPIRE datasets, which illustrate the variety of geospatial data, ranging from administrative units, land cover, to species distribution. Figure 1: Data Themes in INSPIRE datasets. Note. Reused from Minghini et al. (2021a) . Content is licensed under the Creative Commons Attribution 4.0 International (CC BY 4.0). No content changes were made. The increasing availability of geospatial data allows to build AI systems used for optimization, learning, and decision making. Wang et al. (2024a) reviewed 415 peer-reviewed papers in quantitative human geography and organised them along two axes: data source (remote sensing imagery, street view photos, trajectories, social media, POI, census) and AI method (traditional ML, deep learning, NLP, graph models). The visual summary of their results is presented on Figure 2. Figure 2: Types of geospatial data. Note. Reprinted from Wang et al. (2024a) , International Journal of Applied Earth Observation and Geoinformation , 120 , p. 2. Content is licensed under the Creative Commons Attribution 4.0 International (CC BY 4.0). No changes were made. GeoAI applications span public-value experiments as well as commercial analytics. Augmented Collective Intelligence is a framework by Dark Matter Labs that uses satellite imagery, open cadastral layers and citizen reports so local authorities can more accurately quantify the value of trees (including their role as stormwater and heat-mitigation infrastructure), not just street furniture ( Dark Matter Labs, 2020a ) . On the private side, Retail Sonar geocodes loyalty card, census and footfall data to optimise growth strategies and predict store turnover. The two examples underscore GeoAI’s range, from climate adaptation budgeting to profit-seeking site selection, while foreshadowing a common risk: if input layers misrepresent certain districts or demographics, both public and commercial decisions can be skewed. 2.2 How does bias arise in machine learning? Friedman & Nissenbaum (1996a) classified bias in computer systems into three categories: preexisting, technical, and emergent bias. Preexisting bias originates from societal structures, institutions, or individual prejudice and becomes embedded in the system through the training data or values of its designers. Technical bias arises from constraints in hardware, software, algorithms, or formalization choices that unintentionally lead to discriminatory outcomes. Lastly, emergent bias develops after deployment due to shifts in societal knowledge, user demographics, or cultural values that were not accounted for during design. As shown in Figure 3, Masinde et al. (2024a) uses this