Evaluating the Contextual Integrity of False Positives in Algorithmic Travel Surveillance Conference: The 2025 ACM Conference on Fairness, Accountability, and Transparency; June 23–26, 2025; Athens, Greece The 2025 ACM Conference on Fairness, Accountability, and Transparency (FAccT ’25), June 23–26,

Alina Wernick, Alan Medlar, Sofia Söderholm, Dorota Głowacka · 2025

Read Evaluating the Contextual Integrity of False Positives in Algorithmic Travel Surveillance Conference: The 2025 ACM Conference on Fairness, Accountability, and Transparency; June 23–26, 2025; Athens, Greece The 2025 ACM Conference on Fairness, Accountability, and Transparency (FAccT ’25), June 23–26, by Alina Wernick, Alan Medlar, Sofia Söderholm, Dorota Głowacka (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-00218.txt.

Introduction

Alina Wernick and co-authors survey public views on false positives in algorithmic surveillance of air travel, published in 2025. Air travel is heavily surveilled, in the name of preventing terrorism and other serious crime. Even accurate mass systems flag many innocent travelers, with effects on privacy and data rights.

The team surveyed a representative sample of adults in Finland. They also built a new way to estimate the point at which false positive counts breach what people see as fair in context. Surprisingly, very high counts were still judged legitimate when privacy was traded against security. The authors link this in part to high trust in Finland, and ask whether people underweight harms that fall on others.

Catalog record

CREATORAlina Wernick, Alan Medlar, Sofia Söderholm, Dorota Głowacka
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE70 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-00218

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Evaluating the Contextual Integrity of False Positives in Algorithmic Travel Surveillance Conference: The 2025 ACM Conference on Fairness, Accountability, and Transparency; June 23–26, 2025; Athens, Greece The 2025 ACM Conference on Fairness, Accountability, and Transparency (FAccT ’25), June 23–26, 2025, Athens, Greece DOI: 10.1145/3715275.3732139 ISBN: 979-8-4007-1482-5/2025/06 CCS: Social and professional topics Governmental surveillance CCS: Applied computing Law Alina Wernick, Alan Medlar, Sofia Söderholm, Dorota Głowacka Abstract . International air travel is highly surveilled. While surveillance is deemed necessary for law enforcement to prevent and detect terrorism and other serious crimes, even the most accurate algorithmic mass surveillance systems produce high numbers of false positives. Despite the potential impact of false positives on the fundamental rights of millions of passengers, algorithmic travel surveillance is lawful in the EU. However, as the system’s processing practices and accuracy are kept secret by law, it is unknown to what degree passengers are accepting of the system’s interference with their rights to privacy and data protection. We conducted a nationally representative survey of the adult population of Finland (N=1550) to assess their attitudes towards algorithmic mass surveillance in air travel and its potential expansion to other travel contexts. Furthermore, we developed a novel approach for estimating the threshold, beyond which, the number of false positives breaches individuals’ perception of contextual integrity. Surprisingly, when faced with a trade-off between privacy and security, even very high false positive counts were perceived as legitimate. This result could be attributed to Finland’s high-trust cultural context, but also raises questions about people’s capacity to account for privacy harms that happen to other people. We conclude by discussing how legal and ethical approaches to legitimising algorithmic surveillance based on individual rights may overlook the statistical or systemic properties of mass surveillance. † † cc-license: by 1. Introduction 1.1. Algorithmic Mass Surveillance “From initial transaction to exiting the airport at the final destination” air travel is governed by code that determines everything from check-in to boarding the plane ( Kitchin and Dodge 2014 ) . Air travel is also highly surveilled, with passengers subject to complex, digital mass surveillant assemblages by various agencies, such as air travel companies, border control and law enforcement ( Haggerty and Ericson 2017 ) . Often, these processes of surveillance are invisible to passengers ( Kitchin and Dodge 2014 ) . In this article, we focus on a specific mass surveillance practice adopted in air travel - the algorithmic processing of passenger name records (PNR). The PNR system originated in the US in the aftermath of the September 11, 2001 terror attacks to monitor terrorist threats ( Kitchin and Dodge 2014 ) , but was gradually adopted elsewhere, including in the EU where it is mandated by the Passenger Name Record Directive (PNRD) ( Council of European Union 2016c ) that established the conditions for the processing of PNR data for the prevention, detection, investigation and prosecution of terrorist offences and serious crimes ( Olsen and Wiesener 2021 ) . PNR analysis is a form of predictive policing: the detection of potential offenders is performed automatically against databases and using pre-determined criteria that can be updated on the basis of further analysis of PNR data ( Korff and Georges 2015 ) . As such, the PNR system “triages” which passengers should be subject to follow-up scrutiny by competent authorities ( Palmiotto 2024 ) . The use of AI for predictive policing may expose its subjects to discriminatory biases ( Lum and Isaac 2016 ; Jefferson 2018 ; Williams and Kind 2019 ; Trials 2021 ; Browning and Arrigo 2021 ) and the potential discriminatory impact of the algorithmic processing of PNR data has been subject both to legal debate ( Korff and Georges 2015 ; Korff 2021 ; Korff 2023 ; Olsen and Wiesener 2021 ; Brouwer et al. 2023 ; Haitsma 2023 ) and judicial scrutiny in the CJEU decision Ligue des Droits Humains ( CJEU 2022 ) . However, in this paper, we study the PNR system as a form of mass surveillance that interferes with the fundamental rights to privacy and data protection of millions of EU citizens (Arts. 7 and 8 of the Charter of Fundamental Rights of European Union ( Council of European Union 2000 ) ) ( CJEU 2022 ; Korff 2021 ) . The PNR system is subject to the base rate fallacy ( Bar-Hillel 1980 ; EDri 2019 ) , a problem unaddressed by the CJEU ( Korff 2023 ; Thönnes and Vavoula 2023 ; Thönnes 2022a ) , that arises from the exceptionally low prevalence of terrorists and perpetrators of other serious crimes in the general population. As a result, even a surveillance system with a very low false positive rate will flag far more innocent passengers (false positives) than actual terrorists (true positives) as potential criminal threats ( Munk 2017 ; Korff 2023 ; EDri 2019 ) . Indeed, assuming an accuracy of 99.9 percent, the PNR system is expected to produce 500,000 false positives per year within the EU ( EDri 2019 ; Korff 2023 ) . Any efforts to debias the system would not remove this statistical property of the model, exposing a large number of passengers flagged as false positives to further scrutiny by the authorities. The PNR system is also subject to multiple layers of opacity, making it difficult to observe and interfere with. Unlike physical surveillance methods, such as closed-circuit television cameras, passengers are generally unaware of the processing of their PNR data. Indeed, the methods, procedures and criteria for the automated processing of personal data are opaque ( Ulbricht 2018 ) and can be kept secret on the grounds of law enforcement and national security (Art. 15, Law Enforcement Directive (LED) ( Council of European Union 2016b ) ). Furthermore, when the initial assessment is conducted using AI, the grounds for investigating and potentially stopping an individual passenger can be unexplainable, interfering with the passenger’s right to an effective judicial remedy (Art. 47 CFREU, ( CJEU 2022 ; Korff 2023 ) ). Moreover, the PNR system is vulnerable to function creep, where surveillance methods adopted in one context gradually and imperceptibly expand into new domains or are used to serve other purposes ( Wood et al. 2006 ; Koops 2021 ; Tzanou 2010 ) . For example, from specific flights to all flights or from air travel to sea travel. 1.2. Legitimisation Approaches Globally, the EU is known for a strict, rights- and risk-based approach to technology regulation ( Gellert 2016 ; De Gregorio and Dunn 2022 ) , reflected in the General Data Protection Regulation (GDPR) ( Council of European Union 2016a ) and the Artificial Intelligence Act (AI act) ( Council of European Union 2024 ) . In the rights-based approach, the normative values at stake are fundamental rights, that influence legislative activity and legal interpretation in the EU in a top-down manner. Fundamental rights are not absolute, but can be limited on the basis of the principle of proportionality and on the grounds of public security ( Council of European Union 2000 ; CJEU 2022 ) . The CJEU ruled that the PNRD’s exceptions to fundamental rights must be interpreted restrictively, and that surveillance shall not apply indiscriminately

Read the complete text