AI, Digital Platforms, and the New Systemic Risk
Philipp Hacker, Lilian Edwards, Atoosa Kasirzadeh · 2025
Read AI, Digital Platforms, and the New Systemic Risk by Philipp Hacker, Lilian Edwards, Atoosa Kasirzadeh (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-17878.txt.
Introduction
Philipp Hacker, Lilian Edwards, and Atoosa Kasirzadeh warn that AI joined with big platforms can fail at whole-system scale. Their 2025 paper builds a frame for that risk from fields such as finance, climate, and cyber safety. New EU laws name the risk but define it in narrow ways.
The authors split AI system risk into four levels. Harms like bias at scale and firm false claims may fall outside the law's focus on top models. They test two EU laws and their own frame on five cases. Reforms they propose would widen how the laws treat such risk.
Catalog record
| CREATOR | Philipp Hacker, Lilian Edwards, Atoosa Kasirzadeh |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 70 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-17878
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
AI, Digital Platforms, and the New Systemic Risk Philipp Hacker, Lilian Edwards, Atoosa Kasirzadeh Abstract . Artificial intelligence (AI) is becoming increasingly embedded in digital, social, and institutional infrastructures, often merging with platforms to form hybrid structures. As a result, systemic risk has emerged as a critical but undertheorized challenge. In this paper, we develop a rigorous framework for understanding systemic risk in AI, platform, and hybrid system governance. We draw on insights from finance, complex system theory, and cybersecurity – domains where systemic risk has already shaped regulatory responses. We argue that recent legislation, in particular the EU’s AI Act and Digital Services Act (DSA), invokes systemic risk but relies on narrow or ambiguous characterizations of this notion. At times, the legislation reduces the source of risk to specific capabilities in frontier AI models; at other times, it attributes the risk to harms occurring in economic market settings. The DSA, we posit, actually does a better job at identifying systemic risk than the more recent AI Act. Our framework identifies systemic risks overlooked by the DSA and AI Act — including multi-agent interactions, discrimination at scale, and large-scale hallucinations — which can destabilize institutions despite falling outside current definitions. More generally, we present a framework for systemic risk, categorized into four levels: single-model, multi-model, model-platform, and model-institution integration. We then test the characterizations of systemic risk in DSA, the AI Act, and our own framework by applying them to three key yet contentious examples – large-scale discrimination, hallucinations, and environmental effects – to illustrate their respective strengths and limitations. Against this background, this paper proposes reforms that broaden systemic risk assessments, strengthen coordination between regulatory regimes, and explicitly incorporate collective harms. As localized AI and platform failures may increasingly escalate into structural disruptions, we provide a conceptual foundation and a policy-relevant diagnostic toolkit for governing the interplay of AI and platforms in complex, interconnected societies. \acmConference@name ( \acmConference@shortname ), \acmConference@date , \acmConference@venue DOI: 10.1145/3805689.3806506 Conference: The 2026 ACM Conference on Fairness, Accountability, and Transparency; June 25–28, 2026; Montreal, QC, Canada The 2026 ACM Conference on Fairness, Accountability, and Transparency (FAccT ’26), June 25–28, 2026, Montreal, QC, Canada ISBN: 979-8-4007-2596-8/2026/06 CCS: Social and professional topics Computing / technology policy CCS: Social and professional topics Governmental regulations CCS: Computing methodologies Artificial intelligence † † cc-license: by-nc-nd 1. Introduction Throughout history, societies have grappled with technologies that promise progress yet can destabilize the systems into which they are introduced. This tension made the 20th century a period of sharper differentiation between individual risk, defined as specific harms limited to a single person or a few individuals, and systemic risk, characterized by a structural nature that warrants distinct analysis and, at times, regulation. The 2008 financial crisis crystallized decades of research in financial economics into a global event that destabilized economies and drew urgent attention to the concept of systemic risk. Today, systemic risks to financial infrastructure have not disappeared. Yet the growing complexity of digital infrastructure, and its entanglement with core political and social processes, adds new dimensions of systemic risk. Historically, systemic risk has been well defined in finance: cascading failures that destabilize the financial system as a whole (see Section 3 ). AI and large platforms broaden this risk landscape, creating common exposures and points of failure that traditional formulations do not fully capture. This shift is now reflected in digital and AI risk governance, which increasingly treats systemic risks as a critical concern. Recent legislative efforts, notably the European AI Act and the Digital Services Act (DSA), reflect this growing concern. The DSA identifies four major categories of systemic risk that providers of very large digital platforms and search engines must mitigate: the dissemination of illegal content, negative effects on fundamental rights, risks to civic discourse and electoral processes, and harms related to minors and public well-being ( Marsh, 2024 ) . The EU AI Act establishes obligations for providers of general-purpose AI (GPAI) models regarding systemic risks. Unlike the DSA’s enumerative approach, the AI Act provides a conceptual definition focusing on high-impact capabilities, market-wide effects, and propagation across the value chain (Art. 3(65)). In practice, the AI Act attempts to designate AI models as possessing systemic risks based primarily on training compute thresholds, presuming “high-impact capabilities” when training involves more than 10^{25} floating-point operations (FLOPs). By this measure, many large language models (LLMs) on the market would be classified as systemically risky. However, as Bertuzzi (2025) , Hacker and Holweg (2026b) , and Somala et al. (2025) note, rapid advancements in reinforcement learning and compute efficiency have challenged this designation method even before proper implementation. If systemic risk is defined solely by compute thresholds, the Act may overlook the contribution of smaller AI systems deeply integrated into critical infrastructure, while misclassifying computationally intensive models with limited societal integration as systemic risks. Consequently, the Act’s compute threshold is already under scrutiny for revision. More specifically, Art. 3(64) of the AI Act defines high-impact capabilities as “capabilities that match or exceed the capabilities recorded in the most advanced general-purpose AI models [our emphasis].” Under this logic, systemic risks must be specific to these frontier models. However, it is not clear why risks such as large-scale manipulation, discrimination, or hallucinations should only be considered "systemic" when they stem from the most advanced systems; such harms can arise across a wide range of AI models and still cause widespread disruption. This ambiguity highlights the need for a structured framework that transcends simple size-based compute thresholds. While Annex XIII of the AI Act provides a broader set of designation parameters, these remain deeply connected to a definition of systemic risk that focuses exclusively on “the most advanced” models, as we shall discuss later in the paper. Despite these regulatory mentions, the boundaries of systemic risk in AI-driven systems and platforms remain underdeveloped. Systemic risk is often regarded as a “you-know-it-when-you-see-it” concept ( Benoit et al., 2017 ; Marsh, 2024 ) . This stance, we argue, is problematic and can render the notion so loose and useless as to provide little practical guidance: to clarify systemic risk in AI-driven systems, platforms, and hybrid structures that combine both requires one to identify, measure, and monitor the complex propagation mechanisms by which localized failures could cascade across interconnected systems. If systemic risk is defined exclusively by the advanced capabilities of single AI models, the definition contradicts decades of research on systemic risks in domains like finance, where the focus lies on interaction effects rather than the properties of individual components. In this paper, we develop an analytic framework for understanding systemic risk in digital governance by identifying conditions under which AI or platform risks transition from localized failures to systemic risks. To achieve this, we proceed in four steps. First, we draw on lessons from the historical study of systemic risk, financial risk regulation, and complex system sciences to identify minimal conditions common to core definitions of systemic risk in the literature (Section 3 ). Second, and based on our initial historical findings, we formulate a conceptually rich list of four assessment criteria for specifying AI- and platform-driven systemic risks (Section 4 ): (i) the scale and scope of expected damage; (ii) the emergence of collective