Clear, Compelling Arguments: Rethinking the Foundations of Frontier AI Safety Cases

Shaun Feakins, Ibrahim Habli, Phillip Morgan · 2026

Read Clear, Compelling Arguments: Rethinking the Foundations of Frontier AI Safety Cases by Shaun Feakins, Ibrahim Habli, Phillip Morgan (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-08760.txt.

Introduction

Shaun Feakins and colleagues rethink safety cases for frontier AI from safety practice outward. Safety cases are structured arguments that a system is safe enough to deploy in context, long used in aerospace, nuclear, and automotive work. The paper finds the alignment community's borrowings from safety work limited, then offers safety lessons and a case study on deceptive alignment and CBRN capabilities.

Catalog record

CREATORShaun Feakins, Ibrahim Habli, Phillip Morgan
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE47363
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.08760

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Clear, Compelling Arguments: Rethinking the Foundations of Frontier AI Safety Cases Shaun Feakins, Ibrahim Habli, Phillip Morgan Abstract This paper contributes to the nascent debate around safety cases for frontier AI systems. Safety cases are structured, defensible arguments that a system is acceptably safe to deploy in a given context. Historically, they have been used in safety-critical industries, such as aerospace, nuclear or automotive. As a result, safety cases for frontier AI have risen in prominence, both in the safety policies of leading frontier developers and in international research agendas proposed by leaders in generative AI, such as the Singapore Consensus on Global AI Safety Research Priorities and the International AI Safety Report. This paper appraises this work. We note that research conducted within the alignment community which draws explicitly on lessons from the assurance community has significant limitations. We therefore aim to rethink existing approaches to alignment safety cases. We offer lessons from existing methodologies within safety assurance and outline the limitations involved in the alignment community’s current approach. Building on this foundation, we present a case study for a safety case focused on Deceptive Alignment and CBRN capabilities, drawing on existing, theoretical safety case “sketches” created by the alignment safety case community. Overall, we contribute holistic insights from the field of safety assurance via rigorous theory and methodologies that have been applied in safety-critical contexts. We do so in order to create a better foundational framework for robust, defensible and useful safety case methodologies which can help to assure the safety of frontier AI systems. 1 Introduction Safety cases are used to make clear, defensible arguments that a system is acceptably safe in a given context. This paper considers the nascent approach to safety cases by those involved in and concerned about frontier AI systems, which we term “alignment safety cases”. We argue that alignment safety cases diverge significantly from many foundational methods found within safety-critical systems methodologies, limiting their effectiveness. We present a critical appraisal of the existing approach to alignment safety cases. We aim to recentre the debate using foundational and technology-agnostic methodologies from the field of safety assurance. Safety cases have traditionally been concerned with assuring safety-critical systems. Safety-critical systems are those systems whose failure could result in loss of life, significant property damage or damage to the environment [ 54 ] . Safety assurance focuses on how to communicate, assess and establish confidence in sufficient risk reduction in high-criticality domains, such as aerospace, automotive, nuclear and chemical contexts [ 41 ] . The field, also known as safety science or systems safety, incorporates research areas such as engineering [ 16 ] , human factors within teams [ 75 ] , organisational culture [ 71 ] , and safety argumentation [ 37 ] . Safety cases have been used across safety-critical industries for decades. They are best understood within safety science as structured frameworks for thinking about the safety of a system, which should result in a compelling and defensible argument about the system from development through to post-deployment. Alignment safety cases are a growing field of research which aim to use safety cases to help to assure the safety and alignment of frontier AI systems. Frontier AI systems are defined as highly capable general purpose models which “match or exceed the capabilities present in today’s most advanced models” [ 28 ] . Alignment safety cases often include a particular focus on catastrophic risks [ 14 , 20 , 35 , 57 , 8 ] (Appendix B). We define the alignment safety case literature as the current research direction and industry-adopted approach to safety cases by frontier AI developers. 20 and 14 are examples of initial research in this area, with later work at the U.K. AI Security Institute building directly on 20 ’s framework [ 35 , 57 ] . This paper begins by presenting an overview of safety cases within safety-critical systems. It moves to illustrate core issues with the alignment safety case literature’s understanding of and rationale behind safety cases. We then introduce foundational methodologies within safety assurance, and how these might be applied by the alignment safety case community. Finally, we close with a case study illustrating a basic safety argument about two hazardous events - CBRN capabilities and Deceptive Alignment - presented by frontier AI systems, and how a safety case and associated risk assessment might respond to those hazardous events. 2 Safety-Critical Systems, Safety Cases and Frontier AI Assurance An increasing body of work advocates for applying methodologies derived from safety-critical industries and safety assurance to frontier AI [ 81 , 22 , 11 ] . On Knight’s definition, that safety-critical systems are those systems wherein failure could result in loss of life or significant property damage [ 54 ] , frontier AI systems fit the basic definition of a safety-critical system in some deployment contexts. The safety case is a seminal technique within safety-critical systems. Safety cases are accompanied by a rich body of academic and industrial literature and research. A safety case aims to offer “a structured argument, supported by a body of evidence that provides a compelling, comprehensible and valid case that a system is safe for a given application in a given operating environment.” [ 62 ] Within safety-critical systems, there are various characterising features of safety cases, involving argument structure [ 37 ] , confidence assessments [ 36 ] and a through-life process [ 62 , 41 ] . Safety case arguments are often presented in graphical notations, such as Goal Structuring Notation (GSN) [ 52 ] . Importantly , the safety case is a through-life document, developed from the start of system development through to decommissioning [ 62 ] . Safety cases can therefore occasionally become lengthy documents, involving both system level and component level analyses [ 41 ] . The safety case was first introduced formally in the U.K. for the nuclear industry in 1965 [ 42 ] . An increasing number of industries which aim to assure the safety of their systems have adopted safety cases, from ML-based safety-critical systems within automotive [ 69 ] , through to healthcare [ 32 ] , high-rise building safety [ 46 ] , and AI systems themselves [ 41 ] . 2.1 Alignment Safety Cases This background to safety cases motivated those involved in assuring the safety and alignment of frontier AI systems [ 20 , 14 , 48 ] . The fact that safety cases have been used in safety-critical settings explicitly form the justification of 14 and 20 ’s use of safety cases: 20 : “We first introduce the concept of a “safety case,” which is a method of presenting safety evidence used in six industries in the UK (Sujan et al., 2016). A safety case is a structured rationale that a system is unlikely to cause significant harm if it is deployed to a particular setting.“ 14 : “A safety case is a structured argument, supported by evidence, that a system is safe enough to deploy in a given way (MoD, 2007). Safety cases are used in many safety-critical industries, such as nuclear power, aviation, and autonomous vehicles (The Health Foundation, 2012; Inge, 2007; Sujan et al., 2016)…However, there is still

Read the complete text