Constructing Safety Cases for AI Systems: A Reusable Template Framework

Sung Une Lee, Liming Zhu, Md Shamsujjoha, Liming Dong, Qinghua Lu, Jieshan Chen · 2026

Read Constructing Safety Cases for AI Systems: A Reusable Template Framework by Sung Une Lee, Liming Zhu, Md Shamsujjoha, Liming Dong, Qinghua Lu, Jieshan Chen (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-22773.txt.

Introduction

Sung Une Lee and a team give builders a reusable template for safety cases for AI systems. A safety case is a structured argument that a system is safe enough. Their 2026 preprint notes that classic cases, from aviation and nuclear work, assume fixed bounds and known failure modes.

Modern AI breaks those assumptions: it shifts, learns, and acts on its own. Their template framework adapts the case form to that reality. Reusable parts can lift the floor for AI governance. The work serves regulators and builders alike. It turns a craft into a kit.

Catalog record

CREATORSung Une Lee, Liming Zhu, Md Shamsujjoha, Liming Dong, Qinghua Lu, Jieshan Chen
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE118 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-22773

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Constructing Safety Cases for AI Systems: A Reusable Template Framework Sung Une Lee, Liming Zhu, Md Shamsujjoha, Liming Dong, Qinghua Lu, Jieshan Chen Abstract Safety cases, structured arguments that a system is acceptably safe, are becoming central to the governance of AI systems. Yet, traditional safety-case practices from aviation or nuclear engineering rely on well-specified system boundaries, stable architectures, and known failure modes. Modern AI systems such as generative and agentic AI are the opposite. Their capabilities emerge unpredictably from low-level training objectives, their behaviour varies with prompts, and their risk profiles shift through fine-tuning, scaffolding, or deployment context. This study examines how safety cases are currently constructed for AI systems and why classical approaches fail to capture these dynamics. It then proposes a framework of reusable safety-case templates, each following a predefined structure of claims, arguments, and evidence tailored for AI systems. The framework introduces comprehensive taxonomies for AI-specific claim types (assertion-based, constrained-based, capability-based), argument types (demonstrative, comparative, causal/explanatory, risk-based, and normative), and evidence families (empirical, mechanistic, comparative, expert-driven, formal methods, operational/field data, and model-based). Each template is illustrated through end-to-end patterns addressing distinctive challenges such as evaluation without ground truth, dynamic model updates, and threshold-based risk decisions. The result is a systematic, composable, and reusable approach to constructing and maintaining safety cases that are credible, auditable, and adaptive to the evolving behaviour of generative and frontier AI systems. K eywords AI \cdot AI Safety Case \cdot AI Safety Case Taxonomy \cdot AI Safety Case Template \cdot AI Safety Case Pattern 1 Introduction Safety cases have become a central assurance artefact across safety-critical engineering, structured arguments supported by evidence, intended to demonstrate that a system is acceptably safe for a specific purpose and operating context [ kelly1996systematic , bloomfield2009safety ] . However, artificial-intelligence (AI) systems including frontier, generative and agentic AI systems fundamentally differ from the deterministic and specification-driven systems for which safety cases were originally designed. Their capabilities are not engineered line-by-line but discovered after training. Their risks evolve through interactions, fine-tuning, and context. In addition, their evaluation often proceeds without fixed ground truth. Consequently, the logic of assurance for AI should be discovery-driven, continually updated, and capable of integrating empirical, statistical, and abductive reasoning alongside classical deductive forms. The value of a safety case lies not only in regulatory compliance or as a governance tool, but as an epistemic discipline that stabilises ethical reasoning under uncertainty. Discussions of AI safety and ethics often operate largely in a pre-harm, anticipatory mode [ Konigs2025Negativity ] , where severity is inferred rather than observed. While this is necessary, such analysis is often conducted under conditions of limited empirical grounding, making it difficult to specify risk severity, compare against existing systems, or define acceptable risk thresholds. The safety-case approach is well suited to addressing these challenges. By grounding ethical and safety concerns in explicit claims, evidence, and well-defined comparators or baselines, AI safety cases support consistent risk assessment, review, and justification across different systems and contexts. While early work has begun to adapt safety-case thinking to frontier AI [ buhl2024safety , carlan2024dynamic , clymer2025example ] , the field still lacks a coherent, reusable structure that practitioners can apply across model types, lifecycle stages, and regulatory regimes. Existing examples tend to focus on isolated instances such as dynamic updating, misuse safeguards, or autonomous-system templates, without an overarching synthesis that ties together claim formulation, argument structure, and evidence design. Moreover, current practices rarely capture the iterative process by which AI developers discover new model capabilities and failure modes through evaluation, stress testing, and adversarial probing [ wiggins2022opportunities ] . These discoveries continually reshape the scope of assurance itself. This study develops a systematic framework of reusable safety-case templates for AI systems, addressing the limitations of existing assurance approaches. The key contributions are fourfold. • Characterisation of modern AI safety cases. The study first analyses how safety cases are currently constructed for AI systems, contrasting them with classical engineering approaches and identifying distinctive features such as capability discovery, absence of ground truth, continuous evolution, and threshold-based decision-making. • Taxonomies for reusable safety-case design. It introduces AI-specific taxonomies for Claim types including assertion-based, constrained-based, capability-based claims, Argument types including demonstrative, comparative, causal/explanatory, risk-based, and normative arguments, and Evidence families such as empirical, mechanistic, comparative, expert-driven, formal methods, model-based and operational/field data. Each linked through explicit reasoning logics (deductive, inductive, abductive, statistical, and analogical). The taxonomies introduced in this study are descriptive and compositional, not mutually exclusive classification schemes. Claim types, argument types, and evidence families are intended as orthogonal lenses on safety reasoning, rather than disjoint buckets into which safety cases must be partitioned. In real AI safety cases, overlap across categories is expected and legitimate. • Template and pattern library. It proposes a library of reusable templates for constructing AI safety cases, illustrated through end-to-end patterns that address unique AI challenges such as safety justification through discovery-driven evaluation, marginal-risk reasoning without ground truth, continuous evolution for dynamic update and redeployment management, and threshold-based risk acceptance. • Integration with dynamic assurance. Building on emerging ideas such as Dynamic Safety-Case Management Systems (DSCMS) and Checkable Safety Arguments [ carlan2024dynamic ] , the framework embeds these templates within a continuous evaluation pipeline, linking safety claims to live metrics and governance artefacts. These contributions establish a composable, auditable, and reusable foundation for constructing safety cases that remain credible under the uncertainty, discovery, and rapid change inherent to modern and emerging AI systems. To illustrate the practical implications of this study, we examine a real-world case study involving an AI-based tender evaluation system in government. This case study demonstrates how the proposed framework can be applied in practice, showing its potential to enhance governance and assurance processes. It also provides concrete insights that inform decision-making and guide the development of effective, responsible AI solutions. The remainder of the paper proceeds as follows. Section 2 provides background information about AI safety case, including in-depth analysis of how AI safety cases diverge from traditional engineering examples, highlighting the distinctive challenges of discovery-driven evaluation and evolving system boundaries. We then present the methodology of this study in Section 3 . Section 4 introduces the reusable safety-case template framework, detailing the proposed taxonomies of claim, argument, and evidence (CAE) types. Section 5 presents end-to-end patterns illustrating how these templates address characteristic AI assurance problems such as marginal risk without ground truth and continuous model evolution. Section 6 provides a case study to show how the framework/patterns can be applied in the real-world context. In Section 7 we discuss current limitations of this study and future work. We then conclude this study in Section 8 . 2 Background In this section we introduce core AI safety case concepts including the Claims–Arguments–Evidence (CAE) framework, taxonomy, template, and pattern, presents an overview of the AI safety ecosystem pipeline involving different stakeholders, and examine the transition from traditional engineering safety cases to AI-specific approaches. 2.1 AI safety case concepts Safety Case. A safety case is a documented, structured argument asserting that a system is acceptably safe for a given context of operation, supported by evidence [ mod2007safety , habli2025big ] . For AI systems, especially high-capability or frontier AI, the safety case aims to show that the

Read the complete text