Revisiting Formal Methods for Autonomous Robots: A Structured Survey

Atef Azaiez, David A. Anisi, Marie Farrell, Matt Luckcuck · 2025

Read Revisiting Formal Methods for Autonomous Robots: A Structured Survey by Atef Azaiez, David A. Anisi, Marie Farrell, Matt Luckcuck (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-20488.txt.

Introduction

Formal proof methods promise robot behavior that can be verified, not just tested. Atef Azaiez and three co-authors survey how those methods have been applied to autonomous robots in a 2025 arXiv paper. Their structured review complements an earlier survey and tracks how the field matured. The authors describe their database choices, search strings, filters, and shared screening process in detail.

The review catalogs which formalisms and approaches have been used to specify and verify robotic systems. It also examines formal methods for robots whose behavior comes from learned, sub-symbolic components. Some trends from the earlier survey persisted. New ones appeared as well, including a clear rise in formal synthesis and in probabilistic verification. The paper maps a field moving from proving hand-built controllers toward assuring learning-enabled machines.

Catalog record

CREATORAtef Azaiez, David A. Anisi, Marie Farrell, Matt Luckcuck
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE28 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-20488

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Revisiting Formal Methods for Autonomous Robots: A Structured Survey Atef Azaiez, David A. Anisi, Marie Farrell, Matt Luckcuck Abstract This paper presents the initial results from our structured literature review on applications of Formal Methods (FM) to Robotic Autonomous Systems (RAS). We describe our structured survey methodology; including database selection and associated search strings, search filters and collaborative review of identified papers. We categorise and enumerate the FM approaches and formalisms that have been used for specification and verification of RAS. We investigate FM in the context of sub-symbolic AI-enabled RAS and examine the evolution of how FM is used over time in this field. This work complements a pre-existing survey in this area and we examine how this research area has matured over time. Specifically, our survey demonstrates that some trends have persisted as observed in a previous survey. Additionally, it recognized new trends that were not considered previously including a noticeable increase in adopting Formal Synthesis approaches as well as Probabilistic Verification Techniques. 1 Introduction Formal Methods have been incorporated in the software production life cycle since the early adoption of computers. Relying solely on testing has been shown to be not enough to guarantee the absence of bugs in software. This quote from Dijkstra in 1969 emphasises that the computer science community needed to develop alternative methods to testing "Testing shows the presence, not the absence of bugs" [ 6 ] . As technology and aspirations have evolved, the use of Robotic Autonomous Systems (RAS) in safety- and/or mission-critical applications has increased, including in the nuclear [ 4 ] , aerospace [ 27 ] , agriculture [ 3 , 2 ] , transport [ 14 ] and space domains [ 8 ] . These sorts of critical systems among others involving safety and security requirements clearly need to be robustly verified using Formal Methods for specification and verification. The use of Formal Methods (FM) is admitted, recommended and can be required by some standards [ 16 ] . The strong verification provided by potentially combinations of distinct FM and testing approaches is advantageous as it guarantees mathematical proof of correctness. This aides in the assurance process in critical settings and helps to provide various stakeholders with sufficient confidence that the systems function as expected. Various FM approaches have been developed to fulfil specific needs of verification. A 2019 survey provides an overview of these methods and acts as a guidebook for those seeking to apply FM in RAS [ 17 ] . Apart from the obvious benefits to developing reliable software, there is a reciprocal benefit to the FM community: the modularity of RAS, as exemplified in the various middleware by which they are supported, fosters creative and interesting opportunities for examining and demonstrating the efficacy of these FM [ 7 ] . These observations have given rise to a novel sub-domain called Formal Methods for Autonomous Systems 1 1 1 https://fmasworkshop.github.io/ and many conferences have held special tracks in related topics since. On the other hand, there are some challenges of applying FM to RAS, namely the complexity of the this kind of systems as they usually combine discrete software logic with continuous physical dynamics and that can lead to scalability issues. Moreover, the dynamic nature of the environment where RAS operate makes it difficult to capture all interactions and uncertainties. last but not least, there can be a gap between the trustworthiness of formal verification results and the expectations of regulatory acquirements [ 1 ] . In this paper, we present the methodology we adopted to conduct our structured literature survey, initial results which examines how the application of FM to RAS has evolved over time. We analyse which trends have persisted since the original survey [ 17 ] and identify emerging trends. We examine the relative use of different formal methods and verification approaches, and discuss the role played by Sub-Symbolic AI (SSAI) (e.g. machine learning). We reflect on potential reasons for these various evolutions, providing insight and set the stage for future development in this field. Next, we present some related work, while the rest of the paper is structured as follows. In Sect. 2 we describe our survey’s methodology, including the scope and search terms. We present the results in Sect. 3 and discuss the implications of the results in Sect. 4 . Finally, Sect. 5 gives our concluding remarks. Related Work: Our survey builds on a previous survey of FM applied to autonomous robotic systems [ 17 ] , though we extend the time frame from 2007—2018, to 2007—2024; We also use a different methodology and work-flow, and used Rayyan [ 20 ] 2 2 2 Rayyan: https://www.rayyan.ai/ a dedicated tool for conducting structured surveys. This gives broader coverage of the literature, including both wider search terms and additional search sources, initially returning 20,764 papers. We examine similar research questions to [ 17 ] but with an explicit focus on the trends that have emerged over time, and examining the impact of SSAI . As the sub-domain of FM for autonomous systems has evolved and become more popular over time, it is no surprise that other related research efforts exist. These include a manifesto for applicable FM that provides ten principles concerning their use [ 9 ] . This project however does not specifically focus on RAS, rather it discusses the use and promotion of FM in practice more generally. Leahy et al. [ 15 ] define three categories of grand challenge for verification of autonomous systems: (1) Requirements and Specifications, (2) Models and Abstractions, and (3) Tools, Techniques and Algorithms. Related work in [ 22 ] provides a research roadmap for verification of autonomous systems which points to several of these open challenges and emerging standards in the area. 2 Methodology This section outlines the structured methodology, shown in Fig. 1 , that we followed. We begin by defining the relevant Research Questions ( RQ ) and the scope of the survey. We query three academic search sources using dedicated search strings, designed to gather a broad range of papers. Our initial search produced 20,764 results. To effectively handle this vast number of results, we rely on databases and sources that allow bulk-export of results and import them into an online Review Management Platform, Rayyan, developed for systematic reviews [ 20 ] . Rayyan supports automated duplicate detection, collaborative initial screening, systematic conflict resolver, and dedicated data summary dashboards. Using Rayyan, we exclude out-of-scope papers using their Title, Abstract, and Keywords (TAK). Then, we import and read the full text of the papers and gather details about the RAS case study and FM it uses to answer the RQ s. Figure 1 : The structured literature review workflow of this paper. The three databases Google Scholar, ACM and IEEExplore were selected as they allowed bulk-export of search results. The Initial query generated 20,764 results. To be able to effectively handle this, they were imported into an online Review Management Platform called Rayyan, to perform initial screening and filtering based on Title, Abstract, and Keywords (TAK) before continuing with collaborative full text review and result generation. Research Questions: We define three research questions to direct our search. • RQ1: What Formal

Read the complete text