A Structured Framework for Prioritizing Unsafe Control Actions in STPA: Case Study on eVTOL Operations Journal: Reliability Engineering & System Safety
Halima El Badaoui, Shufeng Chen, Mariat James Elizebeth, Takuya Nakashima, Siddartha Khastgir, Paul Jennings · 2025
Read A Structured Framework for Prioritizing Unsafe Control Actions in STPA: Case Study on eVTOL Operations Journal: Reliability Engineering & System Safety by Halima El Badaoui, Shufeng Chen, Mariat James Elizebeth, Takuya Nakashima, Siddartha Khastgir, Paul Jennings (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-10446.txt.
Introduction
Halima El Badaoui and colleagues tackle a paperwork problem in safety analysis: good methods find more hazards than teams can act on. Systems Theoretic Process Analysis of a complex vehicle can generate hundreds of unsafe control actions. Prioritizing them objectively, and explaining the ranking, is where projects stall.
Their framework scores each action by severity, by the influence of the controller issuing it, and by expert rankings of criticality. A Monte Carlo simulation then washes out some subjectivity from those combined inputs. Results are communicated through a prioritization matrix whose scaling adapts dynamically. The case study applies everything to electric vertical takeoff and landing aircraft operations, a fast-moving development program.
Catalog record
| CREATOR | Halima El Badaoui, Shufeng Chen, Mariat James Elizebeth, Takuya Nakashima, Siddartha Khastgir, Paul Jennings |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 67 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-10446
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
A Structured Framework for Prioritizing Unsafe Control Actions in STPA: Case Study on eVTOL Operations Journal: Reliability Engineering & System Safety Halima El Badaoui, Shufeng Chen, Mariat James Elizebeth, Takuya Nakashima, Siddartha Khastgir, Paul Jennings Abstract Systems Theoretic Process Analysis (STPA) is a widely recommended method for analysing complex system safety. STPA can identify numerous Unsafe Control Actions (UCAs) and requirements depending on the level of granularity of the analysis and the complexity of the system being analysed. Managing numerous results is challenging, especially during a fast-paced development lifecycle. Extensive research has been done to optimize the efficiency of managing and prioritising the STPA results. However, maintaining the objectivity of prioritisation and communicating the prioritised results have become common challenges. In this paper, the authors present a complementary approach that incorporates inputs from both the safety analysts and domain experts to more objectively prioritise UCAs. This is done by evaluating the severity of each UCA, the impact factor of each controller or decision maker that issues the UCA, and the ranking provided by the subject matter experts who assess the UCA criticalities based on different factors. In addition, a Monte Carlo simulation is introduced to reduce subjectivity and relativity, thus enabling more objective prioritisation of the UCAs. As part of the approach to better communicate the prioritisation results and plan the next steps of system development, a dynamic-scaling prioritisation matrix was developed to capture different sets of prioritised UCAs. The approach was applied to a real project to improve the safe operations of Electric Vertical Take-off and Landing (eVTOL). The results highlighted critical UCAs that need to be prioritised for safer eVTOL operation. 318 UCAs were identified in total. Based on the application of the prioritisation methodology, 110 were recognized as high-priority UCAs to strengthen the system design. 1 Introduction With the rapid advancement of technology, the complexities of the technologies, as well as the processes of managing these technologies, have also significantly increased. Identifying potential safety flaws due to unexpected emergent behaviors of the process needs to be prioritised at the early phases of the development. System-theoretic Process Analysis (STPA), which is part of the System-Theoretic Accident Model and Processes (STAMP), has been a promising safety analysis method that can be applied in the early phases of system development. STPA has been used in various studies across different domains. Including aviation [ 1 , 2 ] , medical sector [ 3 , 4 , 5 ] , maritime [ 6 , 7 ] , automotive [ 8 , 9 , 10 , 11 ] , railway safety management [ 12 ] , and the safety analysis in the area of Large Language Models (LLM) [ 13 ] . Especially in the aviation domain, STPA was highly recognized as a recommended methodology in the report [ 14 ] . The report also showed findings of a collaborative effort by subject matter experts (SME) from the UK Civil Aviation Authorities (CAA) to study STPA and assess its relevance to aviation safety, including safety management, aircraft development, safety assessment, and certification. It also showed how STPA can effectively identify real design flaws and address the gaps. Unlike traditional safety analysis methods such as FTA, FMEA, and HAZOP, STPA goes beyond these approaches by detecting software-related and non-failure scenarios that these traditional methods may overlook [ 15 , 16 , 17 ] . A standard STPA starts with identifying potential events that need to be prevented, termed as Losses (i.e., Step 1). It then models the interactions of the system stakeholders, which is termed Control Structure (i.e., Step 2). In the next step, any possible unsafe behaviours of each system stakeholder (extracted from the Control Structure) under various circumstances are identified, which is called Unsafe Control Actions (UCAs) in Step 3. Each UCA is then further analysed to understand its causal factors by reviewing the control loop of the controller and its interactions with other system components. STPA can identify a diverse set of causal factors, including but not limited to communication errors, flawed control algorithms, flawed processes, conflicted controls, and missing or inadequate feedback. 1.1 Research Gaps and Motivations STPA has been a promising approach to identify and address the safety concerns of a complex system. However, this means that the analysis would lead to a massive number of results, which would then require a significant amount of time and effort to manage. There has been a growing concern about the large volume of analytical outputs (i.e., UCAs and requirements) and the challenge of managing them effectively without compromising their granularity, completeness, and manageability. Since all the UCAs identified from STPA are relevant and need to be considered further, overlooking any UCA may raise critical questions about the accuracy and completeness of the results. The UCAs need to be prioritised so that the corresponding requirements can be identified and addressed first to prevent or mitigate these most critical UCAs. However, prioritising the UCAs has become a common challenge as the ranking of the UCAs can be subjective to different system stakeholders. Even if the UCAs are prioritised, there are also challenges of communicating the list of prioritised UCAs with other stakeholders due to a lack of visibility of the contributing factors for the ranking. Therefore, the motivation of this work is to resolve the following research gaps: 1. RQ1: How can we better utilize STPA results to strategically improve the system development process? 2. RQ2: How can we objectively prioritise all the UCAs from STPA? 3. RQ3: How can the prioritised UCAs be better communicated with the stakeholders? 1.2 Paper contribution and Novelty In this paper, the authors aim to present a new methodology that combines the STPA methodology and the prioritisation concept to manage a significant number of UCAs identified from a complex system. The approach maintains the ultimate analysis goal, which is to effectively eliminate identified risks across various causal factors. By considering various criteria such as severity, impact factor, and expert judgment input, it allows an effective prioritisation of UCAs and ensures that critical ones are addressed immediately. In the absence of a scientifically definitive approach for prioritisation of STPA results, empirical validation becomes crucial. To demonstrate the effectiveness of the proposed model, a case study from the aviation sector was conducted and will be presented in a later section. To identify the criteria of an ideal prioritisation framework. A study was conducted to explore existing surveys of prioritisation theory [ 18 ] . Table 1 illustrates the ideal criteria of a good prioritisation approach (left column) and how our proposed approach can fulfil these criteria (right column): Table 1: How our approach meets the criteria of an ideal prioritisation framework Criteria of an Ideal Prioritisation Framework Contribution of our Approach to the Criteria Structure problem as a hierarchy Using STPA step 2 to derive the CIF. Involve domain expert’s inputs Both inputs from STPA analysis and stakeholders Represent those inputs into significant numbers Use the Simple Additive Weighting Analyse the sensitivity to variety in judgment MCS Synthesize these results for a better visualisation of the findings Prioritisation Matrix In this paper, a new approach to address the research gaps mentioned above is introduced. In the first stage, we