The Role of XAI in Transforming Aeronautics and Aerospace Systems
Francisco Javier Cantero, Mikel Galafate, Javier M. Moguerza, Isaac Martín de Diego, M. Teresa González De Lena, Gema Gutierrez Peña · 2024
Read The Role of XAI in Transforming Aeronautics and Aerospace Systems by Francisco Javier Cantero, Mikel Galafate, Javier M. Moguerza, Isaac Martín de Diego, M. Teresa González De Lena, Gema Gutierrez Peña (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-17440.txt.
Introduction
Aircraft and spacecraft makers now lean on AI for hard decisions, but a model that cannot explain itself is hard to trust in the air. Francisco Cantero and co-authors review explainable AI for those fields in a 2024 paper. Their aim is to close the gap between engineers and the models they fly with.
The review defines what explainable AI means and what goals it serves. It sorts model types by how open they are and lists the traits a model needs to count as transparent. It also covers after-the-fact tools that probe the choices of a trained model. The authors close with uses across aeronautics and aerospace, showing where explanations help experts judge the call of a model.
Catalog record
| CREATOR | Francisco Javier Cantero, Mikel Galafate, Javier M. Moguerza, Isaac Martín de Diego, M. Teresa González De Lena, Gema Gutierrez Peña |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 22 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2412-17440
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
The Role of XAI in Transforming Aeronautics and Aerospace Systems Francisco Javier Cantero, Mikel Galafate, Javier M. Moguerza, Isaac Martín de Diego, M. Teresa González De Lena, Gema Gutierrez Peña Abstract Recent advancements in Artificial Intelligence have transformed decision-making in aeronautics and aerospace. These advancements in Artificial Intelligence have brought with them the need to understand the reasons behind the predictions generated by Artificial Intelligence systems and models, particularly by professionals in these sectors. In this context, the emergence of eXplainable Artificial Intelligence has helped bridge the gap between professionals in the aeronautical and aerospace sectors and the Artificial Intelligence systems and models they work with. For this reason, this paper provides a review of the concept of eXplainable Artificial Intelligence is carried out defining the term and the objectives it aims to achieve. Additionally, the paper discusses the types of models defined within it and the properties these models must fulfill to be considered transparent, as well as the post-hoc techniques used to understand Artificial Intelligence systems and models after their training. Finally, various application areas within the aeronautical and aerospace sectors will be presented, highlighting how eXplainable Artificial Intelligence is used in these fields to help professionals understand the functioning of Artificial Intelligence systems and models. Preprint Article Keywords Aeronautics, Aerospace, Explainable AI, Machine Learning, Safety-Critical Applications 1 Introduction The rise and development of Artificial Intelligence and its adoption across various sectors of society has led to big advances in decision making in the governments, administrations and businesses. This development of Artificial Intelligence has led to greater awareness among humans that many of the decisions affecting their daily lives are based on the use of these algorithms or directly taken by these. Due to the relevance Artificial Intelligence systems and models have taken in our lives, the necessity of understanding the motives of the decisions taken by these models has been spread among researchers and professionals [ 1 ] . This needs to understand the reason behind the decisions comes from the difficulty of understanding the internal workings of an Artificial Intelligence system or, in other words, when trying to understand the algorithm used by a specific model [ 2 ] . In response to this situation, in 2016, the Defense Advanced Research Projects Agency, started the eXplainable Artificial Intelligence program, whose objective was to develop several methods that allowed to understand and trust in Artificial Intelligence systems. As a result, and with the objective of obtaining interpretable and transparent models, eXplainable Artificial Intelligence was developed. eXplainable Artificial Intelligence proposes the creation of a set of Machine Learning (ML) techniques that allow the creation of more explainable models maintaining a high training level to have users understand and handle Artificial Intelligence [ 3 ] . In aeronautics and aerospace sectors, the use of Artificial Intelligence systems and models has also brought about significant advancements and evolution of automation and development of tasks and processes in both fields. Along with the development of these industries, the need to know and explain the reasons for the decisions taken by Artificial Intelligence systems has also risen. Consequently, during the last decade, eXplainable Artificial Intelligence arose as a fundamental actor when developing Artificial Intelligence systems and models. Aerial Traffic Management (ATM) to control aerial traffic [ 4 ] , or the certification of critical systems that allow the evaluation of the protocols airplane pilots must carry out in critical situations [ 5 ] are some examples of eXplainable Artificial Intelligence in aeronautics. In aerospace, eXplainable Artificial Intelligence runs a fundamental role in tasks such as generation of explanations for Deep Neural Networks (DNN) used in predictive maintenance, digital twins [ 6 ] , and the anomaly detection in spacecraft telemetry [ 7 ] . The emergence of eXplainable Artificial Intelligence has promoted the use of Artificial Intelligence in many complex tasks and processes with the goal of facilitating the understanding of Artificial Intelligence systems and models. For this reason, this article defines eXplainable Artificial Intelligence and its objectives in Section 2 . In Section 3 , the properties Artificial Intelligence models must satisfy for them to be considered interpretable and transparent are defined. In Section 4 , transparent models are defined as well as the techniques applied to models that are not. Section 5 performs a review on the state-of-the-art of eXplainable Artificial Intelligence in aeronautics and aerospace, to end up with the conclusions of the work done in this article in Section 6 . 2 Definition and objectives of eXplainable Artificial Intelligence The name eXplainable Artificial Intelligence was first used when in 2016 Defense Advanced Research Projects Agency promoted the eXplainable Artificial Intelligence program. The objective of the program was to develop Machine Learning techniques that allow the creation of more explainable models while maintaining a high-performance level to have users understand and handle Artificial Intelligence [ 3 ] . Since then, numerous researchers and professionals have been working on this area, proposing definitions and objectives for eXplainable Artificial Intelligence. Among the most relevant definitions, Gunning in 2017 describes eXplainable Artificial Intelligence as “XAI will create a suite of Machine Learning techniques that enables human users to understand, appropriately trust and effectively manage the emerging generation of artificially intelligent partner” [ 3 ] . Arrieta in 2019 defined eXplainable Artificial Intelligence as “Given an audience, an explainable Artificial Intelligence is one that produces details or reasons to make its functioning clear or easy to understand.” [ 8 ] . From these definitions, it can be observed that the main objective of eXplainable Artificial Intelligence is, on the one hand, creating a set of Machine Learning techniques that produce more explainable models while maintaining an elevated level of performance. On the other hand, it also aims to allow humans to comprehend, properly trust, and efficiently manage the emergent generation of Artificial Intelligence partners [ 3 ] . To make Artificial Intelligence models comprehensible to humans, two primary categories of models are distinguished: • Black-box models are characterized by their lack of interpretability, often due to their complexity or opaque nature. These models, such as deep neural networks, operate as "black boxes", where the internal decision-making processes are not easily accessible or understandable to humans [ 9 ] . • White-box models are inherently transparent and interpretable due to their simple and accessible structure. These allow users to trace and understand the logic behind their predictions without requiring additional tools or techniques [ 10 ] . To distinguish between these two types of models, one of the objectives eXplainable Artificial Intelligence has, is to group the terms that make an Artificial Intelligence system or model clear and easy to understand. These terms had been independently studied, and eXplainable Artificial Intelligence grouped them to define a model as a white-box or a black-box model: • Interpretability can be defined as the ability to explain the meaning in understandable terms to a human [ 11 ] when talking about AI. • Explainability is the level to which a system can provide clarification about the cause of its decisions or results [ 12 ] . • Transparency is defined as the degree of understanding a model has by itself [ 10 ] . • Understandability is