Automating AI Failure Tracking: Semantic Association of Reports in AI Incident Database
Diego Russo, Gian Marco Orlando, Valerio La Gatta, Vincenzo Moscato · 2025
Read Automating AI Failure Tracking: Semantic Association of Reports in AI Incident Database by Diego Russo, Gian Marco Orlando, Valerio La Gatta, Vincenzo Moscato (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-23669.txt.
Introduction
Diego Russo, Gian Marco Orlando, Valerio La Gatta, and Vincenzo Moscato automate, in a 2025 preprint, the filing work behind a public database of AI failures. The AI Incident Database holds over three thousand reports of real harm from AI systems. Each new report must be matched by hand to the incident it belongs to. That manual step slows the hunt for fresh failure patterns. The authors frame filing as a ranking task. A report's text is compared with past incidents by meaning, using embedding models.
They test word-matching methods, cross-encoders, and sentence embedding models against each other. The embedding models win clearly. Using both the title and the full text beats titles alone by a wide margin. Longer reports do not hurt accuracy. More training data keeps helping. The authors offer the system as a scalable way to keep the database current, so failure trends surface sooner.
Catalog record
| CREATOR | Diego Russo, Gian Marco Orlando, Valerio La Gatta, Vincenzo Moscato |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 39 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-23669
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Automating AI Failure Tracking: Semantic Association of Reports in AI Incident Database Diego Russo, Gian Marco Orlando, Valerio La Gatta, Vincenzo Moscato Abstract Artificial Intelligence (AI) systems are transforming critical sectors such as healthcare, finance, and transportation, enhancing operational efficiency and decision-making processes. However, their deployment in high-stakes domains has exposed vulnerabilities that can result in significant societal harm. To systematically study and mitigate these risk, initiatives like the AI Incident Database (AIID) have emerged, cataloging over 3,000 real-world AI failure reports. Currently, associating a new report with the appropriate AI Incident relies on manual expert intervention, limiting scalability and delaying the identification of emerging failure patterns. To address this limitation, we propose a retrieval-based framework that automates the association of new reports with existing AI Incidents through semantic similarity modeling. We formalize the task as a ranking problem, where each report—comprising a title and a full textual description—is compared to previously documented AI Incidents based on embedding cosine similarity. Benchmarking traditional lexical methods, cross-encoder architectures, and transformer-based sentence embedding models, we find that the latter consistently achieve superior performance. Our analysis further shows that combining titles and descriptions yields substantial improvements in ranking accuracy compared to using titles alone. Moreover, retrieval performance remains stable across variations in description length, highlighting the robustness of the framework. Finally, we find that retrieval performance consistently improves as the training set expands. Our approach provides a scalable and efficient solution for supporting the maintenance of the AIID. † † paperid: 123 † † orcid: 0009-0007-1095-5168 † † orcid: 0009-0004-7136-1804 † † orcid: 0000-0002-5941-4684 † † orcid: 0000-0002-0754-7696 1 Introduction Artificial Intelligence (AI) systems are increasingly deployed across high-stakes domains, where their decisions significantly impact human lives and societal structures. In healthcare, they have improved diagnostic accuracy and accelerated treatment workflows [ Chaurasia et al.(2022)Chaurasia, Greatbatch, and Hewitt , Chopra et al.(2023)Chopra, Shin, Munjal, Dhama, Emran, et al. , Zhao et al.(2024)Zhao, Liu, Zhang, Yu, and Guo ] . Financial institutions leverage AI for credit scoring, fraud detection, and algorithmic trading, achieving gains in efficiency and risk management [ Addy et al.(2024)Addy, Ajayi-Nifise, Bello, Tula, Odeyemi, and Falaiye , Bello et al.(2023)Bello, Ogundipe, Mohammed, Adebola, and Alonge , Cohen(2022) , Diaconescu and Neagoe(2020) ] . AI also underpins key capabilities in autonomous transportation [ Dartmann et al.(2021)Dartmann, Schmeink, Lücken, Song, Ziefle, and Prestiflippo ] , criminal justice systems [ Rigano(2019) ] , large-scale content moderation [ Gillespie(2020) ] , and military operations, where it supports surveillance, target recognition, and mission planning [ Kase et al.(2022)Kase, Hung, Krayzman, Hare, Rinderspacher, and Su ] . However, real-world deployments have shown that AI systems can fail in unpredictable, opaque, and sometimes harmful ways, especially when deployed at scale. For instance, the use of machine learning to support clinical decision-making has been shown to exacerbate existing health disparities, with certain models underperforming for specific demographic groups [ Pfohl et al.(2021)Pfohl, Foryciarz, and Shah ] . Similarly, in the financial sector, AI-driven credit scoring systems have inadvertently resulted in discriminatory outcomes against minority populations [ Hurley and Adebayo(2016) ] . Additional failures span from accidents involving autonomous driving systems 1 1 1 https://incidentdatabase.ai/cite/23/ to wrongful arrests caused by facial recognition misidentifications 2 2 2 https://incidentdatabase.ai/cite/74/ , emphasizing the potential of AI to reinforce systemic biases, including racism 3 3 3 https://incidentdatabase.ai/cite/60/ and misogyny 4 4 4 https://incidentdatabase.ai/cite/47/ . Given the growing evidence of AI failures across diverse application domains, there is a critical need to systematically document and study these incidents to prevent their recurrence and support the development of safer, more reliable systems. Similar to long-established safety infrastructures in aviation and cybersecurity (e.g., FAA, NASA ASRS, CVE), the AI Incident Database (AIID) was established as a structured repository of real-world failures involving AI technologies [ McGregor(2021) ] . By cataloging detailed incident reports, AIID promotes transparency, accountability, and continuous improvement in AI development. Maintained by a coalition of academic, industrial, and non-profit stakeholders, the database currently hosts over 3,000 curated reports, enabling systematic investigation of failure patterns with the goal of reducing the likelihood that similar failures recur. At the core of the AIID is the concept of AI Incident , an alleged harm or near-harm event in which an AI system is implicated [ McGregor et al.(2022)McGregor, Paeth, and Lam ] . Each incident is typically described through one or more reports — narrative accounts derived from journalistic sources, academic literature, or institutional investigations — which provide details about the context, causes, consequences, and actors involved. These reports consist of a title and a free-text description, both of which can vary considerably in length and level of detail, and are complemented by structured metadata such as system functionality, affected stakeholders, and harm types. However, when a new report is submitted to the AIID, its association with an existing AI Incident is still handled manually by human editors [ Paeth et al.(2024)Paeth, Atherton, Pittaras, Frase, and McGregor ] . This reliance on manual expert intervention poses a scalability bottleneck as the volume of incident reports continues to grow, and it introduces potential inconsistencies due to subjective judgment in the classification process. Moreover, the lack of automation limits the ability to rapidly analyze emerging failure patterns across related incidents. In this work, we address this gap by proposing a method to assist AIID curators in the task of automatically linking newly submitted reports to existing AI Incidents . Specifically, we frame the problem as a retrieval task: the textual content of each report — including its title and description — is compared to previously recorded AI Incidents through semantic similarity-based ranking. The goal is to rank historical incidents based on their semantic relevance to the new report. To assess the robustness and generalizability of our approach, we systematically evaluate ranking performance under a variety of conditions — including different input representations (e.g., title only vs. title and description), variations in description length, and temporal dynamics. To operationalize our investigation, we formulate the following research questions (RQs): RQ1: Does leveraging both the report’s title and description improve retrieval performance? RQ2: Does the length of a report’s description affect the robustness of retrieval performance? RQ3: How does retrieval performance change as the size of the training data increases? To answer these questions, we first conduct comprehensive experiments using both traditional lexical baselines and modern transformer-based sentence embedding models. Our findings demonstrate that sentence transformer models consistently outperform all other approaches. After identifying the best-performing model ( multi-qa-MiniLM-L6-cos-v1 ), we systematically addressed the three RQs. First, we find that while titles alone carry meaningful semantic information, incorporating full descriptions significantly improves retrieval performance, with an average gain of 15–25 percentage points in ranking metrics. Second, our analysis shows that shorter descriptions slightly outperform longer ones, although the performance differences are minimal, suggesting that our system is robust to variations in description length. Finally, we show that retrieval performance steadily improves as the size of the training data increases. These findings highlight the feasibility and robustness of automating the linking of new reports to existing AI Incidents , paving the way for more scalable and consistent maintenance of the AI Incident Database. 2 Related Works This section reviews prior work relevant to our