Enhancing Robot Safety via MLLM-Based Semantic Interpretation of Failure Data
Aryaman Gupta, Yusuf Umut Ciftci, Somil Bansal · 2025
Read Enhancing Robot Safety via MLLM-Based Semantic Interpretation of Failure Data by Aryaman Gupta, Yusuf Umut Ciftci, Somil Bansal (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-06570.txt.
Introduction
Gupta, Ciftci, and Bansal present a study from twenty twenty-five on discovering robot failure types from deployment logs without labels. Robots in homes, cars, and workplaces fail in varied, messy ways. Hand-sorting huge failure logs does not scale for engineers. Their method first infers plain-language failure explanations from mixed sensor inputs. It then groups those explanations to find recurring failure modes. Tests span robot arms, indoor navigation, and self-driving settings. The groupings prove consistent and readable across domains.
Sorted failure types guide smarter data collection for policy fixes. They also strengthen live failure monitoring in their checks. The authors frame failure logs as a rich safety resource. A project website hosts the work.
Catalog record
| CREATOR | Aryaman Gupta, Yusuf Umut Ciftci, Somil Bansal |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 60 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-06570
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Enhancing Robot Safety via MLLM-Based Semantic Interpretation of Failure Data Aryaman Gupta, Yusuf Umut Ciftci, Somil Bansal Abstract As robotic systems become increasingly integrated into real-world environments—ranging from autonomous vehicles to household assistants—they inevitably encounter diverse and unstructured scenarios that lead to failures. While such failures pose safety and reliability challenges, they also provide rich perceptual data for improving future performance. However, manually analyzing large-scale failure datasets is impractical. In this work, we present a method for automatically organizing large-scale robotic failure data into semantically meaningful clusters, enabling scalable learning from failure without human supervision. Our approach leverages the reasoning capabilities of Multimodal Large Language Models (MLLMs), trained on internet-scale data, to infer high-level failure causes from raw perceptual trajectories and discover interpretable structure within uncurated failure logs. These semantic clusters reveal latent patterns and hypothesized causes of failure, enabling scalable learning from experience. We demonstrate that the discovered failure modes can guide targeted data collection for policy refinement, accelerating iterative improvement in agent policies and overall safety. Additionally, we show that these semantic clusters can be employed for online failure detection, offering a lightweight yet powerful safeguard for real-time adaptation. We demonstrate that this framework enhances robot learning and robustness by transforming real-world failures into actionable and interpretable signals for adaptation. https://mllm-failure-clustering.github.io/ Figure 1: A closed-loop framework for interpretable failure analysis of autonomous systems. Our method automatically discovers semantically meaningful failure modes from perception recordings without supervision, distilling them into human-understandable clusters annotated with natural language. These clusters support targeted data collection, policy fine-tuning, and real-time semantic failure detection—enabling scalable and continuous safety improvement. 1 Introduction Autonomous systems—ranging from self-driving vehicles to household robots—are increasingly deployed in open, dynamic environments. In such unstructured settings, even state-of-the-art robotic systems are prone to failures due to unexpected interactions, unmodeled dynamics, and long-tail edge cases that deviate from training distributions. Traditional validation pipelines, often grounded in simulation or controlled testing, struggle to capture the full complexity of real-world deployment, leaving many failure modes undetected until operation. A promising direction for improving robustness is to systematically learn from failures that occur during deployment. Robots naturally collect large volumes of perceptual data, including traces of both successful and failed interactions. These failure trajectories can provide valuable insights about the underlying conditions that led to safety violations, brittleness, or policy errors. However, manually curating and analyzing large-scale failure data is time-consuming and fundamentally unscalable. In this work, we propose a framework for automatically organizing failure trajectories into semantically meaningful clusters, enabling scalable, unsupervised learning from failures. Our method leverages the reasoning capabilities of MLLMs—pretrained on internet-scale vision-language data—to infer high-level failure causes directly from raw observations. By applying prompted reasoning over sequences of perceptual inputs, we identify latent structure in uncurated failure logs, grouping them into interpretable categories described in natural language. Importantly, our framework operates in a completely unsupervised manner, obviating the need for costly human annotation while still isolating nontrivial keywords and cues associated with specific error causes. The resulting semantic clusters offer multiple downstream benefits. First, they guide targeted data collection, enabling developers to focus training on critical or underrepresented failure modes. Second, these clusters can be integrated directly into online monitoring systems, providing a layer of semantic failure detection that acts as an early-warning mechanism for potential system safety violations during runtime. The semantic failure modes of the system can have many more downstream applications and use cases, e.g., targeted stress testing. Our framework not only supports large-scale, structured analysis of failure data but also emphasizes interpretability – crucial for deployment in safety-critical domains. By revealing a structured understanding of failure causes in terms amenable to human interpretation, we offer actionable insights that can help stakeholders better assess the weaknesses of deployed systems and iterate more effectively. Contributions. To summarize, our key contributions are: (a) we propose a novel framework that uses MLLMs to cluster robotic failure data into semantically meaningful groups; (b) our method infers failure causes directly from raw perceptual sequences, eliminating manual annotation or supervision; (c) we demonstrate the effectiveness of our approach on large-scale failure datasets, as well as showcase its potential for supporting downstream applications, including targeted data collection and online failure detection; (d) our framework emphasizes interpretability, generating natural language summaries and keywords for each failure mode to support human-in-the-loop diagnosis. 2 Related Works Semantic Clustering of Images with LLMs. Recent research has demonstrated the effectiveness of Vision Language Models (VLMs) and Large Language Models (LLMs) for semantic grouping of images. For example, [ 24 ] clusters images using human-specified language criteria, while [ 26 ] removes the need for manual input by discovering clustering criteria directly from unstructured image collections. Other approaches like [ 16 ] highlight key semantic differences between image sets, and [ 29 ] and [ 37 ] focus on identifying important subpopulations or selecting semantically diverse subsets for training. Our work builds on this line of research by leveraging VLMs for semantic clustering; however, we focus specifically on failure trajectories in autonomous systems rather than static images, introducing a richer temporal and causal structure to the clustering task. Text Clustering and Topic Modeling. Recent topic modeling methods can be broadly grouped into three categories. First, extensions of classical topic modeling techniques [ 40 , 44 , 25 , 8 ] like Latent Dirichlet Allocation (LDA) integrate word embeddings to enhance semantic representation [ 35 , 38 , 32 , 27 ] . Second, fully embedding-based approaches [ 7 , 11 , 41 , 6 ] that can leverage contextualized representations from pre-trained language models. Third, methods that separate the generation of the clusters from the generation of the topic representation, allowing for a flexible topic model [ 39 , 2 , 21 ] . BERTopic [ 21 ] , extends this approach by incorporating a class-based variant of Term Frequency-Inverse Document Frequency (TF-IDF). Our work differs in that we use multimodal reasoning to discover semantic failure clusters directly from visual data and language-based explanations. Failure Mining in Autonomous Systems. Falsification has emerged as a prominent methodology for uncovering failures in autonomous systems. A variety of approaches [ 23 , 18 , 12 , 19 , 14 , 45 ] have been proposed, wherein systems are tested in simulated environments with varied conditions designed to provoke failures. Such controlled testing allows researchers to identify the specific environmental parameters responsible for system breakdowns. However, while these methods effectively reveal failure scenarios tied to controlled variables, they fall short in capturing semantic failure modes of the system that require nuanced interpretation, requiring a human to manually go through those failure scenarios to identify failure modes of the system. In contrast, our approach leverages readily collected failure data to automatically discover semantic failure modes, bypassing manual human inspection. Language-based Failure Reasoning in Robotics. Recently, several studies have begun to integrate LLMs into robotic systems to generate language-based explanations of failures. For instance, [ 15 ] demonstrates the use of LLMs to generate explanations for failures in manipulation tasks, thereby improving system diagnostic capabilities. Similarly, [ 28 ] presents an LLM-based framework that not only produces informative failure explanations but also guides a language-based planner in correcting those failures for manipulation tasks. Our work extends