Identifying Uncertainty in Self-Adaptive Robotics with Large Language Models

Hassan Sartaj, Jalil Boudjadar, Mirgita Frasheri, Shaukat Ali, Peter Gorm Larsen · 2025

Read Identifying Uncertainty in Self-Adaptive Robotics with Large Language Models by Hassan Sartaj, Jalil Boudjadar, Mirgita Frasheri, Shaukat Ali, Peter Gorm Larsen (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-20684.txt.

Introduction

Hassan Sartaj and co-authors test language models as scouts for doubt in self-tuning robots in a 2025 paper. Such robots must work in fast-shift worlds. Their doubt sources are hard to list, since the systems are deep and facts are spread thin. Staff fall back on gut feel and past jobs. The team ask if models can list doubts in a set, sound way across the build life.

Ten top models faced four plant-scale robot cases. Working staff graded the model lists of doubt sources, impacts, and fixes. Staff agreed with 63 to 88 percent of the lists. They also voiced strong want for the tool in real work. The authors frame models as a strong aid, not a swap, for doubt hunts. A set scout may lift the rigor of robot design reviews.

Catalog record

CREATORHassan Sartaj, Jalil Boudjadar, Mirgita Frasheri, Shaukat Ali, Peter Gorm Larsen
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE25 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-20684

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Identifying Uncertainty in Self-Adaptive Robotics with Large Language Models Hassan Sartaj, Jalil Boudjadar, Mirgita Frasheri, Shaukat Ali, Peter Gorm Larsen Abstract Future self-adaptive robots are expected to operate in highly dynamic environments while effectively managing uncertainties. However, identifying the sources and impacts of uncertainties in such robotic systems and defining appropriate mitigation strategies is challenging due to the inherent complexity of self-adaptive robots and the lack of comprehensive knowledge about the various factors influencing uncertainty. Hence, practitioners often rely on intuition and past experiences from similar systems to address uncertainties. In this article, we evaluate the potential of large language models (LLMs) in enabling a systematic and automated approach to identify uncertainties in self-adaptive robotics throughout the software engineering lifecycle. For this evaluation, we analyzed 10 advanced LLMs with varying capabilities across four industrial-sized robotics case studies, gathering the practitioners’ perspectives on the LLM-generated responses related to uncertainties. Results showed that practitioners agreed with 63–88% of the LLM responses and expressed strong interest in the practicality of LLMs for this purpose. K eywords Self-Adaptive Systems \cdot Robotics \cdot Uncertainty \cdot Large Language Models 1 Introduction Self-adaptive robotics refers to robotic systems that autonomously adjust their behavior, configuration, or decision-making processes in response to environmental changes and unforeseen circumstances [ 1 ] . A fundamental framework for enabling self-adaptation in such systems is the MAPE-K (Monitoring, Analysis, Planning, Execution, and Knowledge) loop, which employs advanced techniques such as artificial intelligence and data analysis to allow robots to continuously collect and analyze data, plan and validate actions, execute adaptive behaviors, and refine decisions using a dynamic knowledge base [ 2 ] . At this level of autonomy, these robots must ensure dependability while effectively managing uncertainty and addressing ethical considerations to operate reliably in real-world environments. A key challenge in self-adaptive robotics is managing uncertainty throughout the entire engineering lifecycle, from initial design to active operations [ 3 ] . Uncertainty may arise from various sources, such as unpredictable environmental conditions, sensor and actuator noise, and human-robot and robot-robot interactions. Such factors directly influence a robot’s dependability, ultimately impacting its overall performance and decision-making capabilities. A crucial step in managing uncertainty within these systems is identifying the sources and potential impacts of uncertainties at early stages of the robotics software engineering lifecycle [ 3 ] . However, it is challenging due to the inherent complexity of self-adaptive robots, including their complex interactions, evolving configurations, and adaptive behaviors, as well as the lack of comprehensive knowledge about unpredictable operational contexts and environmental dynamics. Consequently, practitioners often depend on their intuition and insights from previous experiences with similar systems to identify and manage uncertainties in self-adaptive robotics. The growing adoption of large language models (LLMs) with advanced text capabilities, such as generation, analysis, and comprehension [ 4 ] , extends to various fields, including software engineering [ 5 , 6 ] . In this article, we explore LLMs’ ability to assist practitioners in identifying uncertainties when developing self-adaptive robots throughout the entire software engineering lifecycle, aiming to provide a more systematic and comprehensive approach that improves over the current practice of relying primarily on intuition and experience. To achieve this, we provided LLMs with robots’ software requirements and carefully designed prompts containing clear instructions and an uncertainty questionnaire. After obtaining and compiling responses from the LLMs, we conducted in-person sessions with the practitioners to discuss and gather their feedback. Using input provided by practitioners, we analyzed the quality, relevance, and usefulness of the uncertainties identified by LLMs. For evaluation, we selected 10 advanced LLMs with varying capabilities: Gemini Pro 1.5, Perplexity Sonar, Nemotron 70B, Nova Pro, Mistral Large 2411, LLama 3.3 70B, o1 Preview, GPT-4o, Gemini Flash 2.0, and Claude 3.5 Sonnet. We evaluated these LLMs across four real-world industrial robotics use cases: Industrial Disassembly Robot (IDR), Warehouse Robotic Swarm (WRS), Prolonged Hull of an Autonomous Vessel (PHAV), and Human-Robotic Interaction (HRI). To evaluate the LLM-generated responses regarding uncertainties, we collected feedback from the practitioners involved in each case. Results demonstrated that practitioners agreed with 65–72% of LLMs-generated responses in the IDR case, 83–88% in the WRS case, 79–86% in the PHAV case, and 63–76% in the HRI case. In addition, insights from discussions with practitioners suggested that LLMs have the potential to comprehend robots’ software requirements, provide logical responses to uncertainties, identify novel uncertainties, and demonstrate their usefulness in practical contexts. 2 Industrial Context RoboSAPIENS [ 1 ] is a European Research and Innovation project developing methods and tools for self-adaptive robotic software, enabling robots to handle unpredictability while ensuring dependability. It connects research and industry partners to create and validate self-adaptive software in real-world use cases. RoboSAPIENS implements the MAPLE-K loop (see the left side of Figure 1 ), an extension of MAPE-K introducing a Legitimate phase to ensure planned adaptations comply with safety requirements. Uncertainty is everywhere in a robot’s operations, including its environment, hardware issues, and the software implementing the MAPLE-K loop with all its phases. Thus, a systematic method is needed to identify and understand uncertainties when developing self-adaptive robotic software. Below, we briefly describe the four use cases studied in this work. 2.1 Industrial Disassembly Robot This robot focuses on disassembly tasks, specifically dismantling laptops to support refurbishment. Its first task is to unsnap the fitting of a laptop, considering variations and potential challenges of different types of laptops. Next, it unscrews the small bolts one by one, considering screw types, tightness, and destroyed screws. Finally, it removes the screen cable, where tiny pieces of tape must be removed gradually. 2.2 Warehouse Robotic Swarm This case study involves three omnidirectional mobile robots operating within an indoor delivery system. The primary focus is to ensure safe autonomous navigation through individual-level obstacle detection and fleet-level dynamic path planning while considering human presence. 2.3 Prolonged Hull of an Autonomous Vessel This case focuses on predicting the motion of autonomous vessels during their operation in real and uncertain environments to facilitate dynamic self-adaptation and better decision-making for humans in the loop. 2.4 Human-Robotic Interaction This case focuses on automating manufacturing by introducing robots as on-demand workers. The robot’s task is to load workpieces into the machine and remove them once processing is complete. Figure 1: Industrial context (left) and evaluation methodology overview (right). In the workflow, rounded rectangles indicate our activities, ovals represent individual activities by the practitioners, and hexagons denote collaborative activities. 3 Evaluation Methodology Goal: Our goal is to evaluate the effectiveness of LLMs in identifying uncertainties in self-adaptive robotics and to determine their practical value for the practitioners. Figure 1 presents an overview of our evaluation methodology, encompassing the primary workflow and interactions involving the practitioners and LLMs. Below, we elaborate on each step of the process. Step ❶ : We collected documented robotics software requirements from the practitioners. These documents included detailed descriptions of each use case scenario, clearly specifying the operational context, expected behavior, objectives, and constraints. Moreover, they explicitly outlined hardware characteristics, including details of sensors and actuators, as well as thorough software requirements defining the system architecture, functionalities, and performance expectations. Steps ❷ – ❸ : In the second step, we designed an uncertainty questionnaire inspired by existing work [ 7 ] . This questionnaire

Read the complete text