First Responders’ Perceptions of Semantic Information for Situational Awareness in Robot-Assisted Emergency Response
Tianshu Ruan, Zoe Betta, Georgios Tzoumas, Rustam Stolkin, Manolis Chiou · 2025
Read First Responders’ Perceptions of Semantic Information for Situational Awareness in Robot-Assisted Emergency Response by Tianshu Ruan, Zoe Betta, Georgios Tzoumas, Rustam Stolkin, Manolis Chiou (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-16692.txt.
Introduction
Tianshu Ruan and four co-authors surveyed first responders about robots that use semantic information during emergencies. Semantic information labels what objects and places are, which helps a robot share a clear picture of a scene. The team sent a structured questionnaire to twenty-two responders in eight countries.
Most responders viewed robots positively. They rated semantic information for building awareness at an average of three point six out of five, and valued it even more for predicting surprise emergencies. Responders said they needed fairly high accuracy before trusting the output, yet still found imperfect output useful. The study records which kinds of semantic detail field teams value most.
Catalog record
| CREATOR | Tianshu Ruan, Zoe Betta, Georgios Tzoumas, Rustam Stolkin, Manolis Chiou |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 32 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2510-16692
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
First Responders’ Perceptions of Semantic Information for Situational Awareness in Robot-Assisted Emergency Response Tianshu Ruan, Zoe Betta, Georgios Tzoumas, Rustam Stolkin, Manolis Chiou Abstract This study investigates First Responders’ (FRs) attitudes toward the use of semantic information and Situational Awareness (SA) in robotic systems during emergency operations. A structured questionnaire was administered to 22 FRs across eight countries, capturing their demographic profiles, general attitudes toward robots, and experiences with semantics-enhanced SA. Results show that most FRs expressed positive attitudes toward robots, and rated the usefulness of semantic information for building SA at an average of 3.6 out of 5. Semantic information was also valued for its role in predicting unforeseen emergencies (mean 3.9). Participants reported requiring an average of 74.6% accuracy to trust semantic outputs and 67.8% for them to be considered useful, revealing a willingness to use imperfect but informative AI support tools. To the best of our knowledge, this study offers novel insights by being one of the first to directly survey FRs on semantic-based SA in a cross-national context. It reveals the types of semantic information most valued in the field—such as object identity, spatial relationships, and risk context—and connects these preferences to the respondents’ roles, experience, and education levels. The findings also expose a critical gap between lab-based robotics capabilities and the realities of field deployment, highlighting the need for more meaningful collaboration between FRs and robotics researchers. These insights contribute to the development of more user-aligned and situationally aware robotic systems for emergency response. I Introduction Extreme environments such as disaster zones, radiation-exposed areas, or structurally unstable buildings pose serious risks to human life. In these situations, First Responders (FRs) are often required to operate under high stress, with limited visibility, communication challenges, and physical danger. At the same time, robotic technologies — such as drones, ground vehicles, and other autonomous systems — are becoming increasingly accessible and capable, due to rapid advances in perception, planning, and control. Commercial applications are expanding, yet these developments have not fully translated into effective tools for FRs operating in real-world extreme conditions. Despite growing interest, a significant gap persists between laboratory robotics and field deployments. Challenges such as rugged terrain, environmental hazards (e.g., heat or radiation), and unreliable communications continue to limit the usefulness of robots in the field [ 1 ] . As robotic technology matures, it becomes increasingly important to ensure its development is informed by the needs and experiences of end-users in the field, especially FRs. Their input is critical in designing systems that can truly support them in the field. In many cases the input of firefighters has been integrated at early stages of the development of these technologies, but in some cases this is not always performed [ 2 , 3 ] . To help bridge this gap, we conducted a structured survey aimed at gathering feedback from FRs and robot operators across different mission types and backgrounds. Our methodology builds on previous work [ 4 ] , where we developed a taxonomy of semantics relevant to robotics, and in this study, we presented these concepts to FRs to gather their opinions. We asked them how semantic information, like social media-based Situational Awareness (SA) [ 5 ] , might support robotic deployments in real-world operations. The aim of this paper is twofold. First, we explore the perspectives of FRs on the challenges and demands they face when using robots in the field. Second, we investigate how our proposed semantic framework aligns with their experiences and needs. By analyzing their responses, we hope to better understand the practical role of semantic information in field robotics and identify how future research can be directed to support the real-world demands of FRs. II Related work This work aims at investigating SA, in the context of Search and Rescue (SAR). SA has been defined by Endlsey [ 6 ] as three levels - “ i) the perception of the elements in the environment within a volume of time and space, ii) the comprehension of their meaning, and iii) the projection of their status in the near future”. SA is a well-defined concept that encounters significant challenges whenever researchers try to measure the level acquired during operations [ 7 ] . The different techniques can be direct or indirect to measure different aspects of SA. This highlights a challenge in objectively determining whether a product guarantees an SA level that is adequate for the task that is to be completed. When talking about dynamic SA in the scope of human-robot teams, [ 8 ] systematically discussed the dynamic nature of team SA and the factors that affect SA. In disaster management, the problem of acquiring SA has been analyzed by several researchers. Some works propose solutions to improve SA in different applications. For example, the work from Allison et al. [ 9 ] proposes a framework to control different robots in a hazardous environment with the objective of collecting information and improving the decision-making process. Similarly, in the work proposed by Yang et al. [ 10 ] , the goal was to develop a robot able to aid in the SAR task by increasing the information collected, and consequently the SA acquired during the mission. In both of these works, the focus is on the engineering side of the solution and not on how the solution improves the SA of the end users. The effect on the SA is not measured, and the opinion of the end users has not been formally collected. Other works, such as [ 11 ] and [ 12 ] , focus more on the human aspect of the task. The work detailed in [ 11 ] focuses on the requirements of FRs for robotic deployment in a SAR scenario. On the other hand, the work from Murphy et al. [ 12 ] focuses on the collection of the challenges in rural areas for what concerns disaster management operations. Both of these works propose a series of interviews with experts in the field to gather information from FR experts. In a similar way, with our work, we propose to investigate how FRs acquire SA and if they would be open to using robots with semantic information to improve the decision-making process. III Methodology In this survey, insights and demands were collected via online questionnaires and paper questionnaire sheets. To reach field experts in different countries, the questionnaires were translated from English into Italian, Greek, and Chinese by members of our multi-national research group, by using the back-translation technique. This helps to minimize any misunderstandings caused by second-language users, particularly given the abstract concepts in the questionnaire. The questionnaire consists of three sections: Background and basic demographic information , General attitudes towards robots , and Situational awareness and use of semantic information . In the questionnaires, we investigate the FRs’ backgrounds from two key dimensions: personal information and experiences with robots. The demographic characteristics include the following features: age, gender, country, education level, roles in the team/field, experience in the field, experience with robots, and others. Next, we propose a validated questionnaire, General Attitudes Towards Robots (GAToRS) [ 13 ] , as they may affect how FRs perceive domain-specific robotics. The Italian version of the