From Sea to System: Exploring User-Centered Explainable AI for Maritime Decision Support
Doreen Jirak (✉), Pieter Maes, Armees Saroukanoff, Dirk van Rooy · 2025
Read From Sea to System: Exploring User-Centered Explainable AI for Maritime Decision Support by Doreen Jirak (✉), Pieter Maes, Armees Saroukanoff, Dirk van Rooy (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-15084.txt.
Introduction
Doreen Jirak, Pieter Maes, Armeen Saroukanoff, and Dirk van Rooy argue that AI tools for ships must explain themselves in ways crews can use, in a 2025 paper. Smart tools now help with steering and ship operations. At sea, where things change fast and stakes are high, crews need to know why a tool backs a choice, not just what it backs.
The authors treat good explanations as the base of strong human-machine teamwork at sea. They propose a survey built for the field to learn what sea professionals think about trust, ease of use, and clarity of AI tools. The aim is to steer future tools toward explanations that fit work on the bridge, rather than generic add-ons.
Catalog record
| CREATOR | Doreen Jirak (✉), Pieter Maes, Armees Saroukanoff, Dirk van Rooy |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 13 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-15084
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
From Sea to System: Exploring User-Centered Explainable AI for Maritime Decision Support Doreen Jirak (✉), Pieter Maes, Armees Saroukanoff, Dirk van Rooy Abstract As autonomous technologies increasingly shape maritime operations, understanding why an AI system makes a decision becomes as crucial as what it decides. In complex and dynamic maritime environments, trust in AI depends not only on performance but also on transparency and interpretability. This paper highlights the importance of Explainable AI (xAI) as a foundation for effective human-machine teaming in the maritime domain, where informed oversight and shared understanding are essential. To support the user-centered integration of xAI, we propose a domain-specific survey designed to capture maritime professionals’ perceptions of trust, usability, and explainability. Our aim is to foster awareness and guide the development of user-centric xAI systems tailored to the needs of seafarers and maritime teams. 1 Introduction The maritime industry is undergoing a profound transformation. With advances in artificial intelligence, sensor fusion, and remote operation, Maritime Autonomous Surface Ships (MASS) [ 8 ] are no longer speculative concepts but emerging realities. Maritime tasks such as remote bridge operations [ 2 ] call to redefine the roles and responsibilities of seafarers and maritime authorities alike. Yet, this shift is taking place in a domain known for its conservatism. Unlike the aviation sector, which has a long history of automation and centralized regulation, the maritime sector is highly decentralized and slow to adapt. Operational decisions at sea are shaped not only by technical constraints but also by weather conditions, team dynamics, and longstanding seafaring practices. As such, the integration of autonomous and hybrid systems into maritime operations presents a unique set of challenges. Explainable AI (xAI) offers a promising avenue to address the trust gap between maritime professionals and AI systems [ 16 ] . By making the rationale behind AI-driven decisions transparent and interpretable [ 13 ] [ 11 ] , xAI has the potential to foster user confidence and support safe collaboration between human operators and intelligent systems. In the context of daily maritime routines where adherence to the COLREGs (International Regulations for Preventing Collisions at Sea) is essential, xAI could help clarify how autonomous systems interpret these rules and adapt in real time. This paper presents the design of an empirical study aimed at evaluating maritime stakeholders’ attitudes toward explainable AI in navigational decision support systems. We aim to investigate how explainability features affect user trust, perceived usefulness, and willingness to engage with AI-assisted systems. To this end, we developed a survey-based experimental framework that includes scenario-based stimuli, pre and post-questionnaires assessing trust, openness to technology, and user satisfaction, as well as interactive elements grounded in realistic radar-based tasks. Given the ongoing nature of data collection and the potential for participant bias, this paper focuses on the conceptual framework and design rationale rather than providing detailed stimuli or full survey items. By presenting a survey framework grounded in real-world navigational scenarios, this work aims to inform the development of explainable, trustworthy AI systems tailored for the maritime domain. The results will provide early insight into human-AI interaction challenges and guide future research in the design of interpretable, regulation-compliant autonomous systems at sea. This way, we hope to create more awareness not only the human factors involved in (team) decision-making, but also to foster interdisciplinary research towards user-centered xAI. 2 Related Work The maritime sector, while historically conservative in adopting automation, is now facing a wave of technological transformation driven by advances in artificial intelligence (AI). Applications range from decision-support in navigation tasks to fully autonomous control aboard Maritime Autonomous Surface Ships (MASS) [ 8 ] . These developments promise increased operational efficiency and economic benefits, yet they also raise critical questions about how such technologies can be reasonably integrated into the complex and uncertain environment of maritime operations. For instance, a major concern remains maritime safety. Despite technological progress, human error continues to be a dominant cause of accidents at sea. A commonly cited number stating that around 80% of maritime accidents are due to human error dates back to a study released by Berg et al. [ 1 ] . However, depending on the time range and the territorial waters under investigation, these numbers fluctuate around 60% [ 5 ] and up to 96% [ 15 ] . Root causes often include cognitive fatigue, miscommunication, situational overload, or mental blocking, particularly under pressure or in dynamic team settings. These findings underscore the need to not only automate tasks, but also to complement human performance and enhance decision-making reliability in safety-critical scenarios. Therefore, the integration of AI systems in maritime contexts must go beyond technical robustness. We argue that it must be user-centered , recognizing the operational routines, domain knowledge, and lived experiences of seafarers. This calls for a holistic, interdisciplinary approach that considers both human and machine capabilities. In particular, insights from human factors research, cognitive science, neuroscience, and social psychology are essential to understand how seafarers interpret, adapt to, and interact with these emerging technologies. A central prerequisite for the transition to user-centered human-AI interaction and teaming is trust [ 12 ] . Trust in automation is not a monolithic construct but encompasses trust calibration, both cognitive trust (e.g., perceived competence, reliability, and predictability of the system) and affective trust (e.g., feelings of safety, alignment with human intentions, and emotional comfort with the system’s behavior) [ 7 ] , and trust development over time. In high-risk environments like the maritime domain, where accidents can have serious consequences, designing to enhance trust in AI systems is essential. This leads to the important aspect of how to create also trustworthy systems and interactions in the maritime sector. Unlike controlled simulations, real-world trust is developed and shaped by experience, institutional trainings, and team practices on the bridge. It is not only a matter of whether an AI system or autonomous agent makes “correct” decisions, but whether its decisions are understandable, predictable, and aligned with user expectations [ 6 ] , especially when system actions diverge from standard maritime practices. In this context, explainable AI (xAI) is a key enabler of trustworthy and effective human-AI collaboration. As deep learning models (often simply “AI”) have demonstrated superhuman performance in detection and recognition tasks, their lack of decision transparency has raised concerns. xAI addresses this by developing methods to open the, often called, “black box” of AI decision-making, enhancing transparency, interpretability, and fairness. While recent user-centered xAI has focused on increasing user trust [ 9 ] and preventing over-reliance [ 3 ] , the maritime sector has received comparatively little attention in this regard. However, a recent study by Merwe et al. [ 14 ] showed that agent transparency can potentially improve situational awareness (SAW [ 4 ] ) in seafarers but might be a function of traffic complexity and richness of the agent’s reasoning. Similarly, Madsen et al. [ 10 ] revealed that agent transparency did not improve all SAW levels uniformly and that information display needs calibration to the human cognitive resources, fostering further the need for user-centered xAI studies. To address this gap, we propose a survey-based study aimed at capturing how maritime professionals perceive explainability, trust, and usability in AI-driven decision-making systems. Our goal is