Towards trustworthy AI in materials mechanics through domain-guided attention
Jesco Talies, Eric Breitbarth, David Melching · 2025
Read Towards trustworthy AI in materials mechanics through domain-guided attention by Jesco Talies, Eric Breitbarth, David Melching (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-20658.txt.
Introduction
Jesco Talies, Eric Breitbarth, and David Melching present a training method for trustworthy AI in a 2025 arXiv paper. Their test task is marking crack tips in image data used to study how materials fracture. Deep models can be accurate yet hard to trust in high-stakes science.
Their method, attention-guided training, feeds expert checks of the model's focus back into training. Explanations are scored, and known stress field patterns guide where the model should look. Aligning focus with these physical fields improved the model's reach to new cases. The explanations also grew more faithful to the real physics.
Catalog record
| CREATOR | Jesco Talies, Eric Breitbarth, David Melching |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 56 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-20658
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Towards trustworthy AI in materials mechanics through domain-guided attention Jesco Talies, Eric Breitbarth, David Melching Abstract Ensuring the trustworthiness and robustness of deep learning models remains a fundamental challenge, particularly in high-stakes scientific applications. In this study, we present a framework called attention-guided training that combines explainable artificial intelligence techniques with quantitative evaluation and domain-specific priors to guide model attention. We demonstrate that domain specific feedback on model explanations during training can enhance the model’s generalization capabilities. We validate our approach on the task of semantic crack tip segmentation in digital image correlation data which is a key application in the fracture mechanical characterization of materials. By aligning model attention with physically meaningful stress fields, such as those described by Williams’ analytical solution, attention-guided training ensures that the model focuses on physically relevant regions. This finally leads to improved generalization and more faithful explanations. Keywords— Deep learning, attention-guided training, explainability, XAI, quantitative evaluation metrics, domain knowledge, fracture mechanics, digital image correlation 1 Introduction Deep learning (DL) has led to enormous breakthroughs in many scientific fields, from computer vision [ 1 ] to biology [ 2 ] , material science [ 3 , 4 , 5 ] , computational mechanics [ 6 ] , and fracture mechanics [ 7 , 8 ] because of its ability to identify patterns in complex, high-dimensional data. DL is based on the training of a highly flexible deep neural network, consisting of millions of trainable parameters, with large amounts of data. While typically improving performance, deep neural networks are trained end-to-end and lack interpretability and explainability. This black-box problem raises critical questions regarding reliability and trustworthiness, in particular in high-risk and high-stakes applications such as autonomous vehicles and robots, healthcare, or maintenance of aircraft systems and components. These considerations have been recently recognized as a legal issue in guidelines issued by the EU AI Act [ 9 ] and more specifically for aerospace applications by EASA [ 10 ] and NASA [ 11 ] . Explainable artificial intelligence (XAI) [ 12 ] addresses these issues by proposing processes and methods that provide insights into the decision-making processes of DL models. There are two approaches to XAI: on the one hand, one can aim to achieve intrinsic interpretability by designing inherently transparent models that are human-understandable [ 13 ] . On the other hand, post-hoc explainability seeks to clarify model predictions without modifying the internal model structure, utilizing techniques that shed light on the decision-making process of black-box models [ 14 , 15 , 16 ] . While models designed for intrinsic interpretability offer clarity, they often lack the complexity needed to capture intricate data patterns, which can result in suboptimal performance. This trade-off between interpretability and accuracy is particularly evident in complex tasks tackled with DL, where simpler models do not suffice. For convolutional neural networks (CNNs), a class of DL models used mainly for spatial, grid-like data, post-hoc explanations in the form of attention heatmaps based on class activation mappings (CAM) [ 17 ] have gained wide popularity. While originally only designed for classification tasks, CAM-based methods have recently been extended to semantic segmentation architectures [ 18 , 19 ] . Despite their success, post-hoc explainability also faces criticism for producing explanations that can be misleading or unfaithful to the original black-box model or may oversimplify complex relationships [ 20 ] . Moreover, even when focusing solely on CAM-based approaches, there is a vast array of methods [ 21 , 22 , 23 , 24 , 25 , 26 , 27 ] , making it challenging to determine which method is best suited for a given model and task. To address these concerns, researchers have called for rigorous, standardized metrics to quantitatively evaluate XAI methods. Vilone & Longo [ 28 ] propose a hierarchical classification of XAI methods and conceptualize their evaluation, also pointing out that research currently lacks a consensus on how to assess explainability. Nauta et al. [ 29 ] propose conceptual properties such as correctness (i.e. faithfulness), completeness, and compactness to measure, among others, how well explanations align with the true behavior of a model and how effectively they convey relevant information to users. Moreover, recent work has explored novel approaches which incorporate explanations into the training process. Some methods integrate human-based [ 30 , 31 , 32 ] feedback on explanations, showing that interacting and reflecting upon model explanations can prevent bias, improve accuracy, and reduce required training samples. However, relying on human interaction is tedious and time-consuming, and particularly for specific tasks, it requires experts with domain knowledge. Recently, Stammer et al. [ 33 ] instead sourced explanatory feedback from a secondary critic model. Although their results show improved model generalization and provide more faithful explanations, it does not allow for the explicit inclusion of known concepts and domain knowledge. Figure 1: Overview of attention-guided training (AGT); AGT builds upon conventional machine learning principles, providing enhancements through explainable artificial intelligence (XAI) techniques. It incorporates post-hoc explanations and objective XAI evaluation metrics to assess model explainability and integrates domain knowledge through a modified training loop, ensuring better alignment between trained patterns and expert insights. Addressing these challenges, this paper introduces a framework that integrates faithful explanations and domain knowledge directly into the model training process. We call this framework attention-guided training (AGT). The framework is shown in Figure 1 and enables the determination of trustworthy explanations and provides alignment with domain knowledge during training. The framework starts with the identification of relevant expert knowledge for a specific task, which should be tackled by DL. Then, suitable explainability methods are identified and evaluated using objective metrics. Lastly, the core of AGT is a novel training process where the task-specific classical loss function is combined with an additional loss, which assesses the alignment of the explanation with domain-specific expectations. While AGT serves as a general framework, its development was inspired by the findings of Melching et al. [ 19 ] ; hence, we focus on its specific application in the field of fracture mechanics. In [ 19 ] , the authors employ the explainability method Grad-CAM [ 21 ] for the semantic segmentation of fatigue crack tips in digital image correlation data. They train models with different architectures, including a U-Net [ 34 ] and the so-called ParallelNets approach [ 19 ] . The resulting model explanations exhibit distinct semantic characteristics, as illustrated in Figure 2 . While the U-Net primarily highlights the crack path, the ParallelNets explanations align more closely with the physical crack tip field described by Williams [ 35 ] . Despite the improved generalization capabilities of the latter approach, a framework that explicitly controls network attention during training remains absent. In this work, we present an attention-guided training of a U-Net model for crack tip segmentation in digital image correlation data. First, we adapt existing CAM-based XAI methods to semantic segmentation models. Next, we systematically evaluate their suitability for the given task by assessing correctness, completeness, continuity, and compactness, as proposed by Nauta et al. [ 29 ] , and select the most appropriate XAI method accordingly. Finally, as AGT leverages domain knowledge to guide the training process and align model explanations with a predefined target, we calculate