Efficient Semi-Automated Material Microstructure Analysis Using Deep Learning: A Case Study in Additive Manufacturing
Sanjeev S. Navaratna, Nikhil Thawari, Gunashekhar Mari, Amritha V P, Murugaiyan Amirthalingam, Rohit Batra · 2026
Read Efficient Semi-Automated Material Microstructure Analysis Using Deep Learning: A Case Study in Additive Manufacturing by Sanjeev S. Navaratna, Nikhil Thawari, Gunashekhar Mari, Amritha V P, Murugaiyan Amirthalingam, Rohit Batra (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-13831.txt.
Introduction
Navaratna and co-authors present a semi-automated pipeline that segments material microstructure images with deep learning. Such images vary a lot, so hand labeling is slow and labeled data are scarce. Their workflow pairs a U-Net with an interface where experts fix labels, and those fixes retrain the model. A core-set method picks the most useful images to label. Three pick strategies are compared over six rounds on additive manufacturing data, and their SMILE strategy performs consistently well.
Catalog record
| CREATOR | Sanjeev S. Navaratna, Nikhil Thawari, Gunashekhar Mari, Amritha V P, Murugaiyan Amirthalingam, Rohit Batra |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 47143 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.13831
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Efficient Semi-Automated Material Microstructure Analysis Using Deep Learning: A Case Study in Additive Manufacturing Sanjeev S. Navaratna, Nikhil Thawari, Gunashekhar Mari, Amritha V P, Murugaiyan Amirthalingam, Rohit Batra Abstract Image segmentation is fundamental to microstructural analysis for defect identification and structure–property correlation, yet remains challenging due to pronounced heterogeneity in materials images arising from varied processing and testing conditions. Conventional image processing techniques often fail to robustly capture such complex features, rendering them ineffective for large-scale analysis. Even deep learning approaches struggle to generalize across such heterogeneous datasets owing to scarcity of high-quality labeled data. Consequently, segmentation workflows rely heavily on manual expert-driven annotations, which is labor-intensive and difficult to scale. Here, using the example additive manufacturing (AM) dataset, we present a semi-automated active learning-based segmentation pipeline that integrates a U-Net based convolutional neural network with an interactive user annotation/correction interface and a representative core-set image selection strategy. While the active learning workflow iteratively updates the model by incorporating user-corrected segmentations into the training pool, the core-set selection strategy identifies representative images to be considered in each iteration. Three subset selection strategies, i.e., manual, uncertainty-driven, and our proposed maximin Latin hypercube sampling from embeddings (SMILE) approach were evaluated over six refinement rounds with the SMILE method consistently outperforming other approaches and improving the macro F1 score from 0.74 to 0.93 on segmentation task, while reducing manual annotation time by approximately 65%. The segmented defect regions were further analyzed using a coupled classification model, which categorized defects based on their microstructural characteristics. These classified defects were then mapped to corresponding AM process parameters, enabling insights between processing and defect types. Overall, the proposed framework substantially reduces labeling effort while maintaining scalability and robustness, and is broadly applicable to image-based analysis across diverse materials systems. Keywords : Defect segmentation, Defect classification, Deep learning, Active learning, Microstructure image analysis, Additive manufacturing 1 Introduction An important goal in materials science is to understand how processing conditions influence microstructure and ultimately determine material performance [ 35 , 26 , 57 , 52 ] . Important material properties such as strength and fatigue life are strongly affected by underlying microstructural defects [ 54 ] . Porosity and lack of fusion defects often act as stress concentrators and control how failure occurs in metals, ceramics, and composites [ 3 ] . Hence accurate defect detection and classification is essential for establishing reliable structure-property relationships [ 59 ] . Microstructural characterization is commonly performed using optical and scanning electron microscopy, followed by image segmentation to quantify defect types and features (such as density, morphology, etc.) In practice, segmentation is typically carried out using classical image processing techniques such as global thresholding or Otsu’s method [ 46 ] . While effective for small and simple datasets, these approaches lack robustness under varying imaging conditions and do not scale to large, heterogeneous image databases [ 9 ] . These limitations are especially pronounced in additively manufactured (AM) materials. While additive manufacturing enables complex geometries through layer-by-layer fabrication [ 8 , 36 , 15 , 51 ] , the localized heat input and rapid solidification inherent to the process introduce defects such as porosity and lack of fusion [ 25 ] .These defects strongly influence the mechanical properties and fatigue behavior of AM components [ 19 ] , making reliable defect quantification essential for establishing meaningful process–structure-property relationships [ 19 ] . Furthermore, AM microstructures for a given material composition exhibit substantial variability in defect size, shape, and contrast, driven by changes in process parameters such as laser power and scan speed [ 61 , 18 ] , thereby making it difficult to develop a universal and robust defect detection strategy. Several prior studies have investigated defect quantification in AM materials using image based analysis and supervised learning techniques. For example, Ellendt et al. [ 14 ] developed a rule-based automated framework for pore detection that uses predefined geometric features such as area, perimeter, aspect ratio, and circularity of defects to classify and correlate them with process parameters. While this approach performs well for small datasets, its dependence on predefined geometric features limits its ability to classify complex or highly irregular defect morphologies. Altmann et al. [ 1 ] extended this approach by combining additional geometric descriptors, such as aspect ratio, circularity and solidity, with supervised machine learning (ML) models (e.g., random forest). Although this resulted in improved performance, the approach still relied on hand-crafted features and well curated training data. More recently, Wong et al. [ 60 ] introduced a U-Net–based deep learning framework for automatic segmentation of internal defects in AM components using X-ray computed tomography data. By formulating defect detection as a 2D pixel level and 3D voxel level segmentation task, their work demonstrated that CNNs can learn complex pore geometries directly from high resolution images. However, this framework was developed and validated on a single material system with a limited number of specimens and relied on labels generated using a thresholding scheme, raising concerns about model generalizability and label quality. Overall, the existing studies on defect detection or classification implicitly assume availability of sufficiently large, high quality annotated datasets [ 31 ] , which severely constrains scalability and broader adoption of these models. On a related note, models trained on a single dataset often fail to generalize across different materials, microstructures, or imaging conditions, leading to degraded performance outside the original training domain for which annotated datasets are available [ 29 ] . Another important aspect, especially in the context of AM materials, is that these approaches do not explicitly incorporate microstructural context into defect classification. Etched microstructural images provide essential complementary information such as melt pool boundaries, grain morphology, and phase contrast that is critical for accurate interpretation of defect types. For example, lack of fusion defects are commonly associated with irregular melt pool overlap near grain boundaries and partially unmelted regions, whereas porosity typically appears more circular and isolated. Thus, accurate defect classification requires models that leverage multimodal image data from both polished and etched samples. Thus, to enable efficient and scalable data-driven defect detection and classification we make following two key observations. First, annotating a diverse and representative subset of images is sufficient to capture variability in defect morphology, as many microstructural images contain redundant or overlapping defect patterns. Therefore, selecting images that span range of defect sizes, shapes, and textures can allow the model to learn the underlying defect distribution while minimizing redundant labeling effort [ 38 , 24 , 13 ] . Second, active learning approaches coupled with a human-in-the-loop framework can substantially reduce manual annotation effort by iteratively selecting the most informative samples for annotation and incorporating expert feedback into the subsequent training cycles [ 2 , 23 ] . Such approaches are particularly well suited for materials science applications, where potential candidate space is large but labeling cost is high [ 33 ] , and have previously been explored through uncertainty-based sampling strategies for segmentation tasks [ 16 ] . Based on these observations, here we present a semi-automated, two-stage pipeline for defect quantification consisting of defect detection followed by defect classification. The defect detection stage integrates an active learning framework with a U-Net based CNN, an interactive annotation interface,