A Foundation Model for Non-Destructive Defect Identification from Vibrational Spectra

Mouyang Cheng, Chu-Liang Fu, Bowen Yu, Eunbi Rha, Abhijatmedhi Chotrattanapituk, Douglas L Abernathy, Yongqiang Cheng, Mingda Li · 2025

Read A Foundation Model for Non-Destructive Defect Identification from Vibrational Spectra by Mouyang Cheng, Chu-Liang Fu, Bowen Yu, Eunbi Rha, Abhijatmedhi Chotrattanapituk, Douglas L Abernathy, Yongqiang Cheng, Mingda Li (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-00725.txt.

Introduction

Mouyang Cheng and co-authors train a foundation model in a 2025 paper that reads defects in crystals from their vibration patterns. Defects rule much of a material's strength and function, yet finding them without destroying the sample is a long-standing problem, above all when several defect types mix. Their model, DefectNet, works from a phonon spectrum, a fingerprint of how the crystal vibrates.

The model was trained on more than sixteen thousand simulated spectra drawn from two thousand semiconductors. A tailored attention step lets it name up to six distinct defect elements at once and give each one's share, from a trace to a quarter of the sites. It carries well to crystals it never saw, across a wide span of elements. It can also be tuned on real lab data, a step toward bench use.

Catalog record

CREATORMouyang Cheng, Chu-Liang Fu, Bowen Yu, Eunbi Rha, Abhijatmedhi Chotrattanapituk, Douglas L Abernathy, Yongqiang Cheng, Mingda Li
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE33 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-00725

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

A Foundation Model for Non-Destructive Defect Identification from Vibrational Spectra Mouyang Cheng, Chu-Liang Fu, Bowen Yu, Eunbi Rha, Abhijatmedhi Chotrattanapituk, Douglas L Abernathy, Yongqiang Cheng, Mingda Li Abstract Defects are ubiquitous in solids and strongly influence materials’ mechanical and functional properties. However, non-destructive characterization and quantification of defects, especially when multiple types coexist, remain a long-standing challenge. Here we introduce DefectNet, a foundation machine learning model that predicts the chemical identity and concentration of substitutional point defects with multiple coexisting elements directly from vibrational spectra, specifically phonon density-of-states (PDoS). Trained on over 16,000 simulated spectra from 2,000 semiconductors, DefectNet employs a tailored attention mechanism to identify up to six distinct defect elements at concentrations ranging from 0.2% to 25%. The model generalizes well to unseen crystals across 56 elements and can be fine-tuned on experimental data. Validation using inelastic scattering measurements of SiGe alloys and MgB 2 superconductor demonstrates its accuracy and transferability. Our work establishes vibrational spectroscopy as a viable, non-destructive probe for point defect quantification in bulk materials, and highlights the promise of foundation models in data-driven defect engineering. Introduction Defects play a pivotal role in materials science, profoundly influencing physical properties and ultimately determining device performance across a wide range of technological applications [ 1 ] . The atomic-scale defects are central to the functionality of materials, including solar cells [ 2 ] , thermoelectrics [ 3 , 4 ] , electrode materials in batteries [ 5 ] , catalysts [ 6 ] , and quantum materials [ 7 , 8 , 9 ] . Historically, the study of defects in semiconductors has received considerable attention since the 1950s, due to their critical impact on electronic and optical properties. For instance, controlled doping in silicon enables tunable carrier concentrations [ 10 ] , which are instrumental to transistor operation and microelectronics. Similarly, defect engineering in ultrawide bandgap semiconductors enhances their potential for next-generation power electronics [ 11 ] . More recently, precise defect control, including doping, has emerged as a key enabler for quantum materials. In high-temperature superconductors, optimal superconductivity is achieved only within a range of hole-type doping concentrations [ 12 , 13 ] . In flat-band systems, tuning the Fermi level via doping can unlock strongly correlated phases [ 14 , 15 ] . Topological materials further highlight this sensitivity. In topological insulators and Weyl semimetals, quantum states such as the quantum anomalous Hall effect [ 16 , 17 ] or large Berry curvature-induced responses [ 18 , 19 ] only manifest when the Fermi level is precisely tuned through defect or dopant engineering. The importance of point-defect engineering in functional materials, such as semiconductors and quantum materials, creates an urgent need for characterization methods that can accurately quantify the types and concentrations of defects. However, despite the variety of defect characterization techniques, significant limitations remain in terms of sensitivity, selectivity, quantifiability, and destructiveness. For sensitivity, methods such as diffraction and diffuse scattering primarily respond to large-scale microstructures and inhomogeneities, but not to isolated point defects. Regarding selectivity, positron annihilation spectroscopy (PAS) is highly sensitive only to vacancy-type defects [ 20 ] . Techniques like deep-level transient spectroscopy (DLTS) [ 21 ] , nuclear magnetic resonance (NMR) [ 22 ] and electron paramagnetic resonance (EPR) [ 23 ] offer exceptional sensitivity to low-concentration defects, but are only selective to electrically active trap states (for DLTS), specific isotopes (for NMR), or without chemical specificity (EPR). As to quantification, optical probes such as photoluminescence (PL) [ 24 ] , cathodoluminescence (CL) [ 25 ] , Raman and infrared (IR) spectroscopy [ 26 ] , along with X-ray probes like energy-dispersive X-ray spectroscopy (EDS), X-ray absorption spectroscopy (XAS) and X-ray photoelectron spectroscopy (XPS) [ 27 ] are responsive to point defects, but often struggle to accurately quantify their concentrations, particularly in the presence of multiple coexisting defect species. Regarding destructiveness, imaging methods such as transmission electron microscopy (TEM) [ 28 ] and atom probe tomography (APT) [ 29 ] provide direct 2D and 3D visualization of defects, but require invasive sample preparation and are inherently destructive. Given these constraints, it would be highly desirable to develop characterization techniques that can accurately determine both the chemical identity and concentration of point defects with high sensitivity, broad chemical selectivity, and in a non-destructive manner. In this work, we demonstrate that vibrational spectroscopy that measures PDoS, when integrated with machine learning, offers a promising route toward non-destructive characterization and quantification of point defects in bulk solids. We introduce DefectNet, a foundational machine learning model designed to infer both the chemical identity and concentration of point defects in solid-state materials from vibrational spectra. DefectNet takes as input the PDoS of pristine and defective crystals and outputs the defect chemical species and concentrations for up to six types of substitutional defects that coexist. To accommodate prior knowledge, DefectNet is flexibly designed to integrate initial guesses of candidate defect species, whether provided by the user or generated by an automated recommender. DefectNet addresses three key challenges. First, conventional atom-by-atom representations are inefficient across diverse materials with defects. We overcome this with the impurity-averaged configuration (IAC) representation, an encoding inspired by impurity average procedures in quantum field theory [ 30 , 31 , 32 ] . Second, at low concentrations, defective and pristine phonon spectra can appear nearly identical. To resolve this, we incorporate a spectral attention mechanism that enhances sensitivity to subtle perturbations. Third, the high cost of density functional theory (DFT)-based phonon simulations limits high-throughput data generation. We mitigate this by using machine-learning interatomic potentials (MLIPs) [ 33 , 34 , 35 , 36 ] for efficient, high-fidelity vibrational spectra in broad chemical spaces. Trained on a dataset comprised of 16,000 simulated PDoS spectra derived from 2,000 distinct parent semiconductor materials, DefectNet accurately predicts defect types and concentrations as low as 0.2%. We further demonstrate that DefectNet can be fine-tuned using experimental inelastic neutron scattering (INS) data to recover Ge concentrations in SiGe alloys, as well as Al doping in MgB 2 superconductors. DefectNet marks an initial step toward general-purpose, non-destructive defect characterization and quantification from vibrational spectra, enabling systematic characterization and guiding rational defect engineering through high-throughput simulation and machine learning. Results Defect representation with impurity-averaged configuration We start by introducing the defect representations in our model. Inspired by the fact that defects are normally modeled as perturbations on the crystal structure, we split atomic embeddings into \{f_{j\theta}\} for crystalline sites and \{g_{j\alpha\theta}\} for defect sites. Here, j is the atom index, \alpha represents the defect type, and \theta indicates that all these embeddings are learnable features. These features can be learned by performing an ensemble average on multiple atomic features. For example, for feature vector \vec{f_{j}}=(1,Z_{j},m_{j},s_{j},r_{j},...) , which may include physical quantities such as charge number Z_{j} , mass number m_{j} , spin s_{j} , and radius r_{j} , the atomic embedding can be expressed as f_{j\theta}=\text{Embed}_{\theta}(1,Z_{j},m_{j},s_{j},r_{j},...) (1) i.e., all input features of atom j are optimized for their embedding mixture by an ensemble embedding layer \text{Embed}_{\theta} [ 37 ] . Similarly, \vec{g}_{j\alpha} denotes the feature vector of a defect atom of type \alpha at location \mathbf{R}_{j\alpha} , with the same embedding procedure as \vec{f}_{j} . Subsequently, to define the complete

Read the complete text