Unsupervised anomaly detection in MeV ultrafast electron diffraction

Mariana A. Fazio, Salvador Sosa Güitron, Marcus Babzien, Mikhail Fedurin, Junjie Li, Mark Palmer, Sandra S. Biedron, Manel Martinez-Ramon · 2025

Read Unsupervised anomaly detection in MeV ultrafast electron diffraction by Mariana A. Fazio, Salvador Sosa Güitron, Marcus Babzien, Mikhail Fedurin, Junjie Li, Mark Palmer, Sandra S. Biedron, Manel Martinez-Ramon (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-13702.txt.

Introduction

Mariana Fazio and seven co-authors clean up ultrafast diffraction data in twenty twenty-five. MeV ultrafast electron diffraction watches materials change structure in real time. A laser pulse triggers the change and an electron beam probes it. Low signal forces averaging over thousands of shots.

Shot-to-shot beam instabilities distort some patterns in that average. Finding and removing the anomalous patterns improves accuracy. Their method is fully unsupervised, needing no labeled examples. A convolutional autoencoder rebuilds each diffraction pattern. Patterns with high reconstruction error are flagged as anomalous by statistical analysis. Readers in ultrafast science get data hygiene that keeps rare bad shots from blurring fast structural movies.

Catalog record

CREATORMariana A. Fazio, Salvador Sosa Güitron, Marcus Babzien, Mikhail Fedurin, Junjie Li, Mark Palmer, Sandra S. Biedron, Manel Martinez-Ramon
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE27 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-13702

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Unsupervised anomaly detection in MeV ultrafast electron diffraction Mariana A. Fazio, Salvador Sosa Güitron, Marcus Babzien, Mikhail Fedurin, Junjie Li, Mark Palmer, Sandra S. Biedron, Manel Martinez-Ramon Abstract Abstract I Introduction MeV ultrafast electron diffraction (MUED) is a pump-probe characterization technique for studying ultrafast processes in materials. The use of relativistic beams leads to decreased space-charge effects compared to typical ultrafast electron diffraction experiments employing energies in the keV range Wang et al. 2003 ; Zhu et al. 2015 . Compared to other ultrafast probes such as X-ray free electron lasers, MUED has a higher scattering cross section with material samples and allows access to higher order reflections in the diffraction patterns due to the short electron wavelengths. However, this is a relatively young technology and several factors contribute to making it challenging to utilize, such as beam instabilities which can lower the effective spatial and temporal resolution. In the past years, machine learning (ML) approaches to materials and characterization techniques have provided a new path towards unlocking new physics by improving existing probes and increasing the user’s ability to interpret data. In particular, ML methods can be employed to control characterization probes in near-real time, acting as virtual diagnostics, or ML can be deployed to extract features and effectively denoise acquired data. In this later case, convolutional neural network architectures such as autoencoder models are an attractive and more powerful .. ML has yet to be applied to the MUED technique, where it can certainly enable advances that can further our understanding of ultrafast material processes in a variety of systems. This study focus in the construction of an unsupervised anomaly detection methodology to detect faulty images in MUED. We believe that unsupervised techniques are the best choice for our purposes because the data used to train the detector does not need to be manually labeled, and instead, the machine is intended to detect by itself the anomalies in the dataset, which liberates the user of tedious, time-consuming initial image examination. The structure must, additionally, provide the user with some measure of uncertainty in the detection, so the user can take decisions based on this measure. If most images have a low uncertainty in the decision, the user may decide to manually examine a few images not confidently detected by the algorithm or directly throw them away to eliminate the associated risk of using them. Non supervised methods can be roughly grouped in density-based, bagging, deep learning or kernel methods. The residual methods can use some of the above-mentioned techniques. Density based methods are those that estimate a compact observation model and from it a likelihood of these observations can be inferred. Then, the anomalous nature of a sample can be judged from this measure. In Goldstein and Dengel 2012 histograms are used for this purpose and in Breunig et al. 2000 dissimilarity measures between samples are computed to determine whether a sample is an outlier or not. The k-nearest neighborhood strategy is used in Ramaswamy et al. 2000 ; Angiulli and Pizzuti 2002 to provide an approximate measure of likelihood. The bagging models use an ensemble of detectors constructed with bagging or data subsampling Lazarevic and Kumar 2005 ; Aggarwal and Sathe 2015 . In the field of deep learning we find methods that are also non-supervised and that are intended to process the data to reduce its dimensionality in what is called a bottleneck while preserving its distribution properties. These approaches are convenient when the dimension of the data is very high, as it is the case of images. The autoencoder model Hinton and Salakhutdinov 2006 is used for this purpose in Sakurada and Yairi 2014 ; Chen et al. 2017 . Generative adversarial networks Goodfellow et al. 2020 are applied for anomaly detection in Liu et al. 2019 . Deep learning is useful when the number of data is high, but when the number of samples is low, we may take into consideration the use of kernel methods Shawe-Taylor et al. 2004 . See, for example, the applications for outlier detection in Hardin and Rocke 2004 or Shyu et al. 2003 . The latter uses an autoencoder together with nonlinear dimensionality reduction with the help of kernel methods. One of the most prominent kernel method for anomaly detection is perhaps the OC-SVM Schölkopf et al. 2001 , that makes use of the maximum margin criterion Vapnik 2013 , which effectively imposes a balance between the training error and the expressive capacity of the machine, reducing the overfitting when the number of samples is low. The OC-SVM is, besides, a non-supervised methodology. The Support Vector Data Description (SVDD) in Tax and Duin 2004 is based in the same criterion. Residual methods are based on the examination of the prediction error over the sample under test. If a given variable that is observable can be inferred from the sample, then the prediction error can be measured. If the sample is anomalous, it is expected that it will produce a high error or residual. The determination of whether the residual is high or not can be achieved by a model of the residual distribution (see, e.g. Zamzam et al. 2019 ). Our approach combines the use of an autoencoder and a residual method. Indeed, the method encodes and reconstructs the images with the help of a convolutional autoencoder (CAE) Mao et al. 2016 and then, the reconstruction error is used as a residual to estimate the posterior probability of that the image is normal conditional to the observed error. The error is modeled in a probabilistic way using a convex combination of distributions that automatically capture the conditional distribution of the error under the hypothesis of normal or fault. II Experimental Methods The MUED instrument is located in the Accelerator Test Facility at Brookhaven National Laboratory. A schematic representation of the experimental setup is presented in Fig. 1 . The femtosecond electron beams are generated using a frequency-tripled Ti:Sapphire laser that illuminates a copper photocathode generating a high brightness beam. The electrons are then accelerated and compressed in a 1.6-cell RF cavity achieving energies up to 5 MeV. Current parameters of the electron beam source optimized for stability are presented in Table 1 . The sample chamber is located downstream from the source with a motorized holder for up to nine samples with cryogenic cooling capabilities and a window to allow laser pumping of the material. Next to the chamber a RF deflecting cavity is located and 4 m downstream the detector system is placed to collect the diffraction patterns. The detector consists of a phosphor screen followed by a copper mirror (with a hole for non-diffracted electrons to pass) and a CCD Andor camera of 512 pixels x 512 pixels with a large aperture lens. Suitable material systems for MUED require careful preparation with typical lateral sizes of 100 - 300 \mu m and roughly ¡ 100 nm thickness to assure electron transparency. Laser fluency is adjusted to avoid radiation-induced damage of the probed material. Figure 1 : Schematic representation of the experimental setup for the MUED instrument located in the Accelerator Test Facility at Brookhaven National Laboratory. Table 1 : MUED source parameters for typical operation Beam

Read the complete text