Machine Learning–Augmented Acceleration of Iterative Ptychographic Reconstruction

Bowen Zheng 1 , Katayun Kamdin 1 , David Shapiro 1 , Alexander Ditter 1 , Dayne Sasaki 1,2 , Emma Bernard 3 , Roopali Kukreja 3 , Petrus H. Zwart 4,5,6 , Slavomír Nemšák 1,7 , Apurva Mehta 8 , Nicholas Schwarz 9 , Alexander Hexemer 1 , Tanny Chavez 1,* 1 Advanced Light Source, Lawrence Berkeley National Laboratory, Berkeley, CA 94720, USA 2 Department of Physics, Massachusetts Institute of Technology, Cambridge, MA 02139, USA 3 Department of Materials Science and Engineering, University of California Davis, Davis, CA 95616, USA 4 Center for Advanced Mathematics for Energy Research Applications, Lawrence Berkeley National Laboratory, Berkeley, CA 94720, USA 5 Molecular Biophysics and Integrated Bioimaging Division, Lawrence Berkeley National Laboratory, Berkeley, CA 94720, USA 6 Berkeley Synchrotron Infrared Structural Biology Program, Lawrence Berkeley National Laboratory, Berkeley, CA 94720, USA 7 Department of Physics and Astronomy, University of California, Davis, Davis, CA 95616, USA 8 Linac Coherent Light Source (LCLS), SLAC National Accelerator Laboratory, Menlo Park, CA 94205, USA 9 Argonne National Laboratory, 9700 South Cass Avenue, Lemont, IL 60439, USA * [email protected] · 2026

Read Machine Learning–Augmented Acceleration of Iterative Ptychographic Reconstruction by Bowen Zheng 1 , Katayun Kamdin 1 , David Shapiro 1 , Alexander Ditter 1 , Dayne Sasaki 1,2 , Emma Bernard 3 , Roopali Kukreja 3 , Petrus H. Zwart 4,5,6 , Slavomír Nemšák 1,7 , Apurva Mehta 8 , Nicholas Schwarz 9 , Alexander Hexemer 1 , Tanny Chavez 1,* 1 Advanced Light Source, Lawrence Berkeley National Laboratory, Berkeley, CA 94720, USA 2 Department of Physics, Massachusetts Institute of Technology, Cambridge, MA 02139, USA 3 Department of Materials Science and Engineering, University of California Davis, Davis, CA 95616, USA 4 Center for Advanced Mathematics for Energy Research Applications, Lawrence Berkeley National Laboratory, Berkeley, CA 94720, USA 5 Molecular Biophysics and Integrated Bioimaging Division, Lawrence Berkeley National Laboratory, Berkeley, CA 94720, USA 6 Berkeley Synchrotron Infrared Structural Biology Program, Lawrence Berkeley National Laboratory, Berkeley, CA 94720, USA 7 Department of Physics and Astronomy, University of California, Davis, Davis, CA 95616, USA 8 Linac Coherent Light Source (LCLS), SLAC National Accelerator Laboratory, Menlo Park, CA 94205, USA 9 Argonne National Laboratory, 9700 South Cass Avenue, Lemont, IL 60439, USA * [email protected] (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-01122.txt.

Introduction

Bowen Zheng and twelve co-authors speed up ptychographic reconstruction, an imaging method that rebuilds a sample from many diffraction patterns. The standard solvers are iterative and can converge slowly under real lab conditions. The team adds a learned fast-forward step inside the loop. After a short warm-up with standard updates, the learned step jumps the reconstruction toward a converged state, and normal updates then resume.

Because the physics-based solver still runs, the method keeps its consistency and flexibility while needing far fewer iterations. The model was trained on varied datasets and tested on data from a different year, and it held up well. Image quality matched standard solvers while run time fell by more than half. The method now runs in a production pipeline at a synchrotron beamline, where staff use it during live experiments.

Catalog record

CREATORBowen Zheng 1 , Katayun Kamdin 1 , David Shapiro 1 , Alexander Ditter 1 , Dayne Sasaki 1,2 , Emma Bernard 3 , Roopali Kukreja 3 , Petrus H. Zwart 4,5,6 , Slavomír Nemšák 1,7 , Apurva Mehta 8 , Nicholas Schwarz 9 , Alexander Hexemer 1 , Tanny Chavez 1,* 1 Advanced Light Source, Lawrence Berkeley National Laboratory, Berkeley, CA 94720, USA 2 Department of Physics, Massachusetts Institute of Technology, Cambridge, MA 02139, USA 3 Department of Materials Science and Engineering, University of California Davis, Davis, CA 95616, USA 4 Center for Advanced Mathematics for Energy Research Applications, Lawrence Berkeley National Laboratory, Berkeley, CA 94720, USA 5 Molecular Biophysics and Integrated Bioimaging Division, Lawrence Berkeley National Laboratory, Berkeley, CA 94720, USA 6 Berkeley Synchrotron Infrared Structural Biology Program, Lawrence Berkeley National Laboratory, Berkeley, CA 94720, USA 7 Department of Physics and Astronomy, University of California, Davis, Davis, CA 95616, USA 8 Linac Coherent Light Source (LCLS), SLAC National Accelerator Laboratory, Menlo Park, CA 94205, USA 9 Argonne National Laboratory, 9700 South Cass Avenue, Lemont, IL 60439, USA * [email protected]
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE40 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.01122

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Machine Learning–Augmented Acceleration of Iterative Ptychographic Reconstruction Bowen Zheng 1 , Katayun Kamdin 1 , David Shapiro 1 , Alexander Ditter 1 , Dayne Sasaki 1,2 , Emma Bernard 3 , Roopali Kukreja 3 , Petrus H. Zwart 4,5,6 , Slavomír Nemšák 1,7 , Apurva Mehta 8 , Nicholas Schwarz 9 , Alexander Hexemer 1 , Tanny Chavez 1,* 1 Advanced Light Source, Lawrence Berkeley National Laboratory, Berkeley, CA 94720, USA 2 Department of Physics, Massachusetts Institute of Technology, Cambridge, MA 02139, USA 3 Department of Materials Science and Engineering, University of California Davis, Davis, CA 95616, USA 4 Center for Advanced Mathematics for Energy Research Applications, Lawrence Berkeley National Laboratory, Berkeley, CA 94720, USA 5 Molecular Biophysics and Integrated Bioimaging Division, Lawrence Berkeley National Laboratory, Berkeley, CA 94720, USA 6 Berkeley Synchrotron Infrared Structural Biology Program, Lawrence Berkeley National Laboratory, Berkeley, CA 94720, USA 7 Department of Physics and Astronomy, University of California, Davis, Davis, CA 95616, USA 8 Linac Coherent Light Source (LCLS), SLAC National Accelerator Laboratory, Menlo Park, CA 94205, USA 9 Argonne National Laboratory, 9700 South Cass Avenue, Lemont, IL 60439, USA * [email protected] Abstract Iterative ptychographic reconstruction algorithms are widely used for coherent diffractive imaging but can exhibit slow convergence under realistic experimental conditions. We propose a machine learning–augmented approach that accelerates iterative ptychographic reconstruction by introducing a learned fast-forward operator applied during reconstruction. Following an initial warm-up using standard iterations, the fast-forward operator advances the reconstruction toward a more converged state, after which conventional iterative updates are resumed. This strategy preserves the physical consistency and flexibility of established ptychographic solvers while reducing the number of iterations required for convergence. The model is trained on diverse ptychographic datasets and evaluated on experimental data acquired in a different year, demonstrating robustness and temporal generalization. Compared with conventional iterative solvers, the machine learning-augmented method achieves comparable reconstruction quality while converging faster in terms of Poisson negative log-likelihood, yielding over a two-fold reduction in wall-clock time. The approach has been integrated into an existing reconstruction pipeline and deployed in production at a synchrotron beamline, demonstrating practicality for real-time experimental operation. 1 Introduction Modern synchrotron and electron microscopy facilities are undergoing transformative upgrades in detector technology and beam brightness. Fourth-generation synchrotron sources now deliver coherent X-ray flux orders of magnitude higher than their predecessors, while next-generation detectors capture diffraction patterns at kilohertz frame rates [ 13 , 10 ] . For ptychography, a widely used computational imaging technique that recovers high-resolution complex-valued object information from intensity only diffraction measurements, this dramatic increase in data acquisition rates has created a critical computational bottleneck. Traditional iterative reconstruction algorithms can no longer provide the near-real-time feedback required to guide experimental decision-making, transforming what was once a computational challenge into an operational constraint that limits scientific throughput. The core challenge lies in preserving reconstruction fidelity while achieving the acceleration needed for high-throughput operation. Classical ptychographic reconstruction relies on iterative projection or optimization-based algorithms such as the extended ptychographic iterative engine (ePIE) [ 9 , 8 ] , the difference map [ 16 , 15 ] , and maximum-likelihood methods [ 17 ] . These algorithms recover missing phase information by enforcing consistency between measured diffraction intensities and spatial overlap constraints through gradient-based minimization of a well-defined objective function. This gradient-based optimization provides crucial guarantees: convergence to physically consistent solutions, interpretable intermediate states, and robustness to experimental imperfections such as scan position errors and partial coherence [ 10 ] . However, achieving these guarantees comes at substantial computational cost, with reconstructions often requiring hundreds of iterations and minutes to hours of processing time per dataset. Machine learning (ML) has emerged as a potential solution for accelerating ptychographic reconstruction, but many existing approaches sacrifice the guarantees provided by gradient-based optimization. Most current ML methods rely on single-shot direct mappings from diffraction patterns to reconstructed objects [ 3 , 1 , 6 , 18 , 2 , 5 ] , treating reconstruction as a regression problem. While these approaches enable rapid inference once trained, they fundamentally replace the physics-based optimization with a black-box predictor. This replacement eliminates the gradient-based refinement mechanism that ensures physical consistency with measured data, provides interpretability through well-defined objective functions, and enables adaptive handling of experimental variations. Furthermore, these methods typically train on synthetic or simulated data rather than experimental measurements and assume fixed or known probe configurations, raising concerns about robustness in operational beamline environments where experimental conditions vary continuously. To address this gap, we introduce an ML-augmented acceleration strategy that preserves the gradient-based minimization framework while achieving substantial speedup. Rather than replacing the iterative solver, our approach inserts a learned fast-forward operator that advances early-stage reconstructions toward more converged states. Critically, this operator acts within the optimization loop: conventional gradient-based iterations perform an initial warm-up, the ML operator provides a single acceleration step, and gradient-based optimization then resumes to drive the solution toward physical consistency with measured data. This hybrid design maintains all guarantees of the underlying solver, convergence to statistically optimal reconstructions, interpretable loss landscapes, and robustness to experimental imperfections, while reducing the total iteration count required for convergence. The method is trained solely on historical experimental ptychographic datasets from multiple years and sample types, and evaluated on independently acquired data from a different year to rigorously assess cross-year generalization. We demonstrate accelerated convergence on the test data and report successful deployment in production at an operational synchrotron beamline, where the approach routinely provides more than two-fold reduction in reconstruction time while maintaining reconstruction quality equivalent to conventional iterative solvers. 2 Method 2.1 Overall Framework The proposed framework augments an existing iterative ptychographic reconstruction pipeline with an ML-based fast-forward operator, without replacing the underlying physics-based solver. Instead, the learned model is inserted as an auxiliary module that acts on intermediate object estimates generated during reconstruction. As shown in Fig. 1 (a), standard ptychographic inputs, including measured diffraction patterns and their associated scan positions, are first processed by a conventional reconstruction engine, which performs a small number of iterations as a warm-up stage. The resulting complex-valued object estimate is then passed to the ML-based fast-forward operator, which predicts an improved estimate closer to convergence. This prediction is used to reinitialize the iterative solver, allowing subsequent ptychographic iterations to resume from a more advanced state. The learning objective of the fast-forward operator, illustrated in Fig. 1 (b), is to advance an early-stage object reconstruction toward a more converged solution, effectively reducing the number of solver iterations required by performing a single inference step. Importantly, the ML inference is performed only once during the entire reconstruction process, resulting in minimal additional computational overhead compared to the overall cost of iterative ptychographic reconstruction. This hybrid design combines the robustness physics-based reconstruction with the efficiency gains of data-driven acceleration. Figure 1: Schematic of the proposed ptychographic reconstruction framework. (a) High-level workflow. Ptychographic reconstruction inputs are first provided to the physics-based iterative solver. A small number of ptychographic iterations are performed as a warm-up stage. The resulting complex-valued object estimate is then passed to an ML-based fast-forward operator, which predicts an updated object. Subsequent ptychographic iterations are carried out using this prediction as the new initialization. (b) ML fast-forward operator objective. The goal is to

Read the complete text