Inspired by machine learning optimization: can gradient-based optimizers solve cycle skipping in full waveform inversion given sufficient iterations?

Xinru Mu, Omar M. Saad, Shaowen Wang, Tariq Alkhalifah · 2025

Read Inspired by machine learning optimization: can gradient-based optimizers solve cycle skipping in full waveform inversion given sufficient iterations? by Xinru Mu, Omar M. Saad, Shaowen Wang, Tariq Alkhalifah (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-14919.txt.

Introduction

Xinru Mu, Omar M. Saad, Shaowen Wang, and Tariq Alkhalifah borrow an idea from machine learning to attack cycle skipping in seismic imaging, in a 2025 geophysics paper. Full waveform inversion builds underground velocity maps by fitting simulated waves to recorded ones. When the starting model is off and low frequencies are missing, simulated and real waves can misalign by more than half a cycle, trapping the fit in a wrong minimum.

Neural network training faces similar traps yet often escapes them with large learning rates that break local optimization rules. Mu and the team ask whether gradient-based seismic optimizers, given enough iterations and aggressive step sizes, can behave almost like global search. Their study tests that question directly, probing iteration count and learning rate as remedies for one of the oldest failure modes in waveform inversion.

Catalog record

CREATORXinru Mu, Omar M. Saad, Shaowen Wang, Tariq Alkhalifah
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE50 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-14919

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Inspired by machine learning optimization: can gradient-based optimizers solve cycle skipping in full waveform inversion given sufficient iterations? Xinru Mu, Omar M. Saad, Shaowen Wang, Tariq Alkhalifah Abstract Full waveform inversion (FWI) iteratively updates the velocity model by minimizing the difference between observed and simulated data. Due to the high computational cost and memory requirements associated with global optimization algorithms, FWI is typically implemented using local optimization methods. However, when the initial velocity model is inaccurate and low-frequency seismic data (e.g., below 3 Hz) are absent, the mismatch between simulated and observed data may exceed half a cycle, a phenomenon known as cycle skipping. In such cases, local optimization algorithms (e.g., gradient-based local optimizers) tend to converge to local minima, leading to inaccurate inversion results. In machine learning, neural network training is also an optimization problem prone to local minima. It often employs gradient-based optimizers with a relatively large learning rate (beyond the theoretical limits of local optimization that are usually determined numerically by a line search), which allows the optimization to behave like a quasi-global optimizer. Consequently, after training for several thousand iterations, we can obtain a neural network model with strong generative capability. In this study, we also employ gradient-based optimizers with a relatively large learning rate for FWI. Results from both synthetic and field data experiments show that FWI may initially converge to a local minimum; however, with sufficient additional iterations, the inversion can gradually approach the global minimum, slowly from shallow subsurface to deep, ultimately yielding an accurate velocity model. Furthermore, numerical examples indicate that, given sufficient iterations, reasonable velocity inversion results can still be achieved even when low-frequency data below 5 Hz are missing. K eywords Waveform inversion, gradient-based optimizers, Inverse theory, Image processing. 1 Introduction Full waveform inversion (FWI) is a highly accurate method for estimating subsurface velocity models. It iteratively updates the velocity model to minimize the misfit between simulated and observed seismic data [ 1 ] . However, when the initial velocity model is inaccurate, the phase difference between the observed and simulated data can exceed half a cycle, a phenomenon known as cycle skipping [ 2 ] . In such cases, using a local optimizer for inversion is likely to lead to convergence to a local minimum, thereby reducing inversion accuracy. Because low-frequency data are less sensitive to cycle skipping, a multi-scale FWI strategy has been proposed, which performs inversion progressively from low-frequency to high-frequency data [ 3 ] . This hierarchical approach helps to mitigate cycle skipping and facilitates the recovery of an accurate velocity model. Unfortunately, in practice, seismic data below 3 Hz are often unavailable due to limitations in instrumentation, environmental noise, and other factors [ 4 ] . The absence of low-frequency signal hampers the reliable reconstruction of the low-wavenumber background model, and as a result, cycle skipping may still exist in subsequent high-frequency inversions. To further mitigate the problem of cycle skipping, many methods have been developed, including the use of geological and geophysical priors, advanced objective functions, global optimization methods, and machine learning–assisted inversion methods, among others [ 5 , 6 , 7 , 8 , 9 , 10 , 4 , 11 , 12 ] . Well logs provide accurate and reliable subsurface velocity information. Therefore, incorporating well log velocities as regularization terms in FWI can help prevent convergence to local minima [ 5 ] . Additionally, facies information extracted from well data can also be used as a regularization constraint to enhance the accuracy of FWI [ 13 ] . In recent years, deep neural networks (DNNs) have demonstrated strong capabilities in learning the distributions of well log velocities and facies, which are subsequently incorporated as regularization priors in FWI [ 14 , 10 , 15 ] . The conventional FWI commonly employs the least-squares {L_{2}} -norm for data misfit, which involves point-by-point comparison and is prone to cycle skipping. To overcome this limitation, some advanced objective functions have been proposed, many of which adopt trace-by-trace (or gather-by-gather) comparisons. Among these, the optimal transport objective function has shown strong potential in effectively alleviating the cycle skipping issue in FWI and has attracted significant research and practical interest [ 16 , 17 , 18 , 19 , 20 ] . It measures the difference between observed and simulated seismic data by computing the minimal cost required to transport one distribution into the other, thereby capturing both amplitude and phase discrepancies in a physically meaningful manner. Another promising approach is the matching filter-based misfit function, which computes a matching filter through deconvolution between observed and simulated seismic traces [ 21 , 22 , 8 , 23 , 24 ] . The associated optimization problem is formulated by penalizing filter coefficients at non-zero time lags, as the ideal matching filter becomes a band-limited Dirac delta function when the simulated data perfectly aligns with the observed data. Furthermore, the dynamic time warping (DTW)-based loss function has proven effective in mitigating cycle skipping [ 25 , 26 , 4 , 27 ] . DTW works by nonlinearly aligning simulated and observed seismic traces in time, allowing for local stretching and squeezing to achieve optimal alignment between the signals. In recent developments, DNN–based objective functions have also been developed to improve the measurement of similarity between simulated and observed data, thereby enhancing the overall accuracy of FWI [ 28 , 29 , 30 ] . Another way to solving cycle skipping is the use of global optimization methods, which explore the parameter space more comprehensively and are less likely to become trapped in local minima. Genetic algorithms, simulated annealing, particle swarm optimization, and Monte Carlo methods have all been successfully applied to FWI, yielding promising results [ 31 , 32 , 33 , 6 , 34 , 35 ] . To improve the computational efficiency of global optimization methods, [ 11 ] incorporated gradient information into the simulated annealing algorithm, resulting in a gradient-based global optimization approach that significantly reduces computational cost. Building on this idea, [ 36 ] further incorporated gradient information into the Markov Chain Monte Carlo (MCMC) method, resulting in a hybrid optimization approach that was successfully applied to both FWI and uncertainty analysis. More recently, [ 37 ] employed gradient-based MCMC method for surface wave inversion and uncertainty quantification. However, due to the large number of iterations and high memory requirements, global optimization algorithms are rarely used in practical industrial applications. Taking into account this balance between global and gradient-based optimizers, a question may arise: If we have the luxury to push gradient-based FWI methods to global search cost levels and iterations, would we converge? In this paper, inspired by the optimization implementation in machine learning, where gradient-based optimizers combined with a relatively large learning rate can, after thousands of iterations (starting from a random initialization), produce a well-optimized neural network model. We apply this optimization strategy to FWI to investigate whether it can resolve cycle skipping. We conduct experiments on three velocity models: a linearly increasing model, the Overthrust model, and the Marmousi2 model, along with a field data test. Forward modeling is performed using the acoustic wave equation, with a free-surface boundary condition to simulate multiples. The synthetic shot gathers are filtered to

Read the complete text