Pretrain-to-alignment learning paradigm to improve geophysical AI applicability under scarce field labels and synthetic-to-field gaps: A case study of relative geologic time estimation in global shelf-edge clinothems
Hui Gao, Xinming Wu, Jiarun Yang, Zhixiang Guo, and Yimin Dou · 2026
Read Pretrain-to-alignment learning paradigm to improve geophysical AI applicability under scarce field labels and synthetic-to-field gaps: A case study of relative geologic time estimation in global shelf-edge clinothems by Hui Gao, Xinming Wu, Jiarun Yang, Zhixiang Guo, and Yimin Dou (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-16783.txt.
Introduction
Gao and colleagues propose a staged learning path for geophysical AI when field labels are scarce and synthetic data diverges from field data. It chains self-taught pretraining, synthetic supervision, prior-driven refinement, and domain fine-tuning into one workflow. Tested on relative geologic time estimation in global shelf-edge clinothems, with 3,000 field datasets from many basins, the path works well across surveys. It also sharpens fine-scale rock-layer and structure detail, offering a guide for other geophysical tasks such as interpretation, regression, and inversion.
Catalog record
| CREATOR | Hui Gao, Xinming Wu, Jiarun Yang, Zhixiang Guo, and Yimin Dou |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 47508 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.16783
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Pretrain-to-alignment learning paradigm to improve geophysical AI applicability under scarce field labels and synthetic-to-field gaps: A case study of relative geologic time estimation in global shelf-edge clinothems Hui Gao, Xinming Wu, Jiarun Yang, Zhixiang Guo, and Yimin Dou Abstract Artificial intelligence (AI) has been increasingly applied to various geophysical scenarios, yet its practical deployment remains limited by scarce field labels, pronounced synthetic-to-field domain gaps, and insufficient physical consistency under complex and variable field conditions. To address these challenges, we propose a pretrain-to-alignment learning paradigm that systematically integrates self-supervised pretraining, synthetic supervision, prior-driven refinement, and domain-adaptation fine-tuning into a unified progressive learning workflow. In this paradigm, geophysical AI models are developed through sequential stages that progressively build field-relevant representations, task-specific mapping capability, field consistency, and target-specific adaptability. We validate this paradigm using cross-survey relative geologic time (RGT) estimation in global shelf-edge clinothems as a representative case study. Results from 3,000 field datasets spanning multiple sedimentary basins demonstrate that the proposed paradigm achieves accurate, robust, and well-generalized performance across diverse field surveys, while significantly improving fine-scale stratigraphic and structural details. More broadly, this study provides a practical methodological reference for a broader range of geophysical AI tasks, such as interpretation, regression, and inversion problems. \footer Example \lefthead Gao et al. \righthead Pretrain-to-alignment learning paradigm 1 Introduction Artificial intelligence (AI) approaches have been widely applied across numerous geophysical tasks, including feature detection and delineation ( Xiong et al. 2018 ; Wu et al. 2019 ; Shi et al. 2019 ; Pham et al. 2019 ; Gao et al. 2025a ) , quantitative regression and property estimation ( Das et al. 2019 ; Geng et al. 2020 ; Das and Mukerji 2020 ; Kazei et al. 2021 ; Han et al. 2025 ) , inverse imaging and reconstruction ( Araya-Polo et al. 2018 ; Yang and Ma 2019 ; Wu and McMechan 2019 ; Li et al. 2021 ; Adler et al. 2021 ) , and event detection and monitoring ( Mousavi et al. 2016 ; Zhu and Beroza 2019 ; Mousavi et al. 2020 ; Anikiev et al. 2023 ; Si et al. 2024 ) . Despite these advances, robust cross-survey generalization and reliable field deployment remain major challenges. First, high-quality labeled field datasets are scarce and expensive to acquire ( An et al. 2023 ; Lin et al. 2024 ; Liu and Ma 2024 ; Xu et al. 2025a ) , which limits the feasibility of large-scale supervised learning in real applications. Second, although synthetic datasets can provide abundant and reasonable labels, they often differ substantially from field data in data distribution, structural complexity, and realism, leading to an unavoidable and pronounced synthetic-to-field domain gap ( Zhou et al. 2021 ; Farris et al. 2023 ; Zhou et al. 2025 ) . Third, purely data-driven AI methods often suffer from overfitting to statistical patterns, sensitivity to domain variability, insufficient physical consistency when applied to complex field data ( Zhou et al. 2019 ; Zhao et al. 2024 ; Xu et al. 2025c ) . Fourth, the trained model often exhibits limited cross-survey generalization and requires case-specific retraining or additional adaptation before reliable practical deployment ( Zhao et al. 2024 ; Yang et al. 2025 ; Quesada et al. 2025 ) . Collectively, these issues have become primary bottlenecks to the practical deployment of geophysical AI across various field surveys and geological settings. To improve the practical applicability of geophysical AI models, existing studies have advanced several major directions, including few-shot or transfer learning with limited labeled field data ( Cunha et al. 2020 ; Zhao et al. 2023b ; Liu et al. 2025 ) , synthetic-data-driven supervision to mitigate label scarcity ( Wu et al. 2020 ; Zhao et al. 2023a ; Gao et al. 2023 ) , large-scale pretraining on unlabeled data for improving feature representations ( Liu and Ma 2024 ; Sheng et al. 2025 ; Chu et al. 2025 ; Dou et al. 2025 ) , domain knowledge or physical constraints-driven model training ( Wu et al. 2023 ; Zuo et al. 2024 ; Cao and Weng 2024 ; Xu et al. 2025b ) , and fine-tuning or domain adaptation for target-specific transfer ( Zhou et al. 2021 ; Gao et al. 2025b ; Yang et al. 2025 ) . Although these strategies contribute to enhancing the model’s capability and applicability, they are typically developed in parallel and implemented separately, therefore remain insufficient to constitute a comprehensive solution for practical deployment. Few-shot or transfer learning using labeled field data is inherently constrained by the subjectivity and expert-dependence of manual annotations, the limited scale and diversity of labeled datasets, and overfitting to specific patterns, leading to weak generalization across surveys. Synthetic-data-driven supervision contributes to mitigate the absence of labels, but models trained solely in this way often remain sensitive to the synthetic-to-field domain gap. Large-scale pretraining can improve field-relevant feature representations, yet such improvements do not necessarily translate into stable and reliable downstream performance without sufficient task-specific supervision. Similarly, knowledge-guided training or target-specific transfer strategies can enhance prediction plausibility and adaptability, but they commonly require a sufficiently strong initialization model and are often applied as independent refinements rather than being systematically incorporated into a complete training-to-deployment framework. Consequently, current geophysical AI research still lacks a comprehensive and transferable learning paradigm that systematically integrates representation learning, synthetic supervision, knowledge-driven refinement, and deployment-stage adaptation. To address these limitations, we propose a pretrain-to-alignment learning paradigm for improving the applicability of geophysical AI under scarce field labels and pronounced synthetic-to-field domain gaps. Instead of treating model development as a single-stage optimization problem, the proposed paradigm organizes it as a unified progressive learning process that systematically integrates self-supervised pretraining, synthetic supervision, geological prior-driven refinement and lightweight domain-adaptation fine-tuning (Figure ). In this framework, the geophysical AI model initially acquires field-relevant representations from large-scale unlabeled field datasets through self-supervised pretraining, and then learns task-specific mappings from massive-scale labeled synthetic datasets via synthetic supervision. Subsequently, the trained model is further refined on large-scale unlabeled field datasets using label-independent prior constraints or regularization terms, thereby progressively aligning its predictions with field conditions and reducing the synthetic-to-field gap. Finally, lightweight domain-adaptation fine-tuning is performed on an individual target sample to account for target-specific variability and enhance reliability and flexibility in practical applications. In this way, the proposed paradigm establishes a complete and transferable learning framework for progressively improving model applicability and bridging the synthetic-to-field gap from representation learning to deployment-stage adaptation. To demonstrate the effectiveness of the proposed paradigm, we use relative geologic time (RGT, Stark 2003 ; Stark 2004 ) estimation in global shelf-edge clinothems as a representative case study. Clinothems are basinward-accreting depositional prisms formed at sedimentary basin margin and constitute fundamental elements of the stratigraphic archives ( Steel et al. 2002 ; Hampson and Storms 2003 ; Patruno and Helland-Hansen 2018 ) . Their geometries and stacking patterns record the migration of depositional environments and are primarily forced by variations in sediment supply and relative sea level, which control the progradation, aggradation, and retrogradation of shelf edge in both siliciclastic and carbonate systems ( Pirmez et al. 1998 ; Bullimore et al. 2005 ; Posamentier et al. 2007 ; Anell and Midtkandal 2017 ; Patruno and