The Transparent Earth: A Multimodal Foundation Model for the Earth’s Subsurface
Arnab Mazumder, Javier E. Santos, Noah Hobbs, Mohamed Mehana, Daniel O’Malley · 2025
Read The Transparent Earth: A Multimodal Foundation Model for the Earth’s Subsurface by Arnab Mazumder, Javier E. Santos, Noah Hobbs, Mohamed Mehana, Daniel O’Malley (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-02783.txt.
Introduction
Arnab Mazumder, Javier E. Santos, Noah Hobbs, Mohamed Mehana, and Daniel O'Malley present a 2025 geoscience AI paper introducing Transparent Earth, a foundation model for the planet's subsurface. Underground properties must be inferred from scattered observations of many types, each sparse in its own way.
The transformer model ingests eight observation types, from stress angles to mantle temperature and plate type. Each observation carries a position code plus a modality code derived from a text description of its type, so new data types can be added freely. The model can predict with no inputs or with any mix of extra observations, an in-context learning style. Validation showed stress angle errors dropping more than threefold. Performance grew with model size, supporting the authors' foundation model ambition.
Catalog record
| CREATOR | Arnab Mazumder, Javier E. Santos, Noah Hobbs, Mohamed Mehana, Daniel O’Malley |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 40 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-02783
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
The Transparent Earth: A Multimodal Foundation Model for the Earth’s Subsurface Arnab Mazumder, Javier E. Santos, Noah Hobbs, Mohamed Mehana, Daniel O’Malley Abstract We present the Transparent Earth, a transformer-based architecture for reconstructing subsurface properties from heterogeneous datasets that vary in sparsity, resolution, and modality, where each modality represents a distinct type of observation (e.g., stress angle, mantle temperature, tectonic plate type). The model incorporates positional encodings of observations together with modality encodings, derived from a text embedding model applied to a description of each modality. This design enables the model to scale to an arbitrary number of modalities, making it straightforward to add new ones not considered in the initial design. We currently include eight modalities spanning directional angles, categorical classes, and continuous properties such as temperature and thickness. These capabilities support in-context learning, enabling the model to generate predictions either with no inputs or with an arbitrary number of additional observations from any subset of modalities. On validation data, this reduces errors in predicting stress angle by more than a factor of three. The proposed architecture is scalable and demonstrates improved performance with increased parameters. Together, these advances make the Transparent Earth an initial foundation model for the Earth’s subsurface that ultimately aims to predict any subsurface property anywhere on Earth. \workshoptitle AI4Science: The Reach and Limits of AI for Scientific Discovery 1 Introduction Recent advances in machine learning (ML) are reshaping Earth science. ML models has been used for satellite imagery classification [ 1 ] , time-series analysis [ 2 ] , and data augmentation [ 3 ] . Physics-informed neural networks have also been applied to groundwater flow prediction [ 4 ] and climate parametrization [ 5 ] . However, because observations span diverse modalities and resolutions, many models remain specialized to narrow subdisciplines such as weather forecasting or seismic modeling [ 6 , 7 ] . Foundation models (FMs) show promise for learning from heterogeneous inputs and enabling zero-shot generalization [ 8 ] , yet current Earth-science FMs still target relatively narrow scopes such as seismicity [ 6 ] , climate prediction [ 9 ] , or oceanography [ 10 ] . This persistent specialization reflects the heterogeneity of Earth systems across scales, limited validation data, and the wide variety of data types across fields. Figure 1 : The Transparent Earth workflow fuses heterogeneous observations from multiple modalities and locations to generate predictions for user-defined modalities at arbitrary query points. The integration of multiple modalities across subdisciplines has the potential to substantially improve the resolution and reliability of subsurface property maps. Achieving this, however, requires models that can generalize from sparse and non-uniform observations to provide accurate predictions at local and global scales. To address this challenge, we propose The Transparent Earth , a transformer-based framework for global subsurface modeling. As illustrated in Figure 1 and 3 our model learns from sparse, multimodal observations distributed worldwide and reconstructs geophysical fields with high confidence. Our main contributions are: • A unified attention-based architecture that allows directional, categorical, and continuous modalities to cross-attend during encoding and for multitask prediction, covering inputs such as stress angle, tectonic structure, basin attributes, and mantle temperature. • A training strategy that handles incomplete, spatially disjoint observations with no overlapping coordinates. Through random sampling of observations and modalities, the model learns to generalize under real-world sparsity and heterogeneity. • A query-driven decoder design that incorporates both spatial and task context, where task embeddings are derived from encoder inputs. This conditioning enables the model to infer what to predict and where without relying on memorization. 2 Background Traditional ML and deep learning (DL) techniques have seen widespread use in Earth science modeling applications. Conventional methods such as support vector machines (SVM) [ 11 ] , random forests [ 12 ] , gradient boosting machines [ 13 ] , and shallow neural networks (e.g., multilayer perceptrons) [ 14 ] are frequently limited to predictions of individual subsurface attributes. Geophysical foundation models [ 15 ] are trained on large datasets such as seismic waveforms to perform multiple tasks such as classification, inversion, and signal processing [ 6 ] . However, these foundation models remain focused on a singular discipline and are unable to leverage information from other modalities (such as subsurface temperature, geology, among others). There has also been significant effort to introduce physics informed models for subsurface engineering, especially for the oil and gas industry [ 16 ] and energy systems [ 17 ] . However, modeling each modality in isolation limits the ability to capture the interconnected nature of subsurface properties. In practice, many of these modalities are inherently correlated. For instance, sedimentary basin type, age, and thickness can be correlated to fault types and location that can in turn be correlated to seismic events and ultimately to current stress regimes [ 18 , 19 ] . Furthermore, diverse modalities can inform higher level predictions such as assessments of geothermal prospect viability. These interdependencies, often subtle or non-obvious, can be learned by data-driven models given sufficient observations. Figure 2 : The Transparent Earth architecture for multimodal subsurface modeling. (Input Processing) Inputs are augmented with sine–cosine positional encodings and text-derived modality embeddings, then fused into a unified sequence. (Encoder) The encoder processes these inputs through cross- and self-attention blocks to form a shared latent space. (Decoder) The decoder uses task embeddings and coordinate queries to extract relevant features and generate predictions at arbitrary locations. Advancing subsurface property reconstruction and super-resolution requires models that can jointly reason across diverse geophysical modalities spanning multiple geologic disciplines. This is particularly valuable in data-sparse regions [ 20 ] , where direct observations are scarce, expensive, or highly heterogeneous. Inspired by recent Earth observation systems that leverage globally anchored multimodal fusion architectures [ 21 , 22 , 9 ] , we adopt a similar strategy for subsurface modeling. Specifically, we apply positional encodings of geographic coordinates [ 23 ] , following prior implementations [ 9 , 24 ] , to correlate data across disciplines within a unified spatial reference frame. Table 1 : Summary of datasets used in the Transparent Earth. Each modality is labeled with its task type, spatial resolution, value range or number of classes, sparsity, and source. Modality Task Type Resolution Value Range / Classes Sparsity Source Stress Angle Regression 0.5^{\circ}\times 0.5^{\circ} 0^{\circ} – 180^{\circ} \checkmark [ 25 ] Strain Angle Regression 0.6^{\circ}\times 0.5^{\circ} 0^{\circ} – 180^{\circ} \checkmark [ 26 ] Sediment Thickness Regression 1^{\circ}\times 1^{\circ} 0-21 Km \times [ 18 ] Mantle Temperature Regression 5^{\circ}\times 5^{\circ} 400^{\circ} – 1300^{\circ} C \checkmark [ 27 ] Tectonic Plates Classification 0.001^{\circ}\times 0.001^{\circ} 52 classes \times [ 28 ] Fault Type Classification 0.1^{\circ}\times 0.1^{\circ} 24 classes \times [ 29 ] Basin Type Classification 0.001^{\circ}\times 0.001^{\circ} 9 classes \times [ 19 ] Basin Age Classification 0.001^{\circ}\times 0.001^{\circ} 17 classes \times [ 19 ] A key component of any multimodal system is the fusion of modality-specific representations [ 30 ] , which can be achieved at different stages of the pipeline. Early fusion combines modalities at the input level [ 31 ] , while late fusion integrates their latent representations [ 32 , 33 ] . These strategies have been successfully applied across a variety of multimodal tasks [ 34 ,