SeisBind: Physics-Aware Tri-Modal Representation Binding for Seismic Data via Contrastive Learning

Chaohua Liang The University of Tokyo Graduate School of Frontier Sciences Kashiwa, Japan [email protected] Jun Matsushima The University of Tokyo Graduate School of Frontier Sciences Kashiwa, Japan [email protected] · 2026

Read SeisBind: Physics-Aware Tri-Modal Representation Binding for Seismic Data via Contrastive Learning by Chaohua Liang The University of Tokyo Graduate School of Frontier Sciences Kashiwa, Japan [email protected] Jun Matsushima The University of Tokyo Graduate School of Frontier Sciences Kashiwa, Japan [email protected] (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-14607.txt.

Introduction

Chaohua Liang and Jun Matsushima present a seismic learning method in this 2026 paper. Their framework, SeisBind, is a physics-aware multi-modal contrastive learning design. It aims to transform complex seismic wavefields into human-readable physical representations. Seismic data record how waves move through the earth, and they are hard to interpret directly.

The title spells out the method: physics-aware tri-modal representation binding via contrastive learning. Three modes of data are bound into one shared representation. Contrastive learning pulls matching views together and pushes others apart. Readers get a way to turn raw wavefields into physical terms that geophysicists can read and use.

Catalog record

CREATORChaohua Liang The University of Tokyo Graduate School of Frontier Sciences Kashiwa, Japan [email protected] Jun Matsushima The University of Tokyo Graduate School of Frontier Sciences Kashiwa, Japan [email protected]
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE20 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-14607

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

SeisBind: Physics-Aware Tri-Modal Representation Binding for Seismic Data via Contrastive Learning Chaohua Liang The University of Tokyo Graduate School of Frontier Sciences Kashiwa, Japan [email protected] Jun Matsushima The University of Tokyo Graduate School of Frontier Sciences Kashiwa, Japan [email protected] Abstract This letter proposes a physics-aware multi-modal contrastive learning framework designed to transform complex seismic wavefields into human-readable physical representations. Traditional data-driven inversion methods often focus on pixel-wise mapping, which lacks physical grounding and interpretability. To address this, we introduce a novel framework that jointly aligns seismic shot gathers, subsurface velocity models, and explicit physical descriptors (e.g., mean velocity and gradients) in a shared latent space. By introducing these descriptors as a third modality, our approach encourages the learned embeddings to capture intrinsic geological semantics rather than superficial signal correlations. Experiments on the OpenFWI dataset demonstrate that the proposed method not only achieves robust seismic-to-velocity retrieval but also effectively preserves meaningful physical semantics in the latent space. This representation-centric perspective enables a direct mapping from raw observations to interpretable physical attributes, providing a flexible foundation for expert-guided subsurface characterization. I Introduction Seismic velocity models play a fundamental role in characterizing subsurface structures and serve as the basis for a wide range of geophysical exploration tasks, including seismic imaging, migration, and reservoir characterization. Accurate velocity information is essential for reliable interpretation of seismic data, as errors in velocity models can lead to distorted images and misleading geological conclusions. Consequently, estimating subsurface velocity models from seismic observations has long been a central problem in exploration geophysics. Traditional approaches, primarily Full Waveform Inversion (FWI), are physics-driven but suffer from high computational costs and sensitivity to initial models [ 15 ] . While data-driven methods using Convolutional Neural Networks (CNNs) have emerged to accelerate estimation, most existing approaches rely on direct pixel-wise regression within a single modality. Consequently, they often lack physical interpretability and struggle to generalize to unseen geological scenarios [ 17 ] . What’s more, in conventional end-to-end deep learning frameworks, physical descriptors are difficult to be explicitly embedded into the learning process. As a result, the models tend to rely primarily on data-driven correlations and may overlook important physical information. To address these challenges, we propose SeisBind, a physics-aware multi-modal contrastive learning framework. Instead of explicit inversion, we aim to learn a shared latent space where seismic data, velocity models, and statistical physical descriptors are semantically aligned. By introducing physical descriptors as a third modality, our approach acts as a semantic anchor, forcing the learned embeddings to capture intrinsic geological properties beyond superficial signal correlations. This representation-centric perspective enables robust cross-modal retrieval and provides a flexible foundation for expert-guided characterization. Experimental results on the OpenFWI [ 3 ] dataset demonstrate that our method achieves precise seismic-to-velocity alignment and effectively preserves readable physical semantics. The main contributions of this work are: 1. We introduce a tri-modal contrastive learning framework that integrates physical descriptors with seismic and velocity data. 2. We demonstrate that explicit physical constraints significantly enhance the interpretability and quality of the learned representations. 3. We validate the proposed approach through cross-modal retrieval tasks, showing superior alignment performance. II RELATED WORK Recent works utilized Convolutional Neural Networks (CNNs) to map seismic data directly to velocity models [ 1 , 8 ] . Other generative approaches, such as Generative Adversarial Networks (GANs), have also been employed for seismic impedance inversion with geophysical guidance [ 17 ] . Besides, encoder-decoder architectures like InversionNet [ 16 ] and other fully convolutional networks were developed to improve inversion accuracy and efficiency. More recently, researchers have explored incorporating velocity representation extensions to further enhance FWI performance [ 11 ] . While these methods reduce inference time, they often rely on pixel-wise regression, which may overlook global physical consistency. Contrastive learning has revolutionized representation learning by aligning different views of data in a shared latent space, typically optimizing the InfoNCE loss [ 12 ] . The CLIP model [ 13 ] successfully demonstrated the power of aligning image and text modalities. This paradigm has been extended to various modalities, including audio [ 6 ] and other sensory data, leading to unified embedding spaces like ImageBind [ 5 ] and UniBind [ 10 ] . These frameworks focus on learning transferable representations rather than solving a specific regression task, offering a new perspective for handling complex geophysical data. In the geophysical domain, deep learning is increasingly combined with physics-based constraints. Kong et al. [ 9 ] demonstrated the benefits of combining deep learning with physics-based features for discrimination tasks. Recently, contrastive learning has been applied to subsurface geoscience to build vision-language models [ 2 ] and foundation models like SeisCLIP [ 14 ] for multi-purpose feature extraction. In parallel, generative approaches such as WaveDiffusion [ 4 ] have explored joint latent diffusion frameworks to synthesize seismic and velocity fields that approximately satisfy the governing wave equation.Different from these works, our approach explicitly introduces statistical physical descriptors as a third modality to constrain the learning process, this explicitly aligns the latent space, enabling the direct retrieval of interpretable physical parameters from raw seismic data or velocity models. III METHODS III-A Problem Formulation In real seismic exploration, one of the main objectives is to calculate the subsurface velocity model using obtained seismic data. In this letter, we consider a paired seismic–velocity learning problem, where each training sample consists of three aligned components: (1) a seismic record, (2) a corresponding subsurface velocity model, and (3) a low-dimensional physics descriptor vector summarizing global physical properties of the model. Instead of explicitly learning an inversion mapping from seismic data to velocity models, we aim to learn a shared embedding space in which seismic observations, velocity fields, and physics descriptors are semantically aligned. This formulation enables cross-modal retrieval and zero-shot generalization across acquisition and model distributions. III-B Proposed Model Fig. 1 : model architecture The proposed model for multimodal alignment is illustrated in Fig. Inspired by contrastive multi-modal learning frameworks, we adopt a CLIP-style architecture composed of three modality-specific encoders: Velocity Encoder, Seismic Encoder and Info encoder, each encoder maps its input into a shared 256-dimensional embedding space and all embeddings are L2-normalized to lie on a unit hypersphere. The input seismic tensor has shape (5,T,R), corresponding to five shot channels. The seismic encoder utilizes a symmetric four-block CNN architecture to extract latent features from multi-shot seismic gathers. Each block consists of a convolutional layer followed by batch normalization and ReLU activation. We employ standard square kernels ( 7\times 7 to 3\times 3 ) with progressive downsampling to ensure a balanced receptive field across both temporal and spatial dimensions. The high-dimensional wavefield is finally aggregated via adaptive global average pooling and projected onto a 256-dimensional shared latent space, facilitating the alignment of raw observations with human-readable physical attributes. The velocity encoder is implemented using a ResNet-18 backbone, which has been widely validated as a reliable and effective architecture for feature extraction [ 7 ] . Since the velocity input is single-channel, the first convolutional layer is modified accordingly. The final fully connected layer is replaced with a linear projection to the shared embedding dimension d. To incorporate global physical priors, a lightweight multilayer perceptron (MLP) is employed to encode the physics vector \mathbf{p} . The

Read the complete text