Assessing the Potential of Masked Autoencoder Foundation Models in Predicting Downhole Metrics from Surface Drilling Data

1 st Aleksander Berezowski, 2 nd Hassan Hassanzadeh, 3 rd Gouri Ginde · 2026

Read Assessing the Potential of Masked Autoencoder Foundation Models in Predicting Downhole Metrics from Surface Drilling Data by 1 st Aleksander Berezowski, 2 nd Hassan Hassanzadeh, 3 rd Gouri Ginde (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-15169.txt.

Introduction

Berezowski, Hassanzadeh, and Ginde map thirteen papers from 2015 to 2025 on predicting downhole drilling metrics from surface data. The review names eight common surface metrics and seven downhole targets, with neural nets dominating current methods. No study yet tries masked autoencoder foundation models, despite their strength on time-series tasks. The authors call these models a feasible but untested opportunity, urging head-to-head validation against existing methods.

Catalog record

CREATOR1 st Aleksander Berezowski, 2 nd Hassan Hassanzadeh, 3 rd Gouri Ginde
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE34998
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.15169

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Assessing the Potential of Masked Autoencoder Foundation Models in Predicting Downhole Metrics from Surface Drilling Data 1 st Aleksander Berezowski, 2 nd Hassan Hassanzadeh, 3 rd Gouri Ginde Abstract Oil and gas drilling operations generate extensive time-series data from surface sensors, yet accurate real-time prediction of critical downhole metrics remains challenging due to the scarcity of labelled downhole measurements. This systematic mapping study reviews thirteen papers published between 2015 and 2025 to assess the potential of Masked Autoencoder Foundation Models (MAEFMs) for predicting downhole metrics from surface drilling data. The review identifies eight commonly collected surface metrics and seven target downhole metrics. Current approaches predominantly employ neural network architectures such as artificial neural networks (ANNs) and long short-term memory (LSTM) networks, yet no studies have explored MAEFMs despite their demonstrated effectiveness in time-series modeling. MAEFMs offer distinct advantages through self-supervised pre-training on abundant unlabeled data, enabling multi-task prediction and improved generalization across wells. This research establishes that MAEFMs represent a technically feasible but unexplored opportunity for drilling analytics, recommending future empirical validation of their performance against existing models and exploration of their broader applicability in oil and gas operations. I Introduction Oil and gas wellbore drilling is a highly data-intensive process that requires continuous monitoring and control of numerous physical parameters to ensure operational efficiency. During drilling operations, vast volumes of time-series data are generated from surface sensors, including weight on bit (WOB), standpipe pressure (SPP), torque (T), and rotational speed (RPM) [ 4 ] . These surface measurements are used to estimate downhole conditions that are difficult or costly to measure in real time, such as bottom-hole pressure (BHP) [ 30 ] , equivalent circulating density (ECD) [ 1 ] , and downhole string vibrations [ 22 , 23 ] . Accurate prediction of these downhole metrics is critical for optimizing drilling performance. In recent years, machine learning (ML) has emerged as a promising approach for inferring downhole metrics solely from surface measurements [ 27 ] . A variety of ML models have been developed to map multiple surface features to single downhole targets [ 8 , 10 , 2 , 33 , 29 , 22 , 23 , 30 , 34 , 5 , 31 , 9 , 12 ] . While these approaches have shown utility, they often rely on large labeled datasets for each target metric, struggle to generalize across wells, and are limited in their ability to support multiple predictive tasks simultaneously. Masked Autoencoder Foundation Models (MAEFMs), first introduced by He et al. [ 11 ] , constitute a fundamentally new class of ML models with capabilities that directly address these limitations. Building on the concept of latent-space representations originally proposed by Rumelhart et al. [ 21 ] , MAEFMs employ self-supervised pre-training to learn generalizable features from large unlabeled datasets and can subsequently be fine-tuned on relatively small labeled datasets for multiple downstream tasks. This paradigm is particularly well-suited to the oil and gas sector, where drilling operations generate abundant surface sensor data but labeled downhole measurements are scarce and expensive. MAEFMs have demonstrated state-of-the-art performance in both computer vision and time-series forecasting [ 19 ] , yet their application to downhole metric prediction remains entirely unexplored. The potential to leverage large-scale drilling datasets to learn transferable latent representations, enable multi-task predictions, and reduce dependence on labeled downhole data represents a significant opportunity for research and innovation in the sector. Given this context, it is important to evaluate the suitability of MAEFMs for oil and gas drilling applications, review existing ML approaches for downhole metric prediction, and identify performance limitations and knowledge gaps. This study aims to investigate the feasibility of MAEFMs for predicting critical downhole metrics, outline directions for future research, and highlight where this emerging technology could offer significant advantages in operational efficiency, safety, and cost reduction. II Research Questions The research study is guided by four research questions, each with one or more subquestions, designed to analyze the application of MAEFMs in oil and gas drilling. Q1: What measurements are important to oil and gas drillers? • Q1.1: What surface metrics are collected? • Q1.2: What downhole metrics are important to predict? Drilling is data-intensive, with numerous metrics collected at the surface and a desire to predict many downhole metrics. This question identifies what metrics can be used as inputs to ML models (i.e., metrics collected at the surface) and what metrics are the outputs of ML models (i.e., downhole metrics that are predicted), allowing for greater clarity of the scope of ML in oil and gas drilling. Q2: What methods are used to predict downhole metrics? • Q2.1: What methods are currently used to predict downhole metrics from surface drilling data? This question establishes how ML is currently used to predict downhole metrics, providing background context on current ML applications. Q3: Can MAEFMs be used for oil and gas drilling? • Q3.1: What are MAEFMs? • Q3.2: Are MAEFMs suitable for time-series data such as surface drilling metrics? • Q3.3: Are MAEFMs used in oil and gas drilling currently? This question evaluates the technical feasibility and novelty of MAEFMs in oil and gas drilling. This ensures that MAEFMs are suitable for oil and gas and are able to have an impact on the field. Q4: What should the research direction for MAEFMs in the context of oil and gas drilling be? • Q4.1: What areas could MAEFMs be applied to in oil and gas drilling? This question focuses on defining where MAEFMs could have the most impact, and where research should focus. This helps define the best opportunity for MAEFM application in oil and gas drilling. III Data Collection Methodology The data collection methodology is divided into three sections: paper search, inclusion and exclusion criteria, and data extraction. The methodology presented is consistent with methodologies presented by Peterson et al. [ 20 ] , making it a version of a systematic mapping study. III-A Paper Search A search query was crafted to find papers that used time-series surface drilling data to predict time-series downhole metrics using ML. The search query was composed of four parts that were combined with AND operators. The first part ensured domain relevancy, ensuring the search targeted research in the drilling space. The second part narrowed the search to research focused on downhole metrics. The third part further narrowed the search to prediction, ensuring research was focused on predicting downhole metrics. The final part of the search ensured ML was being used to predict the downhole drilling metrics, as opposed to rules based algorithms. This resulted in the following search query: ("drilling data" OR "surface drilling measurements" OR "surface drilling parameters") AND ("downhole metrics" OR "downhole parameters" OR "bottom hole pressure" OR "equivalent circulating density" OR "downhole vibrations" OR "torque and drag") AND ("prediction" OR "estimation" OR "forecasting" OR "time series") AND ("machine learning" OR "neural network" OR "deep learning" OR "regression" OR "artificial intelligence") Additionally, the following search criteria were applied: • Language: Published in English • Date Range: Published in or after January 2015 until November 2025 • Article Type: Article or conference proceedings • Availability: Full text available online The search was conducted across multiple databases, and the following databases returned at least

Read the complete text