Data-Driven Integration Kernels for Interpretable Nonlocal Operator Learning Publication type: METHODS PAPER Journal: Environmental Data Science
Savannah L. Ferretti, Jerry Lin, Sara Shamekh, Jane W. Baldwin, Michael S. Pritchard, Tom Beucler · 2026
Read Data-Driven Integration Kernels for Interpretable Nonlocal Operator Learning Publication type: METHODS PAPER Journal: Environmental Data Science by Savannah L. Ferretti, Jerry Lin, Sara Shamekh, Jane W. Baldwin, Michael S. Pritchard, Tom Beucler (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-10305.txt.
Introduction
Savannah L Ferretti and co-authors add structure to machine learning of nonlocal climate processes, so what the model learns stays readable. Their data-driven integration kernels first gather each field over space, height, or time with learnable weighting functions, and only then apply a local nonlinear map. Each kernel can be read as a pattern showing which places, levels, and past times matter most. On South Asian monsoon rain, kernel models nearly match baseline skill with far fewer trained weights, curbing overfitting risk.
Catalog record
| CREATOR | Savannah L. Ferretti, Jerry Lin, Sara Shamekh, Jane W. Baldwin, Michael S. Pritchard, Tom Beucler |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 40964 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.10305
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Data-Driven Integration Kernels for Interpretable Nonlocal Operator Learning Publication type: METHODS PAPER Journal: Environmental Data Science Savannah L. Ferretti, Jerry Lin, Sara Shamekh, Jane W. Baldwin, Michael S. Pritchard, Tom Beucler Abstract Machine learning models can represent climate processes that are nonlocal in horizontal space, height, and time, often by combining information across these dimensions in highly nonlinear ways. While this can improve predictive skill, it makes learned relationships difficult to interpret and prone to overfitting as the extent of nonlocal information grows. We address this challenge by introducing data-driven integration kernels, a framework that adds structure to nonlocal operator learning by explicitly separating nonlocal information aggregation from local nonlinear prediction. Each spatiotemporal predictor field is first integrated using learnable kernels (defined as continuous weighting functions over horizontal space, height, and/or time), after which a local nonlinear mapping is applied only to the resulting kernel-integrated features and optional local inputs. This design confines nonlinear interactions to a small set of integrated features and makes each kernel directly interpretable as a weighting pattern that reveals which horizontal locations, vertical levels, and past timesteps contribute most to the prediction. We demonstrate the framework for South Asian monsoon precipitation using a hierarchy of neural network models with increasing structure, including baseline, nonparametric kernel, and parametric kernel models. Across this hierarchy, kernel models achieve near-baseline performance with far fewer trainable parameters, indicating that much of the relevant nonlocal information can be captured through a small set of interpretable integrations when appropriate structural constraints are imposed. keywords nonlocal operator learning; interpretable machine learning; kernel integration 2026 {Frontmatter} \orcid 0000-0001-9684-7668 \orcid 0000-0003-1778-9426 \orcid 0000-0001-7441-4116 \orcid 0000-0002-4174-2743 \orcid 0000-0002-0340-6327 \orcid 0000-0002-5731-1040 \authormark Ferretti et al. Impact Statement Many geophysical processes depend on nonlocal structure in horizontal space, height, and time, yet most data-driven models encode these dependencies implicitly, limiting interpretability and robustness. This work introduces data-driven integration kernels, which make nonlocal influence explicit by separating how information is aggregated from how local predictions are made. Because kernels define physically interpretable weighting patterns, they allow nonlocal structure to be analyzed and compared alongside predictive performance, revealing whether different modeling choices rely on similar forms of nonlocal dependence. The resulting kernel-integrated features provide a direct pathway for informing and constraining physically interpretable parameterizations derived from data-driven models. 1 Introduction Geophysical processes are inherently nonlocal, with local outcomes depending on conditions across neighboring horizontal locations, the vertical column, and past timesteps. A growing body of machine learning research addresses this structure by learning operators ( 16 ) that map entire, high-dimensional input fields to local outputs. Such models have been used to learn nonlocal processes in weather and climate, and have achieved strong predictive performance across a range of applications ( 21 ; 4 ; 24 ) . These operator-learning approaches can flexibly combine information across horizontal space, height, and time, but nonlocal contributions are typically encoded implicitly within large parameter sets, making it difficult to identify which spatial scales, vertical levels, or memory timescales are most influential. As a result, adding broader nonlocal context can increase model complexity without providing clearer insight into how nonlocal information is actually used. A range of strategies have been proposed to manage this complexity. Dimensionality-reduction approaches such as principal-component analysis and encoder–decoder architectures (including autoencoders) compress high-dimensional fields into lower-dimensional latent representations, but these representations often reflect architectural or statistical choices rather than physically meaningful structure ( 15 ; 18 ; 23 ) . Post-hoc explainability methods aim to attribute predictions to influential regions or features, but depend on both the trained model and the attribution technique. As a result, they can mix contributions across predictors and dimensions and yield sample-dependent attributions that are difficult to interpret physically ( 22 ; 19 ) . Because these approaches rely on additional models fitted after training, they can compound uncertainty, reinforce prior expectations, and fail to provide stable summaries of nonlocal influence. We introduce integration kernel learning , which addresses these requirements by representing a model’s nonlocal behavior through learned kernels that weight information across horizontal space, height, and/or time prior to prediction. By explicitly separating nonlocal integration from local nonlinear mapping, the framework constrains the operator class while preserving flexibility in local response. The learned kernels yield continuous, coordinate-aware summaries of nonlocal influence, embedding interpretability directly into the operator without sacrificing predictive skill. Key contributions of this work include: • We introduce integration kernel learning as an interpretable framework for representing nonlocal operators using continuous weighting functions over horizontal space, height, and time. • We show that separating nonlocal integration from local nonlinear mapping regularizes the operator class and yields interpretable kernels. • We develop a hierarchy of models, from unconstrained neural networks to nonparametric and parametric kernel models, to quantify trade-offs between skill, complexity, and interpretability. • We apply the framework to South Asian monsoon precipitation as a case study, showing that kernel models retain most of the predictive skill of full-field models while revealing key dependencies. 2 Methodology We represent nonlocal dependencies in continuous geophysical data using a two-step procedure. First, predictor fields are integrated over horizontal space, height, and/or time using learnable kernels to form lower-dimensional features. Second, these kernel-integrated features are passed to a local nonlinear mapping to predict the target variable. We use a spatiotemporal coordinate system standard in atmospheric applications, but the formulation is readily generalized to other nonlocal processes and coordinate systems. 2.1 Nonlocal Operators via Integration Kernels Let \mathbf{x} denote horizontal location, p denote pressure, and t denote time. We aim to predict a target variable (e.g., precipitation) y(\mathbf{x}_{0},t_{0}) at location \mathbf{x}_{0} and time t_{0} using predictor fields (e.g., temperature and humidity) \{\varphi_{i}(\mathbf{x},p,t)\}_{i=1}^{N_{\varphi}} , where N_{\varphi} is the number of predictor variables. Predictor fields are defined over horizontal space, pressure, and time, while the target variable is defined only over horizontal space and time. We view the mapping from predictor fields to the target as a nonlocal operator \mathcal{L} and approximate: y(\mathbf{x}_{0},t_{0})\approx\mathcal{L}\big[\{\varphi_{i}\}\big](\mathbf{x}_{0},t_{0}), (2.1) where \{\varphi_{i}\} denotes the collection of all predictor fields. A purely local model would restrict y(\mathbf{x}_{0},t_{0}) to depend only on \varphi_{i}(\mathbf{x}_{0},p_{0},t_{0}) , where p_{0} denotes the vertical level nearest the surface, which is insufficient for quantities such as precipitation that depend on nonlocal structure ( 5 ) . We therefore allow \mathcal{L} to depend on a surrounding neighborhood in horizontal space, height, and time. To parameterize this neighborhood dependence, we use integration kernels . For each predictor field \varphi_{i} , integration kernels define linear operators that aggregate the field over specified domains in horizontal space, height, and/or time relative to the prediction point. Each operator produces a kernel-integrated feature, and multiple kernels for the same predictor may differ in their domains or weighting patterns, yielding distinct aggregated summaries of \varphi_{i} . The collection of these features provides a low-dimensional representation of the nonlocal information used in the subsequent prediction step. Formally, the \ell^{\mathrm{th}} kernel-integrated feature associated with predictor \varphi_{i} is defined as: \widehat{\varphi}_{i}^{(\ell)}(\mathbf{x}_{0},t_{0})=\int_{t_{0}-\tau_{\max}}^{t_{0}}\int_{0}^{p_{s}}\int_{\mathcal{D}}k_{i}^{(\ell)}(\mathbf{x},p,t;\mathbf{x}_{0},t_{0})\,\varphi_{i}(\mathbf{x},p,t)\,\mathrm{d}\mathbf{x}\,\mathrm{d}p\,\mathrm{d}t, (2.2) where \mathcal{D} denotes a neighborhood of horizontal locations around \mathbf{x}_{0} , p\in[0,p_{s}] is the pressure coordinate with p = 0 hPa at the top of the atmosphere and p = p_{s} at the surface, and \tau_{\max}>0 sets the temporal memory. The temporal integral is restricted to t\leq t_{0} to