Towards Fine-Tuning-Based Site Calibration for Knowledge-Guided Machine Learning: A Summary of Results
Ruolei Zeng, Arun Sharma, Shuai An, Mingzhou Yang, Shengya Zhang, Licheng Liu, David Mulla, Shashi Shekhar · 2025
Read Towards Fine-Tuning-Based Site Calibration for Knowledge-Guided Machine Learning: A Summary of Results by Ruolei Zeng, Arun Sharma, Shuai An, Mingzhou Yang, Shengya Zhang, Licheng Liu, David Mulla, Shashi Shekhar (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-16013.txt.
Introduction
Ruolei Zeng and seven co-authors wrote this summary paper on machine learning for farm and land carbon, shared on arXiv in 2025. Measuring how much carbon farms and ecosystems absorb or release is hard because conditions vary sharply from place to place. The team builds on a knowledge-guided method that blends physical rules with machine learning.
Their framework, called FTBSC-KGML, first trains one global model and then fine-tunes it for each state or site. It uses satellite measures of plant growth plus climate and soil data from several midwestern sites. In tests it gave lower error and steadier explanations than a single global model. The approach aims to give decision makers cheaper, more local carbon estimates.
Catalog record
| CREATOR | Ruolei Zeng, Arun Sharma, Shuai An, Mingzhou Yang, Shengya Zhang, Licheng Liu, David Mulla, Shashi Shekhar |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 36 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2512-16013
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Towards Fine-Tuning-Based Site Calibration for Knowledge-Guided Machine Learning: A Summary of Results Ruolei Zeng, Arun Sharma, Shuai An, Mingzhou Yang, Shengya Zhang, Licheng Liu, David Mulla, Shashi Shekhar Abstract Accurate and cost-effective quantification of the agroecosystem carbon cycle at decision-relevant scales is essential for climate mitigation and sustainable agriculture. However, both transfer learning and spatial variability exploitation in this field are challenging, as they involve heterogeneous data and complex cross-scale dependencies. Conventional approaches often rely on location-independent parameterizations and independent training, underutilizing transfer learning and spatial heterogeneity in the inputs, and limiting their applicability in regions with strong variability. We propose FTBSC-KGML (Fine-Tuning-Based Site Calibration–Knowledge-Guided Machine Learning), a pretraining- and fine-tuning-based, spatial-variability-aware, and knowledge-guided machine learning framework that augments KGML-ag with a pretraining-fine-tuning process and site-specific parameters. Using a pretraining-fine-tuning process with remote-sensing GPP, climate, and soil covariates collected across multiple midwestern sites, FTBSC-KGML estimates land emissions while leveraging transfer learning and spatial heterogeneity. A key component is a spatial heterogeneity-aware transfer-learning scheme: a globally pretrained model that is fine-tuned per state/site to learn place-aware representations, improving local accuracy under limited data without sacrificing interpretability. Empirically, FTBSC-KGML achieves lower validation error and more consistent explanatory power than a purely global model, better capturing spatial variability across states. This work extends the prior SDSA-KGML framework. Introduction Purely data-driven machine learning (ML) models often achieve limited success in scientific domains due to their high data requirements and inability to produce physically consistent results ( 28 ) . Thus, research communities have begun to explore integrating scientific knowledge with ML in a synergistic manner. The burgeoning field of knowledge-guided machine learning (KGML) offers a promising framework that integrates the strengths of process-based (PB) models, machine learning, and multi-source datasets. KGML has proven effective in spatial prediction tasks, such as land emissions estimation. However, current KGML models use location-independent parameters that overlook spatial heterogeneity across their large footprints, leaving little room for effective global-to-local transfer. As a result, performance and interpretability degrade in settings where processes are spatially variable ( 13 ) . To address these issues, this paper proposes a Fine-Tuning-Based Site Calibration–Knowledge-Guided Machine Learning (FTBSC-KGML) framework as a general schema to enhance current KGML methods by incorporating location-based parameter values and cross-site transfer learning. Building on prior work such as SDSA-KGML ( 18 ) , the proposed approach introduces a transfer-learning mechanism in which a globally pretrained, physics-guided model is fine-tuned for each site or state. This design bridges awareness of spatial variability with model calibration efficiency, leveraging knowledge from aggregated multi-state training while retaining site-specific interpretability. (a) (b) Fig. 1: Input and output of KGML-ag ( 12 ) . The problem is important for accurately predicting carbon and other emissions from land-use activities (e.g., agriculture, deforestation). Quantifying and controlling these emissions is crucial for climate change mitigation, optimum crop management, and maintaining sustainable agriculture. Predicting land emissions is challenging due to the heterogeneity of factors that affect them. This spatial variability, as implied by Tobler’s First Law of Geography ( 27 ) , encompasses variations in soil characteristics, moisture content, and other environmental conditions. Moreover, collecting ground truth data for this task is costly, complicating the training of large deep learning models. These challenges call for methods that both effectively capture spatial variability and are guided by physical knowledge. Related Work: The most common approach for predicting land emissions is based on process-based models, which use scientific theories that accurately explain the phenomena that occur, obeying principles such as mass and energy conservation. However, these models do not perform well in high spatial heterogeneity and variance, which is common in real-world settings ( 5 ) . Other approaches considered, especially for small-area estimation, include data-driven machine learning models. However, these models usually require extensive training data, which can be time-consuming and sometimes impossible to achieve. Knowledge-Guided Machine Learning (KGML) methods have been further explored, incorporating elements of both process-based models and data-driven machine learning approaches. For instance, KGML-ag ( 12 ) integrates several pretraining steps with knowledge from ecosys , a process-based model for agroecosystems, into a deep learning architecture. KGML-ag effectively addresses challenges such as spatial autocorrelation and scalability to larger datasets. However, as mentioned earlier, the lack of awareness of spatial variability in KGML-ag limits its performance and interpretability. To address this limitation, ( 18 ) proposed the Spatial Distribution-Shift Aware Knowledge-Guided Machine Learning (SDSA-KGML) framework, which introduced location-dependent parameters to explicitly account for spatial heterogeneity and distribution shifts across regions such as Illinois, Iowa, and Indiana. Their results demonstrated that incorporating region-specific parameters enhanced local accuracy under strong spatial variability. Building upon this direction, our proposed Fine-Tuning-Based Site Calibration (FTBSC-KGML) extends SDSA-KGML by introducing a transfer-learning mechanism in which a globally pretrained model is fine-tuned for each site or state. This approach bridges spatial variability awareness with model calibration efficiency, leveraging knowledge from aggregated multi-state training while retaining site-specific interpretability. Empirically, this mechanism significantly improves local performance in data-limited regions, mitigating overfitting and preserving knowledge-guided physical constraints. Organization: The paper is organized as follows: Section 2 introduces basic concepts. Section 3 formally defines the problem. Section 4 discusses design decisions. Section 5 presents the proposed approach. Section 6 discusses experimental evaluation. Section 7 concludes the paper and discusses future work. Basic Concepts Knowledge-Guided Machine Learning-ag: The KGML-ag model takes climate and soil data as inputs and generates predictions of agricultural carbon fluxes, crop yields, and changes in soil carbon stocks (i.e., carbon quantity) as outputs ( 2 ) . The input data are gathered from diverse sources, including Eddy Covariance (EC) flux tower sites ( 14 ) , regional survey yield data, remotely sensed gross primary production data, and synthetic data generated by a process-based model. While these data offer a rich set of features, they also present challenges, such as inconsistencies between real and synthetic data and varying data quality ( 1 ) . KGML-ag uses a hierarchical structure with five submodules, including (1) a GRU_Ra module for daily Autotrophic Respiration (Ra) estimation, (2) a GRU_Rh module for daily Heterotrophic Respiration (Rh) estimation, (3) a GRU_NEE module for daily Net Ecosystem Exchange (NEE) estimation, (4) an attention module for crop yield estimation, and (5) a GRU_Basis module to connect and support the other four modules ( 12 ) . Synthetic Data: Along with real sample data, the KGML-ag model is trained on synthetic data generated by the ecosys model ( 4 ) to improve its generalization. The ecosys model simultaneously simulates carbon, water, and nutrient cycles within the soil and plant system based on biophysical and biochemical principles ( 16 ) . In this context, the model is used to generate county-level synthetic data on ecosystem carbon allocation, associated fluxes, and environmental responses. The 5 Step Training Process: KGML-ag uses a five-step training method: 1) Pretrain the yield and Ra submodules using the synthetic data. 2) Pretrains the Ra, Rh, and NEE submodules using the synthetic data. After steps 1 and 2, the KGML-ag model can imitate the ecosys model for yield, Ra, Rh, and NEE. 3) The yield module is fine-tuned with county-level crop yield data. 4) Use synthetic data to maintain Ra, Rh, and NEE pretraining after yield fine-tuning. Despite the similarity between 2) and