To Measure or Not: A Cost-Sensitive, Selective Measuring Environment for Agricultural Management Decisions with Reinforcement Learning
Hilmy Baja, Michiel Kallenberg, Ioannis N. Athanasiadis · 2025
Read To Measure or Not: A Cost-Sensitive, Selective Measuring Environment for Agricultural Management Decisions with Reinforcement Learning by Hilmy Baja, Michiel Kallenberg, Ioannis N. Athanasiadis (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-12823.txt.
Introduction
Farmers must decide when a crop measurement is worth its cost, and Hilmy Baja, Michiel Kallenberg, and Ioannis Athanasiadis build that choice into a learning system in a 2025 paper. Field observations guide choices that affect profit and the environment, yet measuring crop state takes labor, time, and money. It is rarely feasible to measure before every decision.
Earlier farm optimization work often assumed that observations come free. The authors instead design a reinforcement learning environment where measuring has an explicit cost. The agent learns to pick good moments to both measure crop features and apply nitrogen fertilizer. That joint choice balances cost against better decisions. Readers get a more realistic frame for farm advice tools.
Catalog record
| CREATOR | Hilmy Baja, Michiel Kallenberg, Ioannis N. Athanasiadis |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 38 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-12823
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
To Measure or Not: A Cost-Sensitive, Selective Measuring Environment for Agricultural Management Decisions with Reinforcement Learning Hilmy Baja, Michiel Kallenberg, Ioannis N. Athanasiadis Abstract Farmers rely on in-field observations to make well-informed crop management decisions to maximize profit and minimize adverse environmental impact. However, obtaining real-world crop state measurements is labor-intensive, time-consuming and expensive. In most cases, it is not feasible to gather crop state measurements before every decision moment. Moreover, in previous research pertaining to farm management optimization, these observations are often assumed to be readily available without any cost, which is unrealistic. Hence, enabling optimization without the need to have temporally complete crop state observations is important. An approach to that problem is to include measuring as part of decision making. As a solution, we apply reinforcement learning (RL) to recommend opportune moments to simultaneously measure crop features and apply nitrogen fertilizer. With realistic considerations, we design an RL environment with explicit crop feature measuring costs. While balancing costs, we find that an RL agent, trained with recurrent PPO, discovers adaptive measuring policies that follow critical crop development stages, with results aligned by what domain experts would consider a sensible approach. Our results highlight the importance of measuring when crop feature measurements are not readily available. Code — https://github.com/WUR-AI/CropGym-ToMeasureOrNot Introduction As the global population continues to grow and the impacts of climate change become more prominent, optimal farm management decisions play a crucial role in our future sustenance. Effective farm management practices are key to not only ensure food security but also mitigate the apparent environmental risks related to agriculture ( Lipper et al. 2014 ) . Environmental risks come from mismanagement of farming activities, such as over-applying fertilizer and pesticides ( Martínez-Dalmau, Berbel, and Ordóñez-Fernández 2021 ) . In practice, farmers rely on their experience and in-field observations to make better-informed management decisions in order to minimize costs and reduce environmental impacts. For instance, before fertilizing, a farmer might measure the soil (or leaf) nitrogen content and based on that decide when and how much fertilizer to apply ( Berghuijs et al. 2024 ) . However, acquiring a large amount of in-field agricultural data is labor intensive, time-consuming and expensive ( Wu et al. 2022a ) . In most cases, the cost and inconvenience of collecting and processing the data outweigh its informational usefulness for the farmer ( Thompson et al. 2019 ) . Furthermore, this issue is compounded in regions with low data availability and high data collection costs, as the infrastructure required for gathering such data is limited, presenting a large hurdle for applying data-driven optimization ( Cravero et al. 2022 ) . By integrating data-collection recommendations as part of decision-making, data collection can be optimized and executed only when it is the most beneficial for the farmer. Specifically, it is of importance to have a system that simultaneously recommends optimal moments in a growing season to obtain measurements of crop states for the objective of cost-effective and optimal management. The unrealistic assumption that feature observations are readily available has prompted recent work in reinforcement learning (RL) pertaining to active feature measuring for balancing measurement costs ( Bellinger et al. 2021a ) . Previous work has shown early success in this setting, however, it assumed uniformity in the feature costs ( Yin et al. 2020 ) . In the real-world, recognizing that certain features are more expensive to measure than others is essential, as it potentially influences the policies that an RL agent learns. In this work, we experiment on the effect of cost in a measure-and-control paradigm and design an RL environment in which an agent interacts with a crop growth model (CGM) environment during a growing season. It is important to acknowledge that crop features have different measuring costs. The ability to optimize fertilization with fewer crop state measurements is important to lower the hurdle of applying data-driven methods for improving agricultural management activities. We summarize our contributions below: • We propose an RL paradigm of costly measurements for crop management, incorporating crop state measurements as part of decision making; • We design and provide code for an RL environment, coupled with the WOFOST ( Berghuijs et al. 2024 ) crop growth model, that allows an agent to simultaneously learn a control policy (fertilization, irrigation, etc.) and a measuring policy. The RL environment is highly configurable, enabling the user to define their own objectives and RL spaces; • We defined a financial focused reward function that includes the definition of feature measurement costs; • We test our approach in silico in a case study in the Netherlands, optimizing fertilization for winter wheat in a rain-fed environment. Experimental results show that costs indeed affect the RL agent’s optimization capabilities, where higher costs prove detrimental to the agent’s performance. Nevertheless, with realistic costs, the RL agent manages to achieve better performance compared to a baseline of standard practice. Related Work This work fits in two growing RL research areas: RL for agriculture and costly active-measuring and -feature acquisition in RL. RL for crop management . Generally, early RL research in agriculture utilizes simulated environments ( Gautron et al. 2022a ; Goldenits et al. 2024 ) . The bulk of prior research builds a Gym interface that wraps around a CGM and obtain management policies in silico . Notable examples include CropGym ( Overweg, Berghuijs, and Athanasiadis 2021 ; Kallenberg et al. 2023 ) , gym-DSSAT ( Gautron et al. 2022b ) , SWATGym ( Madondo et al. 2023 ) , and CyclesGym ( Turchetta et al. 2022 ) . Related to partially observable crop management, Tao et al. 2022 employed imitation learning to let an RL agent trained with large number of state features to work with a subset of these state features. Each work demonstrated a good potential for RL in crop management. However, these prior works assume temporally complete feature observations , which is almost always not the case due to the cost, time and effort of acquiring these observations. Turchetta et al. 2022 identified these costly observations as a core challenge for RL in agriculture. Costly measuring in RL. Using deep RL, there have been several studies of costly measurements ( Bellinger, Crowley, and Tamblyn 2023 ; Krale, Simão, and Jansen 2023 ) . In the context of active measuring, Nam, Fleming, and Brunskill 2021 formalized an MDP framework called action-contingent noiselessly observable MDP (ACNO-MDP) that, similarly, defines an explicit cost to observe the complete observation space. These prior works assume completely missing feature observations in certain time steps, which does not perfectly fit the formalization of our problem, but nonetheless still describes the general joint measuring and control approach. Costly active feature acquisition in RL. Active feature acquisition (AFA) describes a paradigm where an agent can select features to acquire to improve model accuracy. There has been a fair amount of prior work in the machine learning domain about AFA ( Shim, Hwang, and Yang 2018 ; Kossen et al. 2023 ) . In RL, the work of Yin et al. 2020 includes the formalization of a POMDP extension they call AFA-POMDPs. They employ a sequential variational auto encoder (seq-VAE), that is pre-trained with fully observable features offline, to learn a