Advancing site-specific disease and pest management in precision agriculture: From reasoning-based foundation models to adaptive, feedback-driven learning

Nitin Rai, Daeun (Dana) Choi, Nathan S. Boyd, Arnold W. Schumann · 2025

Read Advancing site-specific disease and pest management in precision agriculture: From reasoning-based foundation models to adaptive, feedback-driven learning by Nitin Rai, Daeun (Dana) Choi, Nathan S. Boyd, Arnold W. Schumann (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-24650.txt.

Introduction

Nitin Rai, Daeun Choi, Nathan S Boyd, and Arnold W Schumann review how new base models could change crop pest and plant ill control. Old tools used hand made traits, then deep nets learned traits on their own. Base models add text and image sense, plus plain talk with growers.

The team screened about forty works on these models for site based care. They found use rose fast in the past two years, and image text models led text only ones. Smart spray with learn by trial is still new. Twin models in code may let farms test spray plans in a safe fake field first.

Catalog record

CREATORNitin Rai, Daeun (Dana) Choi, Nathan S. Boyd, Arnold W. Schumann
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE68 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2510-24650

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Advancing site-specific disease and pest management in precision agriculture: From reasoning-based foundation models to adaptive, feedback-driven learning Nitin Rai, Daeun (Dana) Choi, Nathan S. Boyd, Arnold W. Schumann Abstract Site-specific disease management (SSDM) in agricultural crops has witnessed tremendous advancements over the past few decades using conventional machine and deep learning (ML & DL) approaches for real-time computer vision applications. This research has evolved from handcrafted feature extraction to large-scale automated feature learning in single-modality datasets. However, with the rise of foundation models (FMs), the way large-scale crop disease datasets are processed is being fundamentally transformed. Unlike traditional convolutional neural networks, which often struggle to integrate multi-modal data or connect visual and textual information, FMs enable deeper level of understanding. They can interpret disease symptoms described in text, reason about relationships between symptoms and management factors, and even support interactive Q&A platforms for growers and extension educators. Likewise, the integration of adaptive and imitation learning in robotics is enabling novel applications for field-based disease management. These emerging shifts in advanced computer vision and robotics research are redefining how crops are monitored and managed in in-field settings. Therefore, this study reviewed ≈ \approx 40 research articles (with appropriate screening criteria) to highlight the application of FMs for SSDM in crops, focusing on two primary themes: large-language models (LLMs), and vision language models (VLMs). Additionally, the extended role of FMs in enabling adaptive learning (AL), reinforcement learning (RL), and digital twin frameworks for robotics-based targeted spraying is also discussed. Based on the results and discussion, several key conclusions emerge from this review: (a) FMs are gaining traction, with a notable increase in reported technical literature during 2023-24, (b) researchers are leveraging VLMs more than LLMs, with a five-to tenfold increase in published articles from 2023 to 2024, (c) approaches such as RL or AL are still in their infancy for developing smart spraying technologies that can learn from experience, (d) the integration of digital twins with RL in cyber-physical systems could offer a transformative approach for simulating targeted spraying in virtual environments, (e) addressing the sim-to-real gap, the performance drop when models trained in simulated or controlled environments are deployed in real-world disease scenarios, will be critical for ensuring robust and scalable management systems, (f) while perception models for disease detection are advancing, human-robot collaboration in crop disease management remains limited, particularly in leveraging human-in-the-loop approaches where robots autonomously detect early symptoms and humans validate uncertain cases, and (g) continued advancements in FMs, along with multi-modal integration and real-time feedback, are expected to drive the next generation of SSDM technologies. For updates, resources, and contributions, please visit our AgriPathogenDatabase GitHub repository and consider submitting papers, code, or datasets. K eywords Crop diseases \cdot Foundation models \cdot Reinforcement learning \cdot Imitation learning \cdot Adaptive learning \cdot Digital twin \cdot Target spraying \cdot Robotics \cdot Precision agriculture. Abbreviations The table below includes a list of abbreviations and its subsequent descriptions used in the review study. Abbreviations Descriptions AI Artificial intelligence AL Adaptive learning BERT Bidirectional encoder representations from transformers CLIP Contrastive language-image pre-training CNN Convolutional neural network DINO DIstillation with NO labels DL Deep learning DT Digital twin FM Foundation model GAN Generative adversarial network GPT Generative pre-trained transformer HS Hyperspectral IL Imitation learning IoT Internet of things LLM Large language models LoRA Low-Rank Adaptation ML Machine learning MS Multispectral NLP Natural language processing RGB Red, Green, and Blue RL Reinforcement learning SAM Segment anything model SD Stable diffusion SSDM Site-specific disease management UAV Unmanned aerial vehicle ViT Vision transformer VLA Vision-language-action VLM Vision language models YOLO You Only Look Once 1 Introduction The application of artificial intelligence (AI) has transformed agricultural automation across diverse domains, including weed classification for spot spraying [ 1 , 2 ] , crop yield estimation [ 3 , 4 ] , disease monitoring [ 5 , 6 ] , phenotyping [ 7 , 8 ] , and plant breeding [ 9 , 10 ] . Among these, AI-driven computer vision models have emerged as particularly impactful in crop disease and pest management, where accurate visual recognition is pivotal for early detection and targeted intervention. These vision-based systems are increasingly integrated with smart sprayers and autonomous robots, enabling site-specific fungicide application while reducing chemical inputs and operational costs [ 11 , 12 ] . A major driver of this precision capability lies in the synergy between computer vision models deployed on edge systems, which provides machines with the ability to perceive and interpret complex agricultural environments. At the heart of this development is data, large-scale image datasets, combined with the representation power of deep learning (DL) models, have been pivotal in transmitting “vision” to agricultural robots, thereby bridging the gap between raw perception and actionable intelligence in the field. Despite these advancements that DL models, particularly convolutional neural networks (CNNs), have achieved to address site-specific disease management (SSDM) in crops, they face notable limitations when deployed in agricultural environments. Their performance is often constrained by the availability of annotated datasets, which are expensive and time-consuming to curate for the wide variety of crops, diseases, and field conditions. Moreover, CNN models often require fine-tuning or transfer learning approaches when applied to new crops, disease symptoms, or environmental settings. These models are also limited to applications where multi-modalities of data is generated, as they can only take one format of data at a time. Such constraints have highlighted the need for more adaptive and generalizable approaches, where foundation models (FMs), trained on massive multi-modal datasets demonstrate clear advantage. The term “foundation models” was first used by researchers at Stanford University [ 13 ] . FMs are pretrained on massive and diverse datasets, have emerged as a transformative paradigm in computer vision, with the potential to overcome many limitations posed by CNN models. Unlike conventional models, FMs such as Contrastive Language-Image Pre-training (CLIP), Segment Anything (SAM) [ 14 , 15 ] , and Generative Pretrained Transformer (GPT) [ 16 ] architectures, are inherently versatile as they can be adapted to downstream agricultural tasks with minimal retraining and are capable of few-shot and even zero-shot learning [ 17 , 18 ] . Several studies demonstrate their utility in crop disease detection and synthetic data generation, showcasing improved generalization and robustness compared to traditional task-specific models. For instance, the PlantCaFo model was developed using a few-shot approach that leverages the model’s prior knowledge [ 19 ] . Another work was inspired by the CLIP architecture and used the Progressive Mixup Prompt Leaning (PMPL) framework, which integrates hierarchical feature Mixup with prompt learning for crop disease recognition [ 20 ] . Their ability to encode broad semantic understanding with the help of text-based prompts has introduced a step-change in how agricultural tasks can be analyzed, enabling models to move beyond narrow classification tasks toward more context-aware decision support tools. With the help of FMs, users can now access interactive Q&A interfaces where they upload an image of a crop showing disease symptoms, and the model can reason about the presence of a particular disease, unlike conventional models trained only on specific labels [ 21 , 22 ] . This shift transforms conventional computer vision from a static diagnostic tool into a dynamic algorithm that makes

Read the complete text