Towards Large Reasoning Models for Agriculture

Hossein Zaremehrjerdi, Shreyan Ganguly, Ashlyn Rairdin, Elizabeth Tranel, Benjamin Feuer, Juan Ignacio Di Salvo, Srikanth Panthulugiri, Hernan Torres Pacin, Victoria Moser, Sarah Jones, Joscif G Raigne, Yanben Shen, Heidi M. Dornath, Aditya Balu, Adarsh Krishnamurthy, Asheesh K Singh, Arti Singh, Ba · 2025

Read Towards Large Reasoning Models for Agriculture by Hossein Zaremehrjerdi, Shreyan Ganguly, Ashlyn Rairdin, Elizabeth Tranel, Benjamin Feuer, Juan Ignacio Di Salvo, Srikanth Panthulugiri, Hernan Torres Pacin, Victoria Moser, Sarah Jones, Joscif G Raigne, Yanben Shen, Heidi M. Dornath, Aditya Balu, Adarsh Krishnamurthy, Asheesh K Singh, Arti Singh, Ba (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-19259.txt.

Introduction

Large reasoning models may serve farm decisions better than standard language models, Hossein Zaremehrjerdi and a large team of co-authors argue in a 2025 paper. Agricultural choices about crops, practices, and interventions depend heavily on geographic, climatic, and economic conditions. Traditional language models often fall short on such nuanced, context-specific reasoning, since the right answer shifts with place and season.

The team introduces AgReason, an expert-curated open-ended science benchmark with one hundred questions for agriculture. It is presented as the first benchmark of its kind. With it, they test whether reasoning models handle structured, domain-specific inference better. Readers in agricultural technology get both a test bed and early evidence on a question that affects tool design for farmers.

Catalog record

CREATORHossein Zaremehrjerdi, Shreyan Ganguly, Ashlyn Rairdin, Elizabeth Tranel, Benjamin Feuer, Juan Ignacio Di Salvo, Srikanth Panthulugiri, Hernan Torres Pacin, Victoria Moser, Sarah Jones, Joscif G Raigne, Yanben Shen, Heidi M. Dornath, Aditya Balu, Adarsh Krishnamurthy, Asheesh K Singh, Arti Singh, Ba
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE78 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-19259

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Towards Large Reasoning Models for Agriculture Hossein Zaremehrjerdi, Shreyan Ganguly, Ashlyn Rairdin, Elizabeth Tranel, Benjamin Feuer, Juan Ignacio Di Salvo, Srikanth Panthulugiri, Hernan Torres Pacin, Victoria Moser, Sarah Jones, Joscif G Raigne, Yanben Shen, Heidi M. Dornath, Aditya Balu, Adarsh Krishnamurthy, Asheesh K Singh, Arti Singh, Baskar Ganapathysubramanian, Chinmay Hegde, Soumik Sarkar Abstract Agricultural decision-making involves complex, context-specific reasoning, where choices about crops, practices, and interventions depend heavily on geographic, climatic, and economic conditions. Traditional large language models (LLMs) often fall short in navigating this nuanced problem due to limited reasoning capacity. We hypothesize that recent advances in large reasoning models (LRMs) can better handle such structured, domain-specific inference. To investigate this, we introduce AgReason , the first expert-curated open-ended science benchmark with 100 questions for agricultural reasoning. Evaluations across thirteen open-source and proprietary models reveal that LRMs outperform conventional ones, though notable challenges persist, with the strongest Gemini–based baseline achieving 36% accuracy. We also present AgThoughts , a large-scale dataset of 44.6K question-answer pairs generated with human oversight and equipped with synthetically generated reasoning traces. Using AgThoughts , we develop AgThinker , a suite of small reasoning models that can be run on consumer-grade GPUs, and show that our dataset can be effective in unlocking agricultural reasoning abilities in LLMs. Our project page is here: The AgReason LeaderBoard . 1 Introduction Agriculture is the cornerstone of global sustenance, providing the essentials — food, feed, and fiber — needed to support growing populations [ 1 ] . It is also a critical pillar of the global economy, employing nearly one-third of the world’s workforce and contributing over 4% to global GDP [ 2 , 3 ] . Decision making in agricultural settings is very nuanced; farmers depend on a variety of cues including location-specific soils, microclimates, crop varieties, and dynamic biotic threats, for everyday decision making. As a result, university extension agents and crop advisors routinely address highly contextualized questions — “What should I do about knotweeds in my barley field located in Colorado in September?” or “How can I manage a low yield of corn harvest in Vermont?” — that demand fine-grained, situational reasoning. Agricultural decision support tools based on mainstream LLMs [ 4 , 5 ] often falter in such scenarios. Recent emergence of large reasoning models (LRMs) has shown promise in structured reasoning tasks in domains like mathematics, coding, and logic [ 6 , 7 ] . Flagship benchmarks and reasoning-focused datasets have emerged to evaluate and fine-tune such models [ 8 , 9 ] . However, establishing benchmarks and curating datasets for open-ended scientific decision support have been challenging, as it requires close collaboration with domain experts. Multiple choice based science benchmarks such as GPQA [ 10 ] and ScienceQA [ 11 ] are effective in evaluating broad multitask science knowledge, but do not capture the geo-spatial, seasonal, and management complexities that dominate real-world agricultural decisions. Consequently, models that perform well on these tests may still produce overly generic or impractical agronomic recommendations. Existing agriculture-specific datasets and benchmarks, such as AgXQA [ 12 ] and AgriBench [ 13 ] tend to focus on closed-form factual recall or narrow sub-domains. Therefore, the evaluation and fine-tuning of reasoning models in context-specific agricultural scenarios remain largely unexplored. To address this gap, we introduce AgThoughts and AgReason , two complementary resources aimed at advancing agricultural reasoning in language models. AgThoughts , is a dataset of 44.6K question–answer pairs with explicit reasoning traces generated with oversight from agronomy experts. The data set contains diverse, realistic questions in ten key categories, taking into account variables such as geography, crop stage, disease risk, and weather. From this pool of questions we curate AgReason , a benchmark of 100 open-ended questions with gold-standard responses validated by agronomy experts. These questions reflect real agricultural extension workflows and require multi-step reasoning over location-specific agronomic factors. We evaluate 13 state-of-the-art open-source and proprietary models on AgReason using a carefully designed LLM-as-judge to compare with expert-validated responses. Additionally, we leverage AgThoughts to produce a series of small reasoning models — AgThinker — to enable lightweight, domain-specific reasoning. Our results show that while LRMs significantly outperform standard LLMs on AgReason , even the best performing LRM was only able to achieve a 36% success rate, demonstrating plenty of room for further AI progress in the agricultural domain. 2 Related work Reasoning models, datasets, and benchmarks: As LLMs grow in complexity, evaluating their reasoning capabilities using well-curated benchmarks has become essential. Recent research has focused on developing LLMs with explicit reasoning mechanisms. DeepSeek-R1 [ 14 ] introduced a reinforcement-learning-assisted pipeline to enhance reasoning via supervised fine-tuning (SFT). Both open-source models such as Qwen-QwQ [ 15 ] and LLaMA-4 [ 16 ] , and proprietary systems like OpenAI-O1, Gemini 2.5-Flash, and Claude 3.7-Sonnet demonstrate strong reasoning performance. Table 1 : Classification of reasoning datasets for LLMs; we categorize the datasets by their size, domain of involvement, source reasoning model used in generating Dataset Size Subjects Source Model Sky-T1 [ 8 ] 17k Math, Code, Science DeepSeek-R1 Bespoke-Stratos-17k [ 17 ] 17k Math, Code, Puzzles Open-source FreedomIntelligence/medical-o1-reasoning-SFT [ 18 ] 44.6k Medicine DeepSeek-R1 OpenThoughts-114k [ 19 ] 114k Math, Science, Code, Puzzles DeepSeek-R1 Dolphin-R1 [ 20 ] 800k Math, Code, Chat DeepSeek-R1, Gemini 2.0 GlaiveAI/Reasoning-v1-20M [ 21 ] 22M Logic, Writing, Dialogue R1-Distill-LLaMA-70B AgThoughts (ours) 44.6k Science, Agriculture DeepSeek-R1 New datasets have emerged that capture detailed reasoning traces (see Table 1 ). Efforts such as SkyT1-17K [ 8 ] and Bespoke-Stratos-17K [ 17 ] provided question–response pairs enriched with intermediate reasoning steps in domains like mathematics, programming, and science. OpenThoughts-114K [ 19 ] expanded this effort with over 100,000 multi-domain examples used to train models like OpenThinker-32B. Similarly, Dolphin-R1 [ 20 ] contributed nearly 800,000 samples emphasizing logical inference, while GlaiveAI’s Reasoning-v1-20M [ 21 ] introduced over 22 million examples, making it one of the largest open-domain reasoning datasets available. On the benchmarks side, Arena-Hard [ 22 ] presents a curated benchmark of 500 user-sourced questions from Chatbot Arena; LiveBench [ 9 ] offers a dynamic, regularly updated benchmark of real-world questions across domains like math, code, reasoning, and data analysis; and GPQA [ 23 ] offers challenging open-world questions focusing on basic science. A multitude of domain-specific benchmarks have also emerged; see Table 2 . Table 2 : Classification of reasoning benchmarks for LLMs; we categorize benchmarks on domain of dataset, whether human experts were involved in the data curation process, whether the evaluation tasks are ground-truth or open-ended, and the types of the task involved. Benchmark Domain Human-in-the-loop Open-ended Question Type LiveCodeBench [ 24 ] Coding Yes No Code Generation/Completion LiveBench [ 9 ] Math, Coding Yes No Multiple Choice/Short Answer MedXpertQA [ 25 ] Medicine No No Multiple Choice LegalBench [ 26 ] Law Yes Partial Multiple Choice/Free Response ScienceQA [ 11 ] Science No No Multiple Choice GPQA [ 10 ] Science Yes No Multiple Choice AgReason (ours) Agriculture Yes Yes Free Response Agriculture specific datasets and benchmarks: Agriculture is a domain that demands not only factual knowledge but also context-aware reasoning. Early works, such as [ 27 ] , highlight the limitations of GPT-style models in addressing agricultural extension questions and advocate for human-in-the-loop refinement. AGXQA [

Read the complete text