MIRAGE: A Benchmark for Multimodal Information-Seeking and Reasoning in Agricultural Expert-Guided Conversations
Vardhan Dongre, Chi Gui, Shubham Garg, Hooshang Nayyeri, Gokhan Tur, Dilek Hakkani-Tür, Vikram S. Adve · 2025
Read MIRAGE: A Benchmark for Multimodal Information-Seeking and Reasoning in Agricultural Expert-Guided Conversations by Vardhan Dongre, Chi Gui, Shubham Garg, Hooshang Nayyeri, Gokhan Tur, Dilek Hakkani-Tür, Vikram S. Adve (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-20100.txt.
Description
Vardhan Dongre and colleagues build MIRAGE, a farm advice benchmark for vision language models, in work from 2025. Real farm consults mix vague questions, field photos, and deep local pest knowledge. Past benchmarks use tidy inputs and closed species lists, far from that messy reality.
Over thirty-five thousand real user and expert exchanges ground the benchmark build. More than seven thousand species, pests, and diseases appear across the curated cases. Questions often leave key facts unsaid, forcing models to ask or infer carefully. Models must guide the chat or answer with grounded long form replies. Crop health, pest calls, and farm management scenes fill the set.
Catalog record
| CREATOR | Vardhan Dongre, Chi Gui, Shubham Garg, Hooshang Nayyeri, Gokhan Tur, Dilek Hakkani-Tür, Vikram S. Adve |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 124 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-20100