MIRAGE: A Benchmark for Multimodal Information-Seeking and Reasoning in Agricultural Expert-Guided Conversations

Vardhan Dongre, Chi Gui, Shubham Garg, Hooshang Nayyeri, Gokhan Tur, Dilek Hakkani-Tür, Vikram S. Adve · 2025

Read MIRAGE: A Benchmark for Multimodal Information-Seeking and Reasoning in Agricultural Expert-Guided Conversations by Vardhan Dongre, Chi Gui, Shubham Garg, Hooshang Nayyeri, Gokhan Tur, Dilek Hakkani-Tür, Vikram S. Adve (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-20100.txt.

Description

Vardhan Dongre and colleagues build MIRAGE, a farm advice benchmark for vision language models, in work from 2025. Real farm consults mix vague questions, field photos, and deep local pest knowledge. Past benchmarks use tidy inputs and closed species lists, far from that messy reality.

Over thirty-five thousand real user and expert exchanges ground the benchmark build. More than seven thousand species, pests, and diseases appear across the curated cases. Questions often leave key facts unsaid, forcing models to ask or infer carefully. Models must guide the chat or answer with grounded long form replies. Crop health, pest calls, and farm management scenes fill the set.

Catalog record

CREATORVardhan Dongre, Chi Gui, Shubham Garg, Hooshang Nayyeri, Gokhan Tur, Dilek Hakkani-Tür, Vikram S. Adve
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE124 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-20100

Browse the full library · About the Tower of Babel