How Far Are We from Genuinely Useful Deep Research Agents?

OPPO AI Agent Team · 2025

Read How Far Are We from Genuinely Useful Deep Research Agents? by OPPO AI Agent Team (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-01948.txt.

Description

Deep research agents are AI systems meant to write analyst-level reports by searching, reading, and synthesizing sources on their own. A 2025 paper from the OPPO AI Agent Team asks how close these systems are to being genuinely useful, rather than merely impressive on question-answering tests.

Most existing agents were validated on benchmarks of short answers, while the harder job of writing a full report went largely unmeasured. The benchmarks that do test reports suffer from fuzzy tasks and subjective scoring, which hides real user needs. The authors' assessment aims to ground the field in what people actually ask research agents to produce.

Catalog record

CREATOROPPO AI Agent Team
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE91 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2512-01948

Browse the full library · About the Tower of Babel