Super Research: Answering Highly Complex Questions with Large Language Models through Super Deep and Super Wide Research

Yubo Dong, Nianhao You, Yuxuan Hou, Zixun Sun, Yue Zhang, Liang Zhang, Siyuan Zhao, Hehe Fan · 2026

Read Super Research: Answering Highly Complex Questions with Large Language Models through Super Deep and Super Wide Research by Yubo Dong, Nianhao You, Yuxuan Hou, Zixun Sun, Yue Zhang, Liang Zhang, Siyuan Zhao, Hehe Fan (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-00582.txt.

Introduction

Dong and seven colleagues define Super Research, tackling questions that need far reaching plans, huge evidence hunts, and synthesis across conflicting sources. Their method splits work into a structured plan, retrieves widely for diverse views, and digs deeply through iterative queries to resolve uncertainty. A benchmark of 300 expert questions, each needing over one hundred retrieval steps and one thousand pages, tests the ceiling of current models. Reports carry fine grained citations and intermediate artefacts, audited on coverage, consistency, utility, objectivity, and citation health.

Catalog record

CREATORYubo Dong, Nianhao You, Yuxuan Hou, Zixun Sun, Yue Zhang, Liang Zhang, Siyuan Zhao, Hehe Fan
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE69333
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.00582

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Super Research: Answering Highly Complex Questions with Large Language Models through Super Deep and Super Wide Research Yubo Dong, Nianhao You, Yuxuan Hou, Zixun Sun, Yue Zhang, Liang Zhang, Siyuan Zhao, Hehe Fan Abstract While Large Language Models (LLMs) have demonstrated proficiency in Deep Research or Wide Search, their capacity to solve highly complex questions—those requiring long-horizon planning, massive evidence gathering, and synthesis across heterogeneous sources—remains largely unexplored. We introduce Super Research , a task for complex autonomous research tasks that integrates (i) structured decomposition into a research plan, (ii) super wide retrieval for diverse perspectives, and (iii) super deep investigation to resolve uncertainties through iterative queries. To evaluate this capability, we curated a benchmark of 300 expert-written questions across diverse domains, each requiring up to 100+ retrieval steps and 1,000+ web pages to reconcile conflicting evidence. Super Research produces verifiable reports with fine-grained citations and intermediate artifacts (e.g., outlines and tables) to ensure traceable reasoning. Furthermore, we present a graph-anchored auditing protocol that evaluates Super Research along five dimensions: Coverage, Logical Consistency, Report Utility, Objectivity and Citation Health. While super-complex questions may be infrequent in standard applications, Super Research serves as a critical ceiling evaluation and stress test for LLM capabilities. A model’s proficiency within Super Research acts as a powerful proxy for its general research competence; success here suggests the robustness necessary to navigate nearly any subordinate research task. Leaderboard is available at: https://cnsdqd-dyb.github.io/Super-Research-Benchmark/ Figure 1 : Comparison of Super Research with standard Retrieval-Augmented Generation (RAG), Deep Research, and Wide Search. (a) RAG represents the baseline paradigm, which typically operates with limited depth and width. (b) Deep Research focuses on vertical exploration and recursive chains of evidence to resolve nuanced questions, though it often lacks horizontal width, leading to “tunnel vision”. (c) Wide Search prioritizes horizontal data acquisition and large-scale coverage across diverse information nodes, but lacks synthetic depth, which can result in “information overload”. (d) Super Research explicitly couples Super Deep investigation with Super Wide retrieval to address highly complex questions requiring long-horizon planning, 100+ retrieval steps, and the synthesis of 1,000+ web pages. It can generate research reports of up to 50 pages, averaging around 100k words per report. 1 Introduction The evolution of Large Language Models (LLMs) has marked a paradigm shift in artificial intelligence, moving from simple statistical text completion to sophisticated reasoning and agentic problem-solving. Early iterations focused on scaling parameters to capture world knowledge within static weights. However, the recent shift toward Retrieval-Augmented Generation (RAG) [ 16 ] and agentic workflows [ 40 , 38 ] has empowered LLMs to interact with the external web, allowing them to overcome the limitations of their training cutoff and hallucination tendencies. Today, LLMs are no longer just repositories of information but are increasingly treated as “reasoning engines” capable of orchestrating complex sequences of tool use and information retrieval to answer non-trivial queries. In tandem with these advancements, the concept of Deep Research [ 4 , 6 ] has emerged as a specialized capability for LLMs. This approach prioritizes vertical exploration, where an agent iteratively follows a chain of evidence to resolve specific, nuanced questions. By employing “Chain-of-Thought” prompting [ 34 ] and recursive search loops, Deep Research agents can dive into technical documentation, legal archives, or scientific papers to extract precise answers that are hidden beneath layers of text. The focus here is on the depth of inquiry, which ensures that a specific thread of reasoning is followed to its logical conclusion through rigorous verification and iterative refinement. Conversely, Wide Search [ 36 ] (note that “Wide Research” is not yet established) has evolved to address the necessity for horizontal information coverage. This current paradigm prioritizes large-scale data acquisition, striving to capture an exhaustive array of information nodes and web sources to maximize the width of the raw dataset. In contrast, we define Wide Research as a more sophisticated evolution that focuses on thematic width and perspective synthesis. Rather than mere data accumulation, Wide Research systems are designed to “survey the landscape”, ensuring that no critical angle—be it economic, social, or technical—is overlooked. This is achieved through multi-query expansion and aspect-based retrieval, allowing the model to identify the multifaceted dimensions of a problem and curate a representative sample of evidence from across the digital ecosystem. In this paper, we present Super Research, which is designed to push the boundaries of LLM capabilities in complex research. Super Research is dedicated to addressing super-complex questions such as “optimizing immunopharmacological mechanisms where T cell activation must be precisely balanced against tumor microenvironment immune escape pathways to minimize autoimmune risks” , which lie far beyond the operational limits of current Deep Research or Wide Search paradigms. Super Research explicitly couples three core pillars: (i) Structured Decomposition, which breaks a monolithic query into a multi-layered research plan; (ii) Super Wide Retrieval, which explores the search space horizontally to ensure total coverage of diverse perspectives; and (iii) Super Deep Investigation, which utilizes iterative follow-up queries to resolve uncertainties and verify the reliability of individual data points. To rigorously test this framework, we introduce a new benchmark of 300 expert-written questions that require massive evidence gathering and synthesis. Compared to existing Deep Research or Wide Search that typically operate within a range of 10–20 retrieval iterations and approximately 100 web pages, Super Research is designed for a higher tier of complexity. Those truly “super complex” questions are found in professional intelligence, scientific discovery, or strategic planning, and usually demand long-horizon planning that can manage 100+ retrieval steps and 1,000+ web pages to synthesize massive evidence while maintaining both extreme width and extreme depth. However, evaluating Super Research is itself extremely challenging. Existing evaluation paradigms [ 19 , 4 , 33 , 10 ] are ill-suited for the scale and nuance of complex inquiry. ① Inaccurate LLM-as-a-Judge: Standard report-to-report comparisons [ 41 ] are prone to alignment errors and often fail to capture deep reasoning. ② Shallow Fact-Recall Metrics: Current benchmarks [ 20 , 35 ] prioritize “atomic” facts while neglecting the sophisticated synthesis and analytical depth required for complex questions. ③ Costly Human Evaluation: Expert reviews, and Elo-based systems [ 32 ] are rigorous but prohibitively slow, expensive, and difficult to scale. ④ Neglected Ambiguity: Most metrics fail to reward “uncertainty expression”, penalizing models that correctly identify lack of consensus while rewarding false confidence. To bridge this gap, we formalize a structured evaluation protocol that assesses reports along five dimensions: Coverage Comprehension, Logical Consistency, Report Utility, Objectivity Score, and Citation Health. Furthermore, we introduce an automated, graph-anchored auditing tool (See Appendix F.1 ). By projecting generated reports onto an expert-curated knowledge graph, this tool enables: ① Structured Claim Verification: Mapping claims directly to verified data. ② Interpretable Error Tracing: Pinpointing exactly where a reasoning chain breaks. ③ Reproducible Scoring: Ensuring fair and consistent evaluation at scale. Figure 2 : Overview of the SuperResearch Benchmark framework. (a) Construction Pipeline: The process starts with the joint definition of 300+ “super hard” open-ended tasks, which undergo rigorous expert vetting. Autonomous agents then execute a long-horizon research process involving 100+ retrieval steps and the synthesis of 1,000+ web pages. The resulting “Gold Standard” consists of a structured Research Graph, canonical reports, and a question-answer (QA) exam.

Read the complete text