IRIS: Interactive Research Ideation System for Accelerating Scientific Discovery
Aniketh Garikaparthi, Manasi Patwardhan, Lovekesh Vig, Arman Cohan · 2025
Read IRIS: Interactive Research Ideation System for Accelerating Scientific Discovery by Aniketh Garikaparthi, Manasi Patwardhan, Lovekesh Vig, Arman Cohan (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-16728.txt.
Introduction
Aniketh Garikaparthi, Manasi Patwardhan, Lovekesh Vig, and Arman Cohan built IRIS, an open platform that helps researchers dream up new hypotheses with language models. Automated ideation tools exist, but few keep the human in control with clear visibility. IRIS expands test-time compute through Monte Carlo Tree Search on demand. Fine-grained feedback lets users steer each branch of ideas.
A query-based literature synthesis grounds suggestions in prior work. The design targets transparency and steerability across the ideation process. A user study with researchers from varied disciplines found the system improved their ideation work. The code is openly released for others to use.
Catalog record
| CREATOR | Aniketh Garikaparthi, Manasi Patwardhan, Lovekesh Vig, Arman Cohan |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 26 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-16728
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
IRIS: Interactive Research Ideation System for Accelerating Scientific Discovery Aniketh Garikaparthi, Manasi Patwardhan, Lovekesh Vig, Arman Cohan Abstract The rapid advancement in capabilities of large language models (LLMs) raises a pivotal question: How can LLMs accelerate scientific discovery? This work tackles the crucial first stage of research, generating novel hypotheses. While recent work on automated hypothesis generation focuses on multi-agent frameworks and extending test-time compute, none of the approaches effectively incorporate transparency and steerability through a synergistic Human-in-the-loop (HITL) approach. To address this gap, we introduce IRIS: Interactive Research Ideation System, an open-source platform designed for researchers to leverage LLM-assisted scientific ideation. IRIS incorporates innovative features to enhance ideation, including adaptive test-time compute expansion via Monte Carlo Tree Search (MCTS), fine-grained feedback mechanism, and query-based literature synthesis. Designed to empower researchers with greater control and insight throughout the ideation process. We additionally conduct a user study with researchers across diverse disciplines, validating the effectiveness of our system in enhancing ideation. We open-source our code here . 1 Introduction Figure 1: Human-in-the-loop Idea Generation with Monte-Carlo-Tree-Search. \mathcal{G} : Research Goal, \mathcal{B} : Research Brief With the growing capabilities of large language models (LLMs), the automation of scientific discovery has captured a lot of attention Gridach et al. 2025 . Agentic LLM based systems have shown potential of outperforming PhD researchers and postdocs on short-horizon scientific tasks like question answering, summarization and contradiction detection in various domains Skarlinski et al. 2024 ; Asai et al. 2024 . These advancements have spurred new opportunities of LLMs accelerating scientific discovery, which is essential given the exponential growth of scientific publications Landhuis 2016 ; Fire and Guestrin 2019 . Current solutions that leverage LLMs in scientific ideation primarily remain hinged on multi-agent frameworks or extending test-time compute Si et al. 2024 ; Hu et al. 2024 ; Gottweis 2025 , and aim to validate the quality of the final ideas through human validation or LLM-as-a-judge evaluations Wang et al. 2024 ; Li et al. 2024 ; Baek et al. 2025 . However, these approaches often fail to integrate human supervision during generation in a truly complementary manner, neglecting the nuanced expectations and goals of the user. Consequently, despite investing significant computational resources to develop objectively “novel” ideas, they might not align with the user’s research goals , inevitably leading to dissatisfaction Ou et al. 2022 ; Kim et al. 2024 . Moreover, the importance of meaningful human intervention in the research process cannot be overstated. Notably, AI models have been known to fabricate convincing yet fraudulent scientific information Májovský et al. 2023 . More troubling are cases of deceptive and misaligned AI behaviors Ryan Greenblatt 2025 ; Booth 2025 ; Betley et al. 2025 ; Baker et al. 2025 . Recent developments of more capable Agentic LLMs have shown difficulties in transparently delegating sub-tasks, leading to "reward hacking" behaviors Anthropic 2025 . In the context of idea generation, we find signs of similar "reward hacking" where LLMs adopt fancy terminology e.g. "Prompt Learning and Optimization Nexus" for building a library of prompts, or often proposing the use of "graphs" without any clear motivation or description behind the design choice. We observe that naive recursive feedback loops Baek et al. 2025 forcing the LLM to be more novel inevitably lead to gamifying LLM-as-a-judge metrics without adding actual value. Gupta and Pruthi 2025 carefully study the results of AI-Researcher Si et al. 2024 and advise careful assessment of LLM generated hypotheses due to signs of skillful plagiarism. These examples highlight the pitfalls of premature reliance on fully automated systems, underscoring the need for well-designed Human-in-the-Loop (HITL) systems for scientific ideation; ensuring outcomes are accurate and aligned with human goals. Despite the recent innovations made in LLM-based scientific ideation, several key limitations persist. These include (1) generating hypotheses in a single pass Si et al. 2024 , which overlooks the iterative nature of the ideation process. In contrast, Pu et al. 2024 find that researchers typically seek to refine their hypotheses into concrete research briefs . (2) Optimization through feedback on coarse-grained criteria like rigorousness, originality, generalizability etc. Baek et al. 2025 , while often critiquing entire ideas rather than specific components. (3) Simplistic retrieval augmentation such as appending keywords or abstracts of previous papers in context Wang et al. 2024 ; Si et al. 2024 , whereas effective ideation demands a deeper, more holistic understanding of the domain literature. (4) Unstructured and sub-optimal search of the idea space through either refinement of a generated base-idea (exploitation) Wang et al. 2024 ; Baek et al. 2025 , or through initial search and plan (exploration) without subsequent refinement of promising ideas Hu et al. 2024 . Finally, there is a lack of open-source implementations that would encourage broader adoption. In light of these challenges, we propose IRIS, tackling each of these limitations while enabling human intervention at every stage of the ideation process. Specifically, we make the following contributions: • HITL Framework: A user-centered design balancing human control with automation instead of entirely delegating the process of ideation to AI • Monte Carlo Tree Search: A systematic method to iteratively explore the idea space and extend test time compute via alternating phases of exploration and exploitation (§ 3.2 ) • Fine-grained Review based Refinement: An exhaustive taxonomy (Table 2 ) with fine-grained actionable feedback for improving hypotheses (Figure 2 ) (§ 3.1 ) • Query-based Retrieval: Generating targeted queries for retrieving relevant literature, with re-ranking, clustering and summarization to produce comprehensive, technical and cited responses (§ 3.1 ) • Open Source: Publicly available platform for AI-Assisted scientific ideation Finally, we conduct a user study with researchers from diverse disciplines validating the effectiveness of our designed system (§ 4 ). Figure 2: IRIS Platform Interface with (L) Retrieval Panel, (C) Chat Overview Panel, (R) Research Brief Panel 2 Related Works 2.1 AI Assisted Research The integration of (AI) into scientific research has evolved from early concept-linking tools Swanson 1986 ; Sybrandt et al. 2020 ; Nadkarni et al. 2021 to sophisticated systems that enhance various research stages. In recent years, LLMs have significantly transformed research life-cycles by assisting in literature searches Zheng et al. 2024 ; Ajith et al. 2024 ; Asai et al. 2024 , citation recommendations Pillai and R 2022 ; Zhang and Zhu 2022 ; Press et al. 2024 , review of scientific documents Zhou et al. 2024 , experimental design Huang et al. 2024 ; Schmidgall et al. 2025 , scientific claim verification Lu et al. 2024 , theorem proving Song et al. 2025 , manuscript writing Weng et al. 2025 , and reading assistants 1 1 1 JenniAI , SciSpace , ScholarAI . 2.2 Human-AI Co-creation Systems The emergence of Gen AI has introduced a new dimension to Co-creation systems, setting them apart from previous ones where machines primarily served as supportive tools for human users Davis et al. 2015 ; Muller et al. 2020 ; Weisz et al. 2024 . Recent studies, such as those by Kantosalo and Jordanous 2021 ; Liu et al. 2024 , demonstrate the effectiveness of Gen AI tools in creative tasks, particularly through their steerability and explainability. This has led to growing emphasis among researchers to develop design guidelines