" Excuse me, may I say something… " CoLabScience, A Proactive AI Assistant for Biomedical Discovery and LLM-Expert Collaborations

Yang Wu, Jinhong Yu, Jingwei Xiong, Zhimin Tao, Xiaozhong Liu · 2026

Read " Excuse me, may I say something… " CoLabScience, A Proactive AI Assistant for Biomedical Discovery and LLM-Expert Collaborations by Yang Wu, Jinhong Yu, Jingwei Xiong, Zhimin Tao, Xiaozhong Liu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-15588.txt.

Introduction

Wu and four colleagues introduce CoLabScience, a proactive helper for biomedical discovery that jumps into streaming expert discussions instead of waiting to be asked. Its PULI framework, trained by reinforcement learning on project proposals plus long- and short-term dialogue memory, learns when and how to jump in. On a new test set of mock PubMed-derived dialogues, it beats rivals on jump-in precision and team task value.

Catalog record

CREATORYang Wu, Jinhong Yu, Jingwei Xiong, Zhimin Tao, Xiaozhong Liu
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE64252
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.15588

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

" Excuse me, may I say something… " CoLabScience, A Proactive AI Assistant for Biomedical Discovery and LLM-Expert Collaborations Yang Wu, Jinhong Yu, Jingwei Xiong, Zhimin Tao, Xiaozhong Liu Abstract The integration of Large Language Models (LLMs) into scientific workflows presents exciting opportunities to accelerate biomedical discovery. However, the reactive nature of LLMs, which respond only when prompted, limits their effectiveness in collaborative settings that demand foresight and autonomous engagement. In this study, we introduce CoLabScience, a proactive LLM assistant designed to enhance biomedical collaboration between AI systems and human experts through timely, context-aware interventions. At the core of our method is PULI ( Positive-Unlabeled Learning-to-Intervene ), a novel framework trained with a reinforcement learning objective to determine when and how to intervene in streaming scientific discussions, by leveraging the team’s project proposal and long- and short-term conversational memory. To support this work, we introduce BSDD ( Biomedical Streaming Dialogue Dataset ), a new benchmark of simulated research discussion dialogues with intervention points derived from PubMed articles. Experimental results show that PULI significantly outperforms existing baselines in both intervention precision and collaborative task utility, highlighting the potential of proactive LLMs as intelligent scientific assistants. 1 1 1 https://github.com/YANGWU001/CoLabScience. 1 Introduction Figure 1: Comparison of Reactive and Proactive LLMs in Biomedical Collaboration. Traditional reactive LLMs (left) respond only after being prompted, while proactive LLMs (right) monitor ongoing discussions, identify opportunities to contribute domain-relevant insights, and intervene with timely and context-aware suggestions without explicit prompting. Recent developments in large language models (LLMs) have fostered advancements in scientific research, enabling accelerated discovery in biomedical fields ( Luo et al. 2022 ; Ma et al. 2024 ; Jin et al. 2025 ) . In particular, existing work has explored their potential across tasks such as drug repurposing, disease diagnosis, and clinical question answering ( Qi et al. 2024 ; Zhao et al. 2023 ; Lu et al. 2024c ) . Despite these successes, current models primarily function in a reactive paradigm ( Liao et al. 2023 ; Lu et al. 2024c ; Yao et al. 2025a ) , responding solely upon explicit prompts from researchers. This interaction mode significantly restricts their effectiveness in collaborative settings, where the absence of proactive interventions can lead to missed critical insights and opportunities ( Yang et al. 2025b ; Wu et al. 2024b ) . In response to these limitations, we propose that LLMs supporting biomedical research should evolve toward proactive engagement: continuously tracking ongoing discussions, understanding emerging contexts, and autonomously identifying appropriate moments for contribution—integrating into the team as an active team member rather than remaining a passive tool. For instance, as illustrated in Figure 1, a traditional reactive LLM ( Hassouna et al. 2025 ; Zhou et al. 2026 ) responds passively only after being explicitly prompted by the Clinical Physician, whereas a proactive LLM tracks the discussion, identifies timely opportunities to contribute PTEN-relevant insights, and initiates suggestions that facilitate scientific progress without waiting for direct queries. Motivated by the need for proactive engagement, we present CoLabScience, a novel AI assistant that transforms LLMs from reactive tools to proactive collaborators in biomedical research. At its core lies PULI ( Positive-Unlabeled Learning-to-Intervene ), a framework trained with reinforcement learning to determine when and how to intervene during scientific discussions. To train this model, we constructed BSDD ( Biomedical Streaming Dialogue Dataset ), a collection of simulated scientific dialogues characterized by multiple research roles (e.g., Pharmacologist, Clinical Physician), generated by LLMs with content grounded in PubMed literature ( Sayers et al. 2024 ) . To ensure the reliability of LLM-derived labels and mitigate hallucination risk ( Huang et al. 2025 ; Sriramanan et al. 2024 ) , we adopt a sparse labeling strategy in which only the most valuable intervention points are labeled as positive, while all others remain unlabeled ( Kiryo et al. 2017 ; Wu et al. 2023 ) . By leveraging CoLabScience’s coordinator to identify reliable negative interventions from the positive-unlabeled (PU) data, we employ a two-tier approach: training a small Observer LLM with Group Relative Policy Optimization (GRPO) ( Shao et al. 2024 ) to determine when to intervene and fine-tuning a large-scale Presenter LLM with supervised learning to generate appropriate intervention content. This architecture enables real-time dialogue monitoring via the efficient Observer model, invoking the computationally expensive Presenter model only when an intervention is needed. Reward signals from both models are integrated to train the reinforcement learning coordinator, enabling an end-to-end training loop. By incorporating the project proposal (i.e., project goals, datasets, and background knowledge) and dual-scale conversational memory, in which long-term memory retains critical prior insights and short-term memory captures the evolving conversational context ( Hatalis et al. 2023 ; Zhong et al. 2024 ) , CoLabScience proactively delivers scientifically grounded interventions without requiring explicit prompting. Our contributions in this paper are threefold and can be summarized as follows: \bullet We propose CoLabScience, a proactive LLM assistant that supports efficient biomedical research collaboration through context-aware interventions. Unlike reactive LLMs, CoLabScience autonomously determines when and how to intervene during ongoing research discussions by leveraging project context and conversational history. \bullet We introduce BSDD, a new open benchmark consisting of simulated biomedical research dialogues grounded in PubMed articles and annotated with proactive intervention labels. BSDD provides a valuable resource for training and evaluating future proactive scientific assistants, advancing research in this emerging area. \bullet We empirically validate CoLabScience’s effectiveness through both simulation-based evaluation and human evaluation. The results demonstrate the model’s strong generalization ability and robustness across a range of LLM backbones. 2 Related Work Large Language Models as Scientific Assistants Recent advances in LLMs have shown promise in biomedical research through protein structure prediction, antibiotic discovery, and drug repurposing ( Wong et al. 2024 ; Zambaldi et al. 2024 ; Jumper et al. 2021 ; Swanson et al. 2024 ; Gottweis et al. 2025 ; Yao et al. 2025b ) . Beyond the biomedical domain, systems like Agent Laboratory and AI Scientist ( Schmidgall et al. 2025 ; Lu et al. 2024a ) automate research pipelines from hypothesis generation to reporting, while Agentic Reasoning ( Wu et al. 2025a ) enhances multi-step reasoning. Complementing these systems, RECODE-H ( Miao et al. 2025 ) benchmarks human-agent collaboration through multi-turn code development. However, these approaches are largely reactive, whereas CoLabScience enables context-aware, timely interventions during ongoing scientific discussions. Proactive Capabilities in Large Language Models Recent work explores LLM proactivity through structured prompting, including initiative-taking in collaboration ( Zhang et al. 2024a ; Lu et al. 2024b ; Wu et al. 2025c ) , clarification-seeking behaviors ( Zhang et al. 2024c ; Qian et al. 2024 ; Liu et al. 2024 ; Pang et al. ; Li et al. 2024 ; Wu et al. 2024c ) , and requesting user support in complex tasks ( Wu et al. 2024a ) . VideoLLM-Online ( Chen et al. 2024 ) extends this to multimodal streaming, training models to determine optimal narration timing. However, these approaches rely on hand-crafted prompts and fixed logic, limiting adaptive intervention. In contrast, we introduce a trainable reinforcement learning mechanism that enables context-aware, timing-sensitive proactive decision-making. 3 Methodology 3.1 Preliminary Definitions We formalize the proactive intervention task based on multi-round scientific dialogues, where each

Read the complete text