LLM-Based Agents for Competitive Landscape Mapping in Drug Asset Due Diligence
Alisa Vinogradova, Vlad Vinogradov, Dmitrii Radkevich, Ilya Yasny, Dmitry Kobyzev · 2025
Read LLM-Based Agents for Competitive Landscape Mapping in Drug Asset Due Diligence by Alisa Vinogradova, Vlad Vinogradov, Dmitrii Radkevich, Ilya Yasny, Dmitry Kobyzev (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-16571.txt.
Introduction
Vinogradova, Vinogradov, and co-authors build AI agents that map a drug's rivals for investors, in a 2025 paper. Before backing a drug asset, funds must list every rival drug for the same illness. That list hides in paywalled stores, clashing name systems, and fast change. Even the best chat tools miss many rivals, and no public test for the task existed.
The team turned five years of private deal memos into a graded test set with tidied drug facts. Their finder agent then beat two known research tools on recall, catching about five in six rivals. A judge agent weeds out false hits to keep the list clean. The system now runs for paying users, and a case study with a biotech fund shows the workflow in action. Speed with proof is the selling point.
Catalog record
| CREATOR | Alisa Vinogradova, Vlad Vinogradov, Dmitrii Radkevich, Ilya Yasny, Dmitry Kobyzev |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 44 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-16571
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
LLM-Based Agents for Competitive Landscape Mapping in Drug Asset Due Diligence Alisa Vinogradova, Vlad Vinogradov, Dmitrii Radkevich, Ilya Yasny, Dmitry Kobyzev Abstract In this paper, we describe and benchmark a competitor-discovery component used within an agentic AI system for fast drug asset due diligence. A competitor-discovery AI agent, given an indication, retrieves all drugs comprising the competitive landscape of that indication and extracts canonical attributes for these drugs. The competitor definition is investor-specific, and data is paywalled/licensed, fragmented across registries, ontology-mismatched by indication, alias-heavy for drug names, multimodal, and rapidly changing. Although considered the best tool for this problem, the current LLM-based AI systems aren’t capable of reliably retrieving all competing drug names, and there is no accepted public benchmark for this task. To address the lack of evaluation, we use LLM-based agents to transform five years of multi-modal, unstructured diligence memos from a private biotech VC fund into a structured evaluation corpus mapping indications to competitor drugs with normalized attributes. We also introduce a competitor validating LLM-as-a-judge agent that filters out false positives from the list of predicted competitors to maximize precision and suppress hallucinations. On this benchmark, our competitor-discovery agent achieves 83% recall, exceeding OpenAI Deep Research (65%) and Perplexity Labs (60%). The system is deployed in production with enterprise users; in a case study with a biotech VC investment fund, analyst turnaround time dropped from 2.5 days to ∼ \sim 3 hours ( ∼ \sim 20x) for the competitive analysis. Introduction Mapping the entire competitive landscape for a drug is the first and important step of the competitive analysis underlying the patent, business, and scientific due diligence for in-/out-licensing, as well as for identifying gaps when planning a clinical trial for that specific asset. Regulators make competitor discovery increasingly important, since 12 January 2025, the EU Health Technology Assessment Regulation applies Joint Clinical Assessments (JCAs) ( European Commission 2025 ) for new oncology medicines and all Advanced Therapy Medicinal Products (ATMPs). Missing a relevant competitor or proposing an inappropriate one can lead the JCA to set comparators that the drug developer did not anticipate, exposing the asset to European Union (EU)-wide market access and pricing risk; previously, such exposure was confined to national decisions Globally, expectations align: ICH E10 ( ICH 2000 ) and FDA effectiveness guidances ( FDA 2023 ) emphasize appropriate control/comparator selection, and NICE ( NICE 2022 ) methods require justifiable comparators in routine practice. Figure 1: Model performance across varying levels of sample difficulty. The x-axis denotes difficulty thresholds: at each point, we evaluate all models on the subset of samples where o3-pro-no-web recovered \leq the indicated percentage of ground-truth competitors. This allows us to assess how different agents perform on increasingly difficult samples, using a non-web baseline as the difficulty proxy. Identifying all competitors for an indication demands consolidating evidence from press releases, scientific literature, patents, clinical-trial registries, and target-space intelligence, then linking novel targets to the drugs that modulate them. Because information is scattered, alias-ridden, multilingual, and ranked differently by region and the landscape changes rapidly without central tracking, teams still rely on manual expert workflows and spreadsheets, creating a persistent completeness, recency, and cycle-time risks that cascade into comparator strategy, trial design, pricing, and licensing decisions. Figure 2: Competitors Discovery System Diagram. Diligence memos are parsed by a hierarchical multi-agent system into normalized JSON (assets, indications, competitors), deduplicated and split chronologically. Precision is graded by an expert-trained LLM-as-a-judge Competitor-Validator with mined negatives, recall by an LLM-as-a-judge that uses Web-search; both feed CI/CD. In production, a Competitors-Finder agent calls web tools and the Validator filters candidates. Large language models (LLMs) appear well-suited to this task: they are increasingly multimodal and multilingual, can automate operating with scientific tools, web browsing, managing external databases at scale, and are being rapidly operationalized across big pharma. For example, Moderna shifted from an internal GPT-4 API agent (“mChat”) to ChatGPT Enterprise for thousands of employees, spawning 750+ internal GPTs including “Dose ID” ( OpenAI 2024 ) ; Takeda deployed a secure Azure OpenAI assistant with PwC/Microsoft ( PwC Germany 2024 ) ; and Bayer’s ChatGPT-4 Turbo–based MyGenAssist cut pharmacovigilance letter time by 23% ( Benaïche et al. 2025 ) . Moreover, recent studies report that general-purpose, frontier LLMs can be competitive with—or even outperform—task-specific fine-tuned models on certain pharma-adjacent evaluations ( Chen et al. 2025 ; McDuff et al. 2025 ) . Accordingly, since marginal gains in this setting typically come from agentic scaffolds and execution policy rather than weight adjustments to a specific task, and apparent prompt wins can degrade under real-world constraints, it is necessary to prioritize end-to-end, domain-grounded benchmarking that exercises failure modes, to ensure deployed systems remain stable and maintain certain Service Level Agreements (SLAs). There is no publicly accepted benchmark for competitor discovery because key evidence and curated lists are paywalled and heterogeneous across providers (e.g., Clarivate, Citeline, GlobalData, AlphaSense), necessitating in-house expert curation, and the definition of a “competitor” is investor- and stakeholder-specific. This task heavily relies on web browsing and multi-hop navigation across different sources, backtracking, and evidence reconciliation. Web-agent benchmarks such as BrowseComp (hard-to-surface web facts) ( Wei et al. 2025 ) , WebVoyager (interacting with real-world websites) ( He et al. 2024 ) , WebArena (realistic but closed-world sites) ( Zhou et al. 2023 ) , Mind2Web (generalist website tasks) ( Deng et al. 2023 ) , and WebLINX (conversational web navigation) ( Lù, Kasner, and Reddy 2024 ) are not sufficient to capture the complexity of the competitors discovery problem: nomenclature harmonization; landscape completeness, long-tail coverage; and high-recall retrieval at regulator-grade. To fill this gap, we use LLM-based agents to transform five years of multi-modal, unstructured diligence memos from a private biotech VC fund into a structured evaluation corpus that maps indications to competitor drugs with normalized attributes. Because the primary deployment risk is incompleteness, our benchmark first makes recall observable — how many expert-identified competitors the agent recovers. At the same time, recent work presenting ChiDrug ( Wu et al. 2025 ) , a benchmark comprising six Chinese medication subtasks including an indication task, shows frontier models (e.g., GPT-4o, Claude 3.5) both omit valid answers (recall failures) and hallucinate (precision failures), underscoring the need to measure completeness and to validate outputs. We therefore introduce the post-retrieval filtering LLM-as-judge (Competitors Validator), which, in the fashion of the PaperBench’s “expert slice” ( Starace et al. 2025 ) , uses a conservative synthetic-labeling step in which a calibrated agent, tuned to a 90% F1-score of detecting false-positive competitor drugs, proposes false candidates that are then filtered out before propagating them to the client-facing components of the system. Another challenge in productionizing LLM applications is balancing the “bitter lesson” (that durable gains come from general methods that scale rather than hand-crafted domain rules) with the empirical need for agentic scaffolds on long-tail, multi-hop web tasks. As single‑pass prompting, even with comprehensive Chain-of-Thought (CoT) prompting, reasoning language model, extensive tuning for tool use, often misses a large fraction of long‑tail, multi-hop facts because the optimization landscape is too stiff to plan multi‑step web navigation, branch or backtrack ( Biran et al. 2024 ) , ( Gema et al. 2025 ) . Agentic scaffolds that interleave reasoning and tool use, such