AOP-Smart: A RAG-Enhanced Large Language Model Framework for Adverse Outcome Pathway Analysis
Qinjiang Niu, Lu Yan · 2026
Read AOP-Smart: A RAG-Enhanced Large Language Model Framework for Adverse Outcome Pathway Analysis by Qinjiang Niu, Lu Yan (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-10874.txt.
Introduction
Niu and Yan offer AOP-Smart, a retrieval-aided generation frame for adverse outcome pathway work in toxicology, built on official AOP-Wiki XML data. Using key events, event links, and pathway facts to pull in apt knowledge, it aims to curb hallucinations that sap language-model trust. On 20 pathway question tasks, scores with no retrieval run 15 percent for GPT, 35 percent for DeepSeek, and 20 percent for Gemini. With retrieval, scores jump to 95 percent, 100 percent, and 95 percent in the same order, showing the frame lifts scores and keeps them even.
Catalog record
| CREATOR | Qinjiang Niu, Lu Yan |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 22459 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.10874
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
AOP-Smart: A RAG-Enhanced Large Language Model Framework for Adverse Outcome Pathway Analysis Qinjiang Niu, Lu Yan Abstract Adverse Outcome Pathways (AOPs) are an important knowledge framework in toxicological research and risk assessment. In recent years, large language models (LLMs) have gradually been applied to AOP-related question answering and mechanistic reasoning tasks. However, due to the existence of the hallucination problem, that is, the model may generate content that is inconsistent with facts or lacks evidence, their reliability is still limited. To address this issue, this study proposes an AOP-oriented Retrieval-Augmented Generation (RAG) framework, AOP-Smart. Based on the official XML data from AOP-Wiki, this method uses Key Events (KEs), Key Event Relationships (KERs), and specific AOP information to retrieve relevant knowledge for user questions, thereby improving the reliability of the generated results of large language models. To evaluate the effectiveness of the proposed method, this study constructed a test set containing 20 AOP-related question answering tasks, covering KE identification, upstream and downstream KE retrieval, and complex AOP retrieval tasks. Experiments were conducted on three mainstream large language models, Gemini, DeepSeek, and ChatGPT, and comparative tests were performed under two settings: without RAG and with RAG. The experimental results show that, without using RAG, the accuracies of GPT, DeepSeek, and Gemini were 15.0%, 35.0%, and 20.0%, respectively; after using RAG, their accuracies increased to 95.0%, 100.0%, and 95.0%, respectively. The results indicate that AOP-Smart can significantly alleviate the hallucination problem of large language models in AOP knowledge tasks, and greatly improve the accuracy and consistency of their answers. Keywords: Adverse Outcome Pathway; large language model; retrieval-augmented generation; knowledge enhancement; hallucination problem 1. Introduction Adverse Outcome Pathways (AOPs) are a conceptual framework used to describe the causal relationship from Molecular Initiating Events (MIEs) to Adverse Outcomes (AOs), and are of great significance in toxicological research and chemical risk assessment [ 1 ] . By organizing Key Events (KEs) at the molecular, cellular, tissue, organ, and individual levels, AOPs provide systematic support for the expression of toxicity mechanisms, knowledge integration, and risk judgment [ 2 ] . With the continuous development of AOP-Wiki, the number of related knowledge entries has been increasing, and the content covers more species, biological levels, and complex Key Event Relationships (KERs). Although the expansion of knowledge scale improves the richness of AOP resources, it also increases the difficulty for researchers in retrieving, understanding, and integrating information. To improve the usability of AOP knowledge, previous studies have developed various supporting tools, such as AOP-HelpFinder and AOP-Explore, to support the mining, retrieval, and visualization analysis of AOP-related information [ 6 , 8 ] . At the same time, large language models (LLMs) have shown strong capabilities in tasks such as natural language understanding, knowledge question answering, and complex reasoning, and have demonstrated broad application prospects in biomedical text mining and mechanistic knowledge analysis [ 13 , 3 , 9 ] . Existing studies have shown that LLMs can assist in the extraction, integration, and structured representation of scientific knowledge, and can help with the construction of AOP chains to a certain extent [ 12 ] . However, the generated results of LLMs are limited by the coverage of training corpora and the generation mechanism itself, and they are prone to producing hallucinations when dealing with highly specialized domain knowledge, that is, outputs that are fluent in expression but factually incorrect, thereby affecting their reliability and interpretability in scientific research [ 5 , 11 ] . Retrieval-Augmented Generation (RAG) provides an effective idea for alleviating the above problems. By introducing external knowledge before LLMs generate content, RAG provides knowledge relevant to the question as context to the model, thereby enhancing the factual basis of model responses and reducing the risk of hallucination [ 10 ] . A typical RAG framework usually includes a retrieval module and a generation module: the former obtains relevant content from external knowledge sources, and the latter generates answers based on the retrieved results [ 4 , 7 ] . Most existing RAG methods are based on vector databases and semantic similarity retrieval, and have achieved good results in open-domain question answering and knowledge-intensive tasks. However, research on RAG in the AOP domain is still relatively limited. AOP knowledge is different from general unstructured text; it has significant hierarchical structure, causal relationships, and network characteristics, which place higher requirements on knowledge organization and retrieval methods. Existing studies still lack RAG designs oriented to the causal relationship characteristics of AOPs, especially in how to effectively utilize KEs, KERs, and overall AOP structural information to support complex AOP mechanistic knowledge modeling and reasoning. Based on this, this paper proposes an AOP analysis-oriented RAG framework, AOP-Smart. This method uses the XML data provided by AOP-Wiki to construct a knowledge base and index files, and designs an indexing and knowledge expansion mechanism based on question-related KEs to achieve joint retrieval and knowledge integration of KE, KER, and AOP information. On this basis, the KE, KER, and AOP knowledge related to the question are used as external context and input into LLMs, thereby improving the reliability of LLM results. The main contributions of this study are as follows: (1) A RAG framework for the AOP domain is proposed, which introduces AOP knowledge into the reasoning process of LLMs; (2) A knowledge expansion strategy based on question-related KEs is designed to achieve associated retrieval and knowledge supplementation among KEs, KERs, and AOPs; (3) Comparative experiments verify the effectiveness of this method in alleviating the hallucination problem in the AOP domain and improving answer accuracy. 2. Methods 2.1 Overall Framework of AOP-Smart To ensure the consistency of data sources and the reproducibility of the experimental process, this study conducted experiments based on the stable XML snapshot of the AOP-Wiki released on 2026-01-01. This dataset was obtained from the official AOP-Wiki quarterly “Permanent Downloads” archive (https://aopwiki.org/downloads ), which provides versioned XML dumps for citation and reproducible research. The 2026-01-01 release was selected to guarantee data stability, and all contents were subsequently parsed and processed in a unified manner. It should be noted that the constructed system does not depend on a specific version of the data, but has good scalability and updating capability. By replacing the XML file of the corresponding version, the knowledge base can be updated. Figure 1: Overview of the AOP-Smart framework. (A) In the absence of retrieval augmentation, the LLM directly generates responses based solely on its internal parameters, which may lead to incomplete or hallucinated outputs. (B) With the proposed AOP-Smart framework, user queries are first used to retrieve relevant KE candidates from an indexed KE list, followed by structured expansion to KE, KER, and AOP-level information from the knowledge base. The retrieved structured context is then combined with the user query and fed into the LLM to produce a knowledge-enhanced and more reliable response. As shown in Figure 1 (A), without introducing the RAG mechanism, the user question is directly input into the LLM, and the model answers only relying on its internal parameters, lacking the support of external knowledge, and thus is prone to problems such as missing information or factual errors. As shown in Figure 1 (B), the AOP-Smart framework introduces a knowledge retrieval process prior to response