Explainable Innovation Engine: Dual-Tree Agent-RAG with Methods-as-Nodes and Verifiable Write-Back

Renwei Meng · 2026

Read Explainable Innovation Engine: Dual-Tree Agent-RAG with Methods-as-Nodes and Verifiable Write-Back by Renwei Meng (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-09192.txt.

Introduction

Renwei Meng proposes an engine that upgrades retrieval-augmented generation by treating methods, not text chunks, as the stored units. Two trees hold the store: one traces where each method came from, the other groups methods so search can start broad and narrow down. At query time an agent picks a named way to combine ideas, builds new method nodes, and logs each step. A checker then drops weak nodes and writes the sound ones back for later use.

Catalog record

CREATORRenwei Meng
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE41561
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.09192

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Explainable Innovation Engine: Dual-Tree Agent-RAG with Methods-as-Nodes and Verifiable Write-Back Renwei Meng Abstract Retrieval-augmented generation (RAG) improves factual grounding, yet most systems rely on flat chunk retrieval and provide limited control over multi-step synthesis. We propose an Explainable Innovation Engine that upgrades the knowledge unit from text chunks to methods-as-nodes . The engine maintains a weighted method provenance tree for traceable derivations and a hierarchical clustering abstraction tree for efficient top-down navigation. At inference time, a strategy agent selects explicit synthesis operators (e.g., induction/deduction/analogy), composes new method nodes, and records an auditable trajectory; a verifier–scorer layer then prunes low-quality candidates and writes validated nodes back to support continual growth. Expert evaluation across six domains and multiple backbones shows consistent gains over a vanilla baseline, with the largest improvements on derivation-heavy settings, and ablations confirm the complementary roles of provenance backtracking and pruning. These results suggest a practical path toward controllable, explainable, and verifiable innovation in agentic RAG systems.Code is available at: https://github.com/xiaolu-666113/Dual-Tree-Agent-RAG . 1 Introduction Large language models (LLMs) excel at text generation and cross-task transfer, yet they remain limited in knowledge freshness , factual reliability , and provenance : outputs may sound plausible without verifiable support. Retrieval-Augmented Generation (RAG) improves grounding by retrieving external evidence during generation [ 8 ] , but surveys still highlight persistent challenges in controllability and interpretability for complex synthesis [ 5 ] . Most RAG deployments follow “flat chunking + vector similarity”: split documents into local chunks and concatenate top- k results. This often breaks for tasks requiring global structure , cross-section integration , and reusable methodological reasoning . Structured retrieval aims to address this: RAPTOR builds hierarchical summary trees for multi-level retrieval [ 12 ] , while GraphRAG uses graphs and community summaries for global synthesis [ 3 ] , suggesting that navigable structures can improve both coverage and interpretability. Our goal goes beyond evidence lookup to controllable innovation : proposing new method nodes and conclusions along auditable derivation chains, then filtering and validating them. Agentic paradigms such as ReAct and tree-structured search improve transparency [ 17 , 16 ] , yet rarely maintain a persistent methodology atlas that encodes “prior methods \rightarrow derived results” for continual growth. Reliability is pivotal in such loops: Self-RAG and Chain-of-Verification add critique and verify–revise control [ 1 , 2 ] , RAGAS provides reference-free evaluation for iteration [ 4 ] , and formal environments (e.g., LeanDojo, Draft–Sketch–Prove, LEGO-Prover) enable executable checking in high-assurance domains [ 15 , 7 , 14 ] . Motivated by these gaps, we propose an Explainable Innovation Engine that retains RAG as the backbone but upgrades the indexing unit from text chunks to methods-as-nodes . The engine maintains (i) a weighted provenance tree that captures traceable method derivations, and (ii) a hierarchical abstraction tree that supports efficient top-down localization and controlled descent [ 12 ] . At inference time, a strategy controller selects explicit synthesis operators (e.g., induction/deduction/analogy) to compose new method nodes, while a verifier–scorer layer prunes low-quality candidates and writes validated nodes back to enable continual growth. Because real research artifacts are often multimodal, we also discuss practical interfaces for multimodal indexing and extraction [ 9 ] . Contributions. (i) A dual-tree, relation-weighted organization of methods-as-nodes for explainable and controllable innovation search; (ii) a closed-loop pipeline—strategy-guided synthesis, score-based pruning, executable verification, and write-back—to balance novelty and reliability; (iii) a unified retrieval pathway that combines global localization (summary abstractions) with fine-grained reuse (provenance backtracking) for visualization and auditing. Paper organization. Section 2 presents current work related to this field. Section 3 details algorithm flow. Section 4 introduce the mathematical methods of evaluation indicators and discuss the results. Section 5 concludes with limitations and future directions. 2 Related Work Our work lies at the intersection of Retrieval-Augmented Generation (RAG), structured indexing, agentic reasoning, and verification-oriented discovery. We review the most relevant threads and highlight what remains missing for controllable, explainable method synthesis . Figure 1: The complete algorithm process 2.1 Retrieval-Augmented Generation and Structured Indexing RAG augments LLMs with external evidence to improve grounding and updateability [ 8 ] , yet most systems still retrieve flat text chunks with limited control over multi-step synthesis. To improve global coverage, RAPTOR builds hierarchical summary trees for multi-level retrieval [ 12 ] , while GraphRAG organizes corpora into graphs and community summaries for global question answering [ 3 ] . KG-guided RAG further exploits relational structure for multi-hop expansion [ 11 , 18 ] . We complement these lines by indexing method units directly: a provenance structure supports reuse and auditing, while an abstraction tree enables top-down navigation. 2.2 Retrieval Strategy, Reflection, and Evaluation Retrieval strategy work addresses when/how to retrieve; HyDE, for example, improves dense retrieval via hypothetical-document embeddings [ 6 ] . Reliability-oriented pipelines such as Self-RAG and Chain-of-Verification add critique and verify–revise loops to reduce evidence misuse and hallucination [ 1 , 2 ] . RAGAS provides reference-free signals to disentangle retrieval and generation quality for iteration [ 4 ] . We extend these ideas from text-level grounding to method-level pruning and validation of synthesized nodes. 2.3 Agentic Search and Verification Loops ReAct and Tree-of-Thoughts introduce explicit tool-using and multi-branch search patterns with evaluation/backtracking [ 17 , 16 ] ; we instantiate these principles over a method-node space with logged operators and attributions for auditability. In high-assurance domains, executable verification strengthens discovery loops: LeanDojo and Draft–Sketch–Prove support retrieval-augmented and sketch-guided proving [ 15 , 7 ] , while LEGO-Prover emphasizes reuse via growing verified libraries [ 14 ] . AlphaGeometry and FunSearch further show that coupling generation with external evaluators can yield measurable progress under selection [ 13 , 10 ] . For multimodal evidence, surveys highlight alignment and structure preservation challenges [ 9 ] , motivating our context-preserving segmentation for method extraction. 2.4 Summary and Gap Prior work improves retrieval, indexing, agentic search, and post-generation verification, but rarely unifies methods-as-nodes with explainable weighted derivations and dual structures for provenance (reuse/auditing) and abstraction (navigation). Our approach integrates structured retrieval, strategy-driven synthesis, pruning, and verification into a controllable innovation loop. 3 Methods We present an explainable, controllable, and verifiable innovation engine built on retrieval-augmented generation (RAG) [ 8 ] . The core idea is to index methods-as-nodes and explicitly represent how methods contribute to subsequent methods/results, enabling structured retrieval, strategy-guided synthesis, and post-hoc verification [ 5 ] . We construct two complementary structures: a provenance tree for traceable derivations and an abstraction tree for efficient hierarchical navigation, inspired by structured retrieval over long corpora [ 12 , 3 ] . The complete algorithm process is shown in the figure 1 . See Appendix C for the complete pseudocode of the algorithm. 3.1 Two-Tree Knowledge Representation 3.1.1 Method Provenance Tree Let T_{M}=(\mathcal{M},\mathcal{E}_{M}) be the method provenance tree . Each node m\in\mathcal{M} is a reusable research method unit (e.g., model, theorem, experimental paradigm, proof tactic). Each directed edge (m_{i}\!\to\!m_{j})\in\mathcal{E}_{M} indicates that m_{i} contributes to m_{j} , with weight w_{ij}\in[0,1] . Real scientific method dependencies are typically a DAG with multi-parent contributions. To obtain a tree backbone for efficient search and visualization, we define the primary parent of m_{j} as \mathrm{parent}(m_{j})=\arg\max_{i}w_{ij}, (1) and keep other incoming edges as optional supporting edges (for explanation/scoring without breaking the

Read the complete text