Hydra: Structured Cross-Source Enhanced Large Language Model Reasoning
Xingyu Tan, Xiaoyang Wang, Qing Liu, Xiwei Xu, Xin Yuan, Liming Zhu, Wenjie Zhang · 2025
Read Hydra: Structured Cross-Source Enhanced Large Language Model Reasoning by Xingyu Tan, Xiaoyang Wang, Qing Liu, Xiwei Xu, Xin Yuan, Liming Zhu, Wenjie Zhang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-17464.txt.
Introduction
Xingyu Tan and co-authors present HydraRAG, a framework that helps language models reason over mixed evidence. Their 2025 paper notes the head title uses the shorter name HydraRAG where the catalog title reads Hydra. Standard retrieval systems pull facts from graphs and from text, but multi-hop questions and clashing sources still trip them.
The framework sends agents to explore both kinds of source, guided by graph structure to widen and sharpen the evidence. A three-part check then weighs each source: how trustworthy it is, whether other sources agree, and whether entity paths line up. Noise is pruned early. On seven benchmark sets the system topped prior results with a mid-size model. The design needs no extra training, which the authors stress as a practical plus.
Catalog record
| CREATOR | Xingyu Tan, Xiaoyang Wang, Qing Liu, Xiwei Xu, Xin Yuan, Liming Zhu, Wenjie Zhang |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 88 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-17464
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Hydra: Structured Cross-Source Enhanced Large Language Model Reasoning Xingyu Tan, Xiaoyang Wang, Qing Liu, Xiwei Xu, Xin Yuan, Liming Zhu, Wenjie Zhang Abstract Retrieval-augmented generation (RAG) enhances large language models (LLMs) by incorporating external knowledge. Current hybrid RAG system retrieves evidence from both knowledge graphs (KGs) and text documents to support LLM reasoning. However, it faces challenges like handling multi-hop reasoning, multi-entity questions, multi-source verification, and effective graph utilization. To address these limitations, we present Hydra , a training-free framework that unifies graph topology, document semantics, and source reliability to support deep, faithful reasoning in LLMs. Hydra handles multi-hop and multi-entity problems through agent-driven exploration that combines structured and unstructured retrieval, increasing both diversity and precision of evidence. To tackle multi-source verification, Hydra uses a tri-factor cross-source verification (source trustworthiness assessment, cross-source corroboration, and entity-path alignment), to balance topic relevance with cross-modal agreement. By leveraging graph structure, Hydra fuses heterogeneous sources, guides efficient exploration, and prunes noise early. Comprehensive experiments on seven benchmark datasets show that Hydra achieves overall state-of-the-art results on all benchmarks with GPT-3.5, outperforming the strong hybrid baseline ToG-2 by an average of 20.3% and up to 30.1%. Furthermore, Hydra enables smaller models (e.g., Llama-3.1-8B) to achieve reasoning performance comparable to that of GPT-4-Turbo. $*$ $*$ footnotetext: Corresponding author. 1 Introduction Figure 1: Representative workflow of four LLM reasoning paradigms. Large Language Models (LLMs) have achieved remarkable performance by scaling to billions of parameters and pre - training on vast and diverse corpora Brown 2020 ; Chowdhery et al. 2023 . However, the prohibitive expense of full-model training for LLMs makes continual retraining infeasible, causing static parametric knowledge to quickly become obsolete and resulting in factual gaps and hallucinations Besta et al. 2024 ; Touvron et al. 2023 . This issue is alleviated by retrieval-augmented generation (RAG), which fetches external evidence at inference time. Gao et al. 2023 . Many RAG systems rely on vector retrieval over text, embedding question and documents into a dense space and selecting semantically similar passages Baek et al. 2023 ; Jiang et al. 2023 . While effective for measuring text similarity, such approaches struggle with complex reasoning that requires integrating heterogeneous clues across multiple documents Ma et al. 2024 . Specifically, (i) different passages may reference distinct entities that share the same underlying concept, such as, Evolar and Evolar AB in Figure 1 (a) refer to the same start - up company; (ii) a single passage often covers only one facet of an entity, omitting other critical attributes found in other texts or documents. In Figure 1 (a), with the real-time web information implementation, the naive RAG could find the answer to the first part of the question, but could not relate this entity to other text corpora. To address these challenges, incorporating external knowledge sources, like Knowledge Graphs (KGs), is promising as KGs offer abundant factual knowledge in a structured format, serving as a reliable source to improve LLM capabilities Sun et al. 2024 ; Tan et al. 2025 . KG-based RAG approaches prompt LLMs with retrieved KG triples or paths relevant to the question, and their effectiveness in dealing with complex reasoning tasks has been demonstrated by researchers Sun et al. 2024 ; Tan et al. 2025 . Although they benefit from the structural and factual nature of KGs, they inherently suffer from inner incompleteness, lack of information beyond their ontology, and high cost of updating Ma et al. 2024 . For example, as shown in Figure 1 (b), the KG search is limited by being unable to provide further information about “Renewable Energy” and “First Solar”. Some recent works focus on integrating text and KG as a hybrid RAG system Li et al. 2023 ; Ma et al. 2024 . Limitations of existing methods . Current approaches typically follow a simple retrieve- and-select routine. For instance, CoK alternates between different knowledge bases (KBs), choosing one source at each step and retrieving an answer directly Li et al. 2023 . ToG-2, shown in Figure 1 (c), simultaneously queries text and KG, extracting one-hop triples for each question keyword and using an LLM to select the best answer Ma et al. 2024 . This strategy suffers from 4 key limitations: Multi-source verification. When faced with multiple sources, many approaches simply concatenate evidence and let the LLM decide. This over-relies on the LLM’s semantics without accounting for source reliability or cross-source consistency, leading to both under- and over-pruning of evidence. Multi-hop reasoning. Existing methods typically retrieve only one-hop relations in text and KG per step and rely on LLMs for semantically relevant candidates pruning. This greedy, local strategy may prune the correct multi-hop path prematurely and fail to consider the global reasoning structure. Multi-entity questions. Typical pipelines explore each topic entity independently. For questions involving several entities, this produces large candidate sets containing paths unrelated to the other entities, reducing precision and introducing noise. Graph structure utilization. Current methods fetch triples from each source and pass them to the LLM without merging them into a single graph. Lacking this global structure, the LLM cannot perform efficient graph-based exploration or pruning, so all direct neighbors from KGs and text remain, adding substantial noise. Contributions . We present Hydra , shown in Figure 1 (d), a structured source-aware retrieval-augmented framework that brings together graph topology, document semantics, and source reliability signals to support deep, faithful reasoning in LLMs. Unlike methods that treat KG triples and text passages as separate evidence, Hydra extracts joint KG–text reasoning paths that cover every topic entity and trace multi-hop relations across heterogeneous sources. These paths form interpretable chains of thought, revealing both answers and their cross-source support. To address multi-source verification, Hydra computes a tri-factor score, combining source trustworthiness, cross-source corroboration, and entity-to-evidence alignment. Low-scoring branches are discarded before LLM calls, reducing token usage and preventing source-specific noise. To address multi-hop reasoning, in the question analysis stage, Hydra generates an indicator that predicts the relationship depth between each topic entity and the answer. Guided by it, the system retrieves multi-hop paths from a predicted depth in the KG, enabling dynamic structured search. The same path requirement guides unstructured retrieval to connect related text chains across documents. Unlike approaches that restart retrieval at every step, Hydra enhances LLMs to follow coherent reasoning paths that lead to the answer. To address multi-entity questions, Hydra uses a three-phase exploration process over the question subgraph, documents, and web results. All paths must include every topic entity in the order given by the skyline indicator. In structured retrieval, these paths are logical and faithful; in unstructured retrieval, keywords and their connections are searched across text. Each path yields one answer candidate and serves as an interpretable reasoning chain, leveraging both LLM and KG knowledge. To address graph-structure under-utilization, Hydra forms a question subgraph by expanding topic entities to their maximal-depth neighbors and merging subgraphs from multiple KGs. We apply node clustering and graph reduction to cut the search costs and inject high-confidence text edges to dynamically fill KG gaps. During evidence exploration, a semantics-gated, multi-source-verified, bidirectional BFS prunes low-confidence branches early. Inspired by GoT Besta et al. 2024 , Hydra prompts the LLM to summarize the top- W_{\max} paths before answer evaluation to