Knowledge-Grounded Agentic Large Language Models for Multi-Hazard Understanding from Reconnaissance Reports Journal: International Journal of Disaster Risk Reduction
Chenchen Kuai, Zihao Li, Braden Rosen, Stephanie Paal, Navid Jafari, Jean-Louis Briaud, Yunlong Zhang, Youssef M. A. Hashash, Yang Zhou · 2025
Read Knowledge-Grounded Agentic Large Language Models for Multi-Hazard Understanding from Reconnaissance Reports Journal: International Journal of Disaster Risk Reduction by Chenchen Kuai, Zihao Li, Braden Rosen, Stephanie Paal, Navid Jafari, Jean-Louis Briaud, Yunlong Zhang, Youssef M. A. Hashash, Yang Zhou (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-14010.txt.
Introduction
Chenchen Kuai, Zihao Li, and seven co-authors turn disaster reconnaissance reports into a question-answering knowledge base. Field reports after earthquakes, floods, and storms hold key evidence about how hazards interact, but their loose narrative form blocks systematic use. Language models could help, yet they invent facts when not grounded in documents.
Their framework, MoRA-RAG, routes each query across hazard-specific databases and chunks reports in a way that keeps context intact. A verification loop checks whether the gathered evidence suffices and searches again when it does not. On a question set built from ninety documented events, the system reached high accuracy and cut hallucinations compared with plain and standard retrieval-augmented models.
Catalog record
| CREATOR | Chenchen Kuai, Zihao Li, Braden Rosen, Stephanie Paal, Navid Jafari, Jean-Louis Briaud, Yunlong Zhang, Youssef M. A. Hashash, Yang Zhou |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 56 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-14010
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Knowledge-Grounded Agentic Large Language Models for Multi-Hazard Understanding from Reconnaissance Reports Journal: International Journal of Disaster Risk Reduction Chenchen Kuai, Zihao Li, Braden Rosen, Stephanie Paal, Navid Jafari, Jean-Louis Briaud, Yunlong Zhang, Youssef M. A. Hashash, Yang Zhou Abstract Post-disaster reconnaissance reports contain critical evidence for understanding multi-hazard interactions, yet their unstructured narratives make systematic knowledge transfer difficult. Large language models (LLMs) offer new potential for analyzing these reports, but often generate unreliable or hallucinated outputs when domain grounding is absent. This study introduces the Mixture-of-Retrieval Agentic RAG (MoRA-RAG), a knowledge-grounded LLM framework that transforms reconnaissance reports into a structured foundation for multi-hazard reasoning. The framework integrates a Mixture-of-Retrieval mechanism that dynamically routes queries across hazard-specific databases while using agentic chunking to preserve contextual coherence during retrieval. It also includes a verification loop that assesses evidence sufficiency, refines queries, and initiates targeted searches when information remains incomplete. We construct HazardRecQA by deriving question–answer pairs from GEER reconnaissance reports, which document 90 global events across seven major hazard types. MoRA-RAG achieves up to 94.5% accuracy, outperforming zero-shot LLMs by 30% and state-of-the-art RAG systems by 10%, while markedly reducing hallucinations across diverse LLM architectures. MoRA-RAG also enables open-weight LLMs to achieve performance comparable to proprietary models. It establishes a new paradigm for transforming post-disaster documentation into actionable, trustworthy intelligence for hazard resilience. 1 Introduction Natural hazards such as earthquakes, hurricanes, floods, and wildfires continue to threaten communities, infrastructure, and economies worldwide [ 1 , 2 , 3 ] . While each hazard poses distinct risks, many disasters occur in sequence or in combination, amplifying impacts significantly [ 4 ] . Earthquakes may destabilize slopes and cause landslides, hurricanes often generate both storm surge and inland flooding, and heavy rainfall can accelerate soil erosion. These complex dynamics make it essential to understand not only individual hazards but also their interactions. A crucial element in building such understanding is the knowledge transfer [ 5 ] , the ability to learn lessons and knowledge from past events and apply them to strengthen preparedness, response, and resilience against future hazards. Knowledge in the hazard domain is preserved in many forms. Operational manuals describe best practices, predictive models simulate hazard scenarios, and sensor networks provide continuous environmental monitoring [ 6 , 7 , 8 ] . Yet none of these sources fully capture the depth and contextual nuance of post-disaster field evidence. Reconnaissance reports occupy a unique position in this landscape [ 9 ] . Compiled by interdisciplinary teams after major disasters, they document hazard characteristics, infrastructure performance, environmental conditions, and social impacts. These reports integrate measurements, photographs, maps, and expert analyses, often capturing cascading or compound hazards that unfold within a single disaster event. They represent one of the most authoritative sources of hazard knowledge [ 10 ] . However, the very richness that gives these reports their scientific and practical value also makes them challenging to exploit systematically. Reconnaissance documents often span hundreds of pages and encompass a diverse blend of qualitative and quantitative content, including narrative accounts, measurements, maps, tables, and photographic evidence. Although this depth of information offers unparalleled insight into disaster impacts, it is typically presented in highly specialized language filled with technical jargon, abbreviations, and situational references that demand expert interpretation [ 11 ] . Critical findings, such as the relationships between hazard intensity, structural response, and cascading failures, are frequently fragmented between sections and embedded within unstructured narrative text. The absence of uniform standards among the reporting teams further amplifies this challenge, making it difficult to systematically synthesize, compare, and transfer the knowledge contained in these reports [ 12 ] . Recent advances in large language models (LLMs) offer new opportunities to extract, integrate, and reason with this wealth of knowledge. LLMs have demonstrated strong performance on tasks such as summarization, answering questions, and contextual reasoning [ 13 ] . Yet, because they rely heavily on broad world knowledge, their output often suffers from hallucinations, producing fluent but unsupported claims. Retrieval-augmented generation (RAG) seeks to address this issue by grounding responses in external documents [ 14 ] . While effective for general-purpose texts, existing RAG frameworks are not well-suited for long and highly technical hazard reports. Once these reports are divided into smaller chunks (i.e., short text segments split for embedding and retrieval) for vector databases, their rich contextual dependencies become fragmented across numerous segments. Retrieving truly relevant evidence from such a vast and heterogeneous hazard corpus remains difficult [ 15 ] . In addition, most retrieval pipelines rely solely on semantic similarity, tending to retrieve textual information within a single topical dimension [ 16 , 17 ] . In hazard domains, this corresponds to retrieving information from one hazard type while neglecting multiple or cascading hazards. Consequently, the retrieved information can be incomplete or misleading, and the LLMs built upon it often fail to produce trustworthy, well-grounded responses. Moreover, conventional RAG systems lack mechanisms to assess whether the retrieved evidence is sufficient or to recognize when a reliable answer cannot be provided [ 18 ] . These limitations reveal a fundamental gap between current retrieval architectures and the demands of multi-hazard reasoning. Addressing this gap requires a framework capable of both precision retrieval and iterative validation across diverse hazard domains. To this end, this paper presents the first systematic effort to adapt RAG for transforming hazard reports, such as reconnaissance documents, into structured and reliable world knowledge that supports multi-hazard understanding and reasoning with LLMs. A dedicated dataset, HazardRecQA , is developed from reconnaissance reports to benchmark the quality of knowledge transfer. Building upon this foundation, we propose the Mixture-of-Retrieval Agentic RAG (MoRA-RAG) framework, which overcomes the limitations of existing approaches. MoRA-RAG incorporates a Mixture-of-Retrieval (MoR) mechanism that dynamically selects relevant hazard databases through a routing strategy, enhancing retrieval precision and highlighting cross-hazard relationships. Its agentic architecture actively verifies the sufficiency and consistency of retrieved evidence, performs targeted online searches to fill knowledge gaps, and synthesizes external information to strengthen reasoning robustness. By combining these capabilities, MoRA-RAG establishes a new paradigm for trustworthy and context-aware knowledge transfer in the hazard domain, enabling LLMs to reason across interconnected disaster processes and support more informed decision-making. 2 Related Literature 2.1 Knowledge transfer in natural hazards Knowledge transfer from past events helps understand how hazards evolve, interact, and impact communities as new events unfold [ 3 , 19 ] . By drawing on prior experiences, researchers and practitioners are able to identify patterns of vulnerability, recognize emerging risks, and anticipate cascading effects across interconnected systems [ 20 , 21 , 22 ] . Forecasting and predictive modeling leverage data from historical events to identify recurring patterns and prepare in advance of upcoming hazards, forming the foundation of modern early warning systems [ 23 , 24 ] . Similarly, resilience analyses based on past disasters reveal how infrastructure, logistics, and social systems respond and recover under disruption, offering insights into system fragility and redundancy [ 25 ] . All together, knowledge transfer remains a cornerstone of hazard impact analysis and an indispensable component of disaster preparedness and response. However, much of this knowledge transfer still relies primarily on structured data (e.g., tabular records and quantitative indicators). At the same time, a substantial