Typed-RAG : Type-Aware Decomposition of Non-Factoid Questions for Retrieval-Augmented Generation
DongGeon Lee, Ahjeong Park *, Hyeri Lee, Hyeonseo Nam, Yunho Maeng · 2025
Read Typed-RAG : Type-Aware Decomposition of Non-Factoid Questions for Retrieval-Augmented Generation by DongGeon Lee, Ahjeong Park *, Hyeri Lee, Hyeonseo Nam, Yunho Maeng (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-15879.txt.
Introduction
DongGeon Lee and co-authors present Typed-RAG in a 2025 paper on answering non factoid questions. Such questions are open ended, carry varied intent, and need reasoning across several aspects. Standard retrieval augmented generation often retrieves poorly for them and gives thin answers.
Their framework first classifies a question into a type, such as debate, experience, or comparison. It then splits the question into focused sub queries, retrieves for each, and combines the results. A new benchmark built from wiki content covers many question types. Typed-RAG beat language model and standard retrieval baselines on retrieval and answer quality.
Catalog record
| CREATOR | DongGeon Lee, Ahjeong Park *, Hyeri Lee, Hyeonseo Nam, Yunho Maeng |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 55 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-15879
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Typed-RAG : Type-Aware Decomposition of Non-Factoid Questions for Retrieval-Augmented Generation DongGeon Lee, Ahjeong Park *, Hyeri Lee, Hyeonseo Nam, Yunho Maeng Abstract Addressing non-factoid question answering (NFQA) remains challenging due to its open-ended nature, diverse user intents, and need for multi-aspect reasoning. These characteristics often reveal the limitations of conventional retrieval-augmented generation (RAG) approaches. To overcome these challenges, we propose Typed-RAG , a framework for type-aware decomposition of non-factoid questions (NFQs) within the RAG paradigm. Specifically, Typed-RAG first classifies an NFQ into a predefined type (e.g., Debate, Experience, Comparison). It then decomposes the question into focused sub-queries, each focusing on a single aspect. This decomposition enhances both retrieval relevance and answer quality. By combining the results of these sub-queries, Typed-RAG produces more informative and contextually aligned responses. Additionally, we construct Wiki-NFQA, a benchmark dataset for NFQA covering a wide range of NFQ types. Experiments show that Typed-RAG consistently outperforms existing QA approaches based on LLMs or RAG methods, validating the effectiveness of type-aware decomposition for improving both retrieval quality and answer generation in NFQA. Our code and dataset are available on https://github.com/TeamNLP/Typed-RAG . These authors contributed equally to this work. 1 Introduction Traditional and current question answering (QA) systems Rajpurkar et al. (2016) ; Peters et al. (2018) ; Lewis et al. (2020) ; Ouyang et al. (2022) ; Zhang et al. (2024) have primarily addressed factoid questions—queries seeking specific, verifiable information that yield concise, objective answers like “When was Google founded?” . However, real-world information needs extend far beyond such simple factual queries. Figure 1: Comparison of factoid question answering (top) and non-factoid question answering (bottom). Factoid questions typically have a single correct answer, whereas non-factoid questions may admit multiple valid answers. Non-factoid questions (NFQs) represent a fundamentally different challenge from traditional factoid questions, as they require elaborate, interpretive responses that integrate multiple perspectives rather than retrieving single facts Bolotova et al. (2022) . These questions—encompassing comparative evaluations, personal experiences, and open-ended discussions—reflect the rich, multifaceted nature of human information seeking. Figure 1 illustrates the key differences between factoid questions and NFQs, as well as their example answers. Despite their prevalence in practical settings Yang and Alonso (2024) , current approaches to non-factoid question answering (NFQA) face significant limitations. The core challenge lies in the inherent complexity and heterogeneity of NFQs, which vary along multiple dimensions including question intent, aspect directionality, and degree of contrast between perspectives. Existing methods fail to adequately address this diversity. Type-specific approaches to NFQA An et al. (2024) —methods that focus exclusively on particular NFQ types—struggle to generalize across the full spectrum of NFQ types, whereas retrieval-augmented generation (RAG) systems Lewis et al. (2020) ; Izacard and Grave (2021) , despite improving contextuality, produce overly homogeneous responses that lack the multi-faceted depth essential for comprehensive answers. Ultimately, the fundamental challenge is adapting retrieval and generation strategies to the specific characteristics of each NFQ type. To address these limitations, we propose Typed-RAG , a type-aware decomposition approach that fundamentally reimagines NFQA within the RAG paradigm. Our approach integrates question type classification directly into the RAG paradigm, enabling tailored retrieval and generation strategies for distinct NFQ types. The key innovation lies in decomposing multi-aspect NFQs into single-aspect sub-queries, allowing targeted retrieval for each aspect before synthesizing a comprehensive response. This decomposition approach ensures that generated answers align with user intent while capturing the full complexity of the question. In order to assess the performance of Typed-RAG , we evaluate it on Wiki-NFQA, a new benchmark dataset derived from Wikipedia that encompasses a broad spectrum of NFQ types. Our results demonstrate that Typed-RAG significantly outperforms baseline systems, including standard approaches using LLMs and RAG, in handling NFQ complexity and delivering nuanced, intent-aligned answers. Our main contributions are as follows: • We propose Typed-RAG , a novel framework for type-aware decomposition of non-factoid questions that enhances RAG-based NFQA by integrating question type classification with targeted decomposition strategies. • We develop retrieval and generation strategies specifically optimized for different NFQ types, enabling more effective handling of complex and diverse user queries. • We release the Wiki-NFQA dataset, providing a comprehensive benchmark for evaluating QA systems on non-factoid questions and facilitating future NFQA research. • We demonstrate through extensive experiments that Typed-RAG significantly outperforms baseline models, validating the effectiveness of type-aware decomposition in generating contextually appropriate and high-quality answers. By addressing the unique challenges of NFQA through type-aware decomposition, our work bridges the gap between complex user information needs and current QA system capabilities, advancing the development of more adaptive and context-sensitive QA technologies. 2 Related Work 2.1 Non-Factoid Question Answering (NFQA) Non-Factoid Question Taxonomy To address the complexity of real-world QA, prior work has developed detailed taxonomies for question types Burger et al. (2003) ; Chaturvedi et al. (2014) ; Bolotova et al. (2022) . Unlike factoid questions, which seek concise factual answers, non-factoid questions (NFQs) require subjective, multi-faceted responses Chaturvedi et al. (2014) ; Bolotova et al. (2022) . Bolotova et al. (2022) categorized NFQs into six types: Evidence-based , Comparison , Experience , Reason , Instruction , and Debate . Recently, Mishra et al. (2025) emphasized critical challenges faced by LLM-based QA systems when handling NFQs, particularly those requiring in-depth reasoning or nuanced debate, illustrated through practical examples such as detailed descriptive questions (e.g., “How was the construction of the Taj Mahal perceived by the citizens of Agra in the 17th century?” ). Their work also highlighted specific application contexts where robust NFQA systems are vital, including voice assistants like Amazon Alexa Hashemi et al. (2020) and web forums frequently hosting user-generated descriptive queries Bajaj et al. (2016) . In contrast to earlier approaches that target individual NFQ types, our method provides a unified framework to handle all categories effectively. Figure 2: Overview of Typed-RAG . Non-factoid questions (NFQs) are first classified by a pretrained Type Classifier and then processed according to their type. A Multi-aspect Decomposer and Answer Aggregator address each type’s specific requirements using LLMs with tailored prompts. See Appendix A.4 and Figure 17 for prompt details and a complete illustration. Evaluation Metrics Traditional metrics—such as ROUGE or BERTScore Zhang et al. (2020) —often fall short in capturing the semantic richness and nuanced quality of NFQA outputs. To overcome these limitations, Yang et al. (2024) introduced LINKAGE, a listwise ranking framework that uses an LLM as a scorer to rank candidate answers against quality-ordered references. LINKAGE shows stronger correlation with human judgments and outperforms conventional metrics, highlighting its suitability for NFQA evaluation. 2.2 Retrieval-Augmented Generation (RAG) Retrieval-augmented generation (RAG) improves the quality of LLM responses by incorporating external documents, improving factual accuracy and contextual relevance Lewis et al. (2020) ; Izacard and Grave (2021) . However, the quality of RAG outputs critically depends on the retrieval step: irrelevant or noisy documents can exacerbate hallucinations Huang et al. (2023) ; Lee and Yu (2025) . Recent advances apply query rewriting and multi-hop decomposition to enrich retrieved contexts Rackauckas (2024) ; Chan et al. (2024) , and adaptive retrieval strategies that assess query-document relevance before the generation process Jeong et al. (2024) ; Yan et al. (2024) ; Asai et al. (2024) . Despite these developments, the application of RAG to NFQA remains underexplored. For example, Deng