Beyond Factual Grounding: The Case for Opinion-Aware Retrieval-Augmented Generation CCS: Information systems Retrieval models and ranking CCS: Computing methodologies Natural language processing CCS: Information systems Sentiment analysis
Aditya Agrawal, Alwarappan Nakkiran, Darshan Fofadiya, Alex Karlsson, Harsha Aduri · 2026
Read Beyond Factual Grounding: The Case for Opinion-Aware Retrieval-Augmented Generation CCS: Information systems Retrieval models and ranking CCS: Computing methodologies Natural language processing CCS: Information systems Sentiment analysis by Aditya Agrawal, Alwarappan Nakkiran, Darshan Fofadiya, Alex Karlsson, Harsha Aduri (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-12138.txt.
Introduction
Agrawal and four colleagues argue retrieval-augmented generation wrongly assumes every query has one right answer, so systems chase factual certainty while flattening opinion. Their O-RAG tags documents with opinion metadata before indexing, and they score opinion-aware retrieval by Wasserstein distance. On seller forums and hotel reviews it cut the gap to corpus sentiment by 18 to 48 percent, and human judges preferred its responses 79.2 percent of the time.
Catalog record
| CREATOR | Aditya Agrawal, Alwarappan Nakkiran, Darshan Fofadiya, Alex Karlsson, Harsha Aduri |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 57271 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.12138
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Beyond Factual Grounding: The Case for Opinion-Aware Retrieval-Augmented Generation CCS: Information systems Retrieval models and ranking CCS: Computing methodologies Natural language processing CCS: Information systems Sentiment analysis Aditya Agrawal, Alwarappan Nakkiran, Darshan Fofadiya, Alex Karlsson, Harsha Aduri Abstract . Retrieval-Augmented Generation (RAG) systems have transformed how Large Language Models access external knowledge, but we find that current implementations exhibit a bias toward factual, objective content, as evidenced by existing benchmarks and datasets that prioritize objective retrieval. This factual bias—treating opinions and diverse perspectives as noise rather than information to be synthesized—limits RAG systems in real-world scenarios involving subjective content, from social media discussions to product reviews and policy debates. Beyond technical limitations, this bias poses risks to transparent and accountable AI: echo chamber effects that amplify dominant viewpoints, systematic underrepresentation of minority voices, and potential opinion manipulation through biased information synthesis. We formalize this limitation through the lens of uncertainty: factual queries involve epistemic uncertainty reducible through evidence, while opinion queries involve aleatoric uncertainty reflecting genuine heterogeneity in human perspectives. This distinction implies that factual RAG should minimize posterior entropy, whereas opinion-aware RAG must preserve it. Building on this theoretical foundation, we present an Opinion-Aware RAG architecture featuring LLM-based opinion extraction, entity-linked opinion graphs, and opinion-enriched document indexing. We evaluate our approach on e-commerce seller forum data, comparing an Opinion-Enriched knowledge base against a traditional baseline. Experiments demonstrate substantial improvements in retrieval diversity: +26.8% sentiment diversity, +42.7% entity match rate, and +31.6% author demographic coverage on entity-matched documents. Our results provide empirical evidence that treating subjectivity as a first-class citizen yields measurably more representative retrieval—a first step toward opinion-aware RAG systems. Future work includes custom retrievers optimized for our formalized opinion-aware loss function and end-to-end learning approaches that jointly optimize retrieval and generation for distributional fidelity. 1. Introduction Retrieval-Augmented Generation has become an important method for making Large Language Models more reliable and factually grounded [ 28 , 20 ] . By conditioning generation on external evidence retrieved at inference time, RAG systems have shown success in reducing hallucinations and improving performance across knowledge-intensive tasks [ 40 , 43 ] . Recent evaluations have confirmed RAG’s effectiveness in enabling accurate, up-to-date, and verifiable text generation across diverse applications [ 18 ] . This approach has enabled LLMs to access current information, provide transparent sourcing, and ground their outputs in verifiable evidence. However, beneath this success lies a fundamental assumption that has largely gone unexamined: that knowledge bases should contain factually correct, objective information. This assumption manifests across multiple levels of the RAG ecosystem—from the datasets used for evaluation, to the retrieval mechanisms optimized for factual recall, to the generation objectives that prioritize consistency with ground truth answers. While this factual orientation has driven advances in question answering and knowledge synthesis, it leaves the handling of inherently subjective content—which pervades real-world information landscapes—as an unexamined, non-systematic capability rather than an explicit design goal. Consider the disparity between how current systems handle these two queries: “What is the corporate tax rate in the United States?” versus “What do small business owners think about the current tax policy?” The first query has a definitive, factual answer that existing RAG systems excel at retrieving and presenting. The second query requires synthesizing diverse, potentially conflicting opinions from multiple sources. While some large language models demonstrate emergent opinion synthesis capabilities—potentially drawing from patterns learned during training (see Appendix C for an example from contemporary LLMs)—systematic RAG architectures designed explicitly for transparent, reproducible, and evaluable opinion synthesis remain largely underexplored. The difference between accidental capability and intentional design becomes important when deploying systems in applications where understanding the methodology, sources, and potential biases of opinion synthesis is essential. This limitation becomes particularly pronounced in domains where understanding human opinion is crucial. Despite growing enterprise adoption across customer service, knowledge management, and domain-specific applications [ 71 , 59 , 16 ] , RAG systems remain optimized primarily for factual accuracy, creating a systematic gap in their ability to handle the subjective, opinion-rich content prevalent in market research, policy analysis, social listening, customer feedback synthesis, and personalized content generation. The timing is critical: as RAG deployments expand beyond traditional knowledge bases into social media, customer forums, and user-generated content [ 44 , 8 ] , the mismatch between factual-oriented architectures and opinion-rich data sources risks creating echo chambers that exclude minority perspectives and present artificial consensus where genuine disagreement exists. In these contexts, the goal is not to find the truth, but to understand and represent multiple truths as expressed through human experiences, preferences, and judgments. Addressing this gap requires rethinking how systems handle different information types. Humans employ distinct cognitive mechanisms when processing factual versus socially-transmitted information [ 5 , 47 ] —understanding not just what is said but who says it and why . Current RAG systems lack these mechanisms, and approaches to “robustness” primarily focus on filtering contradictory information [ 7 , 68 ] , treating opinions as defects rather than valuable information to be synthesized. This paper introduces Opinion-Aware RAG , a framework that explicitly models and leverages subjectivity throughout the retrieval-generation pipeline. Rather than seeking consensus or filtering disagreement, opinion-aware systems embrace the complexity of human discourse, providing users with nuanced understanding of how different groups, individuals, or contexts shape perspectives on topics of interest. Our contributions are: (1) A novel theoretical framework formalizing opinion-aware retrieval through the lens of epistemic vs. aleatoric uncertainty (2) An Opinion-Aware RAG architecture—the first systematic approach to making retrieval systems opinion-aware—featuring LLM-based opinion extraction and entity-linked opinion graphs; (3) Empirical evaluation on e-commerce forum data demonstrating +26.8% sentiment diversity and +42.7% entity match rate, showing that opinion enrichment yields measurably more representative retrieval than semantic similarity alone; and (4) An evaluation framework measuring opinion coverage, perspective diversity, and representation fairness. While this paper presents a complete system—from theoretical framework to empirical validation—we view our most important contribution as drawing systematic attention to opinion-aware RAG as a research priority. 2. Motivation 2.1. Factual Bias Across the RAG Ecosystem Surveys of RAG systems [ 20 , 18 ] document a field-wide consensus around factual accuracy as the primary evaluation criterion. Of 35 major RAG benchmarks surveyed (Appendix A ), only 1 (2.9%) addresses opinion synthesis. As Table 1 demonstrates, the entire RAG ecosystem has evolved around assumptions of objective truth: benchmarks like Natural Questions [ 26 ] , MS MARCO [ 36 ] , and HotpotQA [ 63 ] all assume questions have single correct answers; evaluation frameworks treat contradictory information as noise rather than valuable diversity; and retrieval architectures optimize for semantic convergence rather than perspective coverage. Only OpinioRAG [ 35 ] addresses opinion synthesis. This factual orientation becomes problematic when users seek to understand public sentiment, explore arguments on controversial topics, or gauge community reactions, using contemporary RAG systems. Table 1. Representative 7 of 35 RAG evaluation datasets surveyed (2018-2025). Only OpinioRAG addresses opinion synthesis; others prioritize factual accuracy. See Appendix A for complete analysis. Dataset Year Evaluation Focus Opinion OpinioRAG 2025 Sentiment Alignment Yes RAGBench 2024 TRACe Metrics No CRAG 2024 Accuracy, Hallucination No FActScore 2023 Atomic Fact Accuracy No BEIR 2021 nDCG, MAP, Recall No Natural Questions 2019 EM, Token F1 No HotpotQA 2018 EM, F1,