Answer Bubbles: Information Exposure in AI-Mediated Search
Michelle Huang, Agam Goyal, Koustuv Saha, Eshwar Chandrasekharan Siebel School of Computing and Data ScienceUniversity of Illinois Urbana-Champaign {mh106, agamg2, ksaha2, eshwar}@illinois.edu · 2026
Read Answer Bubbles: Information Exposure in AI-Mediated Search by Michelle Huang, Agam Goyal, Koustuv Saha, Eshwar Chandrasekharan Siebel School of Computing and Data ScienceUniversity of Illinois Urbana-Champaign {mh106, agamg2, ksaha2, eshwar}@illinois.edu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-16138.txt.
Introduction
Huang and co-authors show how AI search answers narrow what users see. Five systems answer 11,000 real queries in the study. Vanilla GPT, Search GPT, Perplexity, and Google variants face plain Google. Source diversity forms the first check on each answer. Hedging drops by up to 60 percent in AI summaries. Confidence wording stays while caution markers thin out. Wikipedia and long sources gain outsized citation share. Social and negative sources shrink in the mix. Same questions thus yield unlike information worlds per system.
Catalog record
| CREATOR | Michelle Huang, Agam Goyal, Koustuv Saha, Eshwar Chandrasekharan Siebel School of Computing and Data ScienceUniversity of Illinois Urbana-Champaign {mh106, agamg2, ksaha2, eshwar}@illinois.edu |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 45796 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.16138
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Answer Bubbles: Information Exposure in AI-Mediated Search Michelle Huang, Agam Goyal, Koustuv Saha, Eshwar Chandrasekharan Siebel School of Computing and Data ScienceUniversity of Illinois Urbana-Champaign {mh106, agamg2, ksaha2, eshwar}@illinois.edu Abstract Generative search systems are increasingly replacing link-based retrieval with AI-generated summaries, yet little is known about how these systems differ in sources, language, and fidelity to cited material. We examine responses to 11,000 real search queries across four systems—vanilla GPT, Search GPT, Google AI Overviews, and traditional Google Search—at three levels: source diversity, linguistic characterization of the generated summary, and source-summary fidelity. We find that generative search systems exhibit significant source-selection biases in their citations, favoring certain sources over others. Incorporating search also selectively attenuates epistemic markers, reducing hedging by up to 60% while preserving confidence language in the AI-generated summaries. At the same time, AI summaries further compound the citation biases: Wikipedia and longer sources are disproportionately overrepresented, whereas cited social media content and negatively framed sources are substantially underrepresented. Our findings highlight the potential for answer bubbles , in which identical queries yield structurally different information realities across systems, with implications for user trust, source visibility, and the transparency of AI-mediated information access. $\ddagger$ $\ddagger$ footnotetext: Both authors contributed equally. Author order decided by Nintendo Super Smash Bros. $\ast$ $\ast$ footnotetext: Both authors were advisors of this work. 1 Introduction “Google users are less likely to click on a link when they encounter search pages with AI summaries.” —Pew Research Center, July 2025 4 Generative search systems are increasingly mediating how users search for and access information, shifting the landscape from “traditional” link-based search toward AI-generated overviews that select, synthesize, and cite sources on users’ behalf 10 ; 19 . Rather than returning ranked lists of links for users to evaluate themselves, these AI systems collapse the search process into a single synthesized output that implicitly determines what information the users receive, how it is framed, and which sources are attributed. Recent evidence suggests that this shift is already reshaping user behavior at scale. A Pew Research study found that when Google’s AI Overview appeared in search results, users clicked on traditional result links at roughly half the rate compared to searches without a summary, and clicked on sources cited within the AI summary itself in only 1% of visits 4 . As users increasingly rely on these synthesized overviews rather than navigating to original sources, the design choices embedded in generative search systems, i.e., which sources they retrieve, how they synthesize them, and what language they use, can have great impact on how they shape public information exposure 28 . Figure 1: Paper Overview. Traditional search returns a ranked list of links for users to evaluate, while generative search produces an answer bubble containing AI-generated summaries synthesized from multiple sources. We study these answer bubbles along three dimensions: the sources they cite (RQ1), the linguistic and epistemic qualities of their summaries (RQ2), and how faithfully those summaries represent cited content (RQ3). Despite this growing influence, systematic empirical evaluations across generative search systems remain limited. Prior work has examined informational accuracy in individual large language model (LLM)-based systems 33 , but how different systems utilize various types of cited sources, incorporate epistemic attributes in outputs, and maintain fidelity to the original cited information remains understudied. This gap is consequential: just as filter bubbles describe how personalized algorithms restrict the diversity of content users encounter 24 , generative search systems risk creating what we term “answer bubbles” : self-contained, system-specific information realities in which the same query issued to different search platforms could yield structurally different answers, without the user’s knowledge or ability to compare across systems. Furthermore, information-seeking is also influenced by how it is presented. Affective and epistemic cues in language can signal trustworthiness, curiosity, or authority 32 ; 14 . When synthesizing text, these attributes are no longer properties of the original sources alone, but of the system’s own voice. Whether and how these attributes vary across systems remains an open question with direct implications for user trust and information quality. In this paper, we present the first comparative study of generative and traditional search systems. We query 11,000 real user search queries across 11 topics through four systems—vanilla GPT, Search GPT, Google AI Overviews, and traditional Google Search—and ask three research questions (RQs): RQ1: How do the sources cited by generative search systems differ from each other and from traditional search in terms of diversity, concentration, and domain composition? RQ2: How do the epistemic, psycholinguistic, and stylistic qualities of generative search responses vary across systems and topics? RQ3: How faithfully do generative search summaries represent information from their sources? Summary of Findings: Our analysis yields three key findings. First, generative search systems draw from fundamentally different source pools, with Search GPT’s top-100 domains overlapping only 24–25% with traditional Google Search, favoring encyclopedic and news sources while nearly excluding social media. Second, search grounding systematically reshapes the epistemic character of responses, reducing hedging language by up to 60% while preserving confidence markers, with effects varying significantly by topic. Third, biases in source selection compound during synthesis: Wikipedia is both the most-cited and most over-represented source, whereas social media and discussion forums, despite being cited, are substantively under-used by up to 22 percentage points. 2 Related Work Auditing Generative Search Systems: The shift from link-based retrieval to LLM-synthesized search responses has prompted growing scrutiny of how these systems access and present information. 20 audited citation verifiability across four generative search engines, finding that only 51.5% of generated statements were fully supported by their citations. 16 conducted a smaller-scale audit of ChatGPT, Bing Chat, and Perplexity, documenting sentiment and source-authority biases across public-interest topics. 33 showed that augmenting LLMs with search improves factual accuracy on time-sensitive queries, and 19 surveyed LLM-powered search and recommendations. However, these studies focus on individual system properties—accuracy, verifiability, or bias—rather than systematically comparing user-relevant properties across systems. Our work fills this gap with a large-scale cross-system study spanning source selection, linguistic characterization, and source-summary fidelity. Source Bias in Retrieval and Generation: Search engines have long shaped source visibility through ranking concentration 31 . Generative search deepens this dynamic, as systems now actively select which sources to incorporate and suppress 8 . Prior work has shown that dense retrievers exhibit systematic biases toward short, surface-level documents 6 ; 9 . Our work extends these findings beyond the retrieval stage, showing that source-selection biases compound during synthesis. We operationalize this using Equal Coverage and Coverage Parity metrics adapted from 17 , quantifying source-summary fidelity as a measurable property of generative search. Epistemic and Psycholinguistic Dimensions: Psycholinguistic factors and epistemic emotions shape how users seek and evaluate information 14 ; 32 , while linguistic register influences trust 35 ; 5 . Furthermore, behavioral evidence shows users increasingly rely on AI summaries over original sources 4 , amplifying the influence of system-generated language. Research on human-AI interaction further suggests users tend to over-rely on AI outputs lacking explicit uncertainty signals 3 . We operationalize these constructs through LIWC-based analyses, showing that search grounding selectively suppresses hedging while preserving confidence markers. 3 Data & Response Collection We now outline our process for curation of the query dataset and