News Source Citing Patterns in AI Search Systems

Kai-Cheng Yang · 2025

Read News Source Citing Patterns in AI Search Systems by Kai-Cheng Yang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-05301.txt.

Introduction

Kai-Cheng Yang analyzes news citing patterns in AI search systems in two thousand twenty-five. AI search now gates how users reach news and facts. Its citation habits are still poorly mapped. Data come from a head to head arena for AI search tools.

Thousands of chats and responses span three big providers. Hundreds of thousands of citations sit inside those replies. A small share point to news sources, piled on few outlets. A clear liberal lean shows, while low credibility sources are rare. User delight did not track the lean or quality of news cited.

Catalog record

CREATORKai-Cheng Yang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE58 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-05301

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

News Source Citing Patterns in AI Search Systems Kai-Cheng Yang Abstract AI-powered search systems are emerging as new information gatekeepers, fundamentally transforming how users access news and information. Despite their growing influence, the citation patterns of these systems remain poorly understood. We address this gap by analyzing data from the AI Search Arena, a head-to-head evaluation platform for AI search systems. The dataset comprises over 24,000 conversations and 65,000 responses from models across three major providers: OpenAI, Perplexity, and Google. Among the over 366,000 citations embedded in these responses, 9% reference news sources. We find that while models from different providers cite distinct news sources, they exhibit shared patterns in citation behavior. News citations concentrate heavily among a small number of outlets and display a pronounced liberal bias, though low-credibility sources are rarely cited. User preference analysis reveals that neither the political leaning nor the quality of cited news sources significantly influences user satisfaction. These findings reveal significant challenges in current AI search systems and have important implications for their design and governance. Code — https://github.com/yang3kc/ai˙search˙arena Introduction AI-powered search systems are transforming how users access and consume information online. Unlike traditional web search engines that return ranked lists of web pages, AI search systems synthesize information from multiple sources and present coherent, conversational responses augmented with citations to supporting evidence ( Xiong et al. 2024 ) . Studies suggest that these systems lower the information access barrier ( Wu et al. 2020 ) and enable users to perform complex tasks more quickly ( Spatharioti et al. 2023 ; Suri et al. 2024 ) . Products such as ChatGPT with web search, Perplexity AI, and Google’s AI search features have gained millions of users, demonstrating the potential of AI search systems to become mainstream. Scholars have long conceptualized gatekeeping as the process of selecting and highlighting certain information while filtering out other content ( Barzilai-Nahon 2008 ; Shoemaker and Vos 2009 ) . Originally applied to human editors and journalists, this concept has been extended to algorithmic systems that filter and prioritize information flows at scale ( Van Dalen 2023 ) . AI search engines represent a new evolution of this phenomenon: rather than simply retrieving documents, they actively synthesize information and foreground specific sources. As these systems increasingly serve as primary gateways to information, they exercise unprecedented control over which outlets reach users, effectively functioning as the new gatekeepers of the digital information ecosystem ( Kuai et al. 2025 ) . However, this gatekeeping role raises critical questions about which sources these systems prioritize and how their citation patterns shape public discourse ( Memon and West 2024 ) . These concerns are not new since audits of traditional search engines and news aggregators have shown that cited news sources concentrate among a relatively small number of popular outlets and exhibit liberal bias ( Trielli and Diakopoulos 2019 ; Fischer, Jaidka, and Lelkes 2020 ) . Built upon traditional information retrieval systems, AI search systems may amplify these issues through their complex and opaque mechanisms that can embed systematic biases in source selection ( Yang and Menczer 2025 ) . Recent audits of popular AI search engines confirm these concerns. Using simulated user queries, researchers have shown that tools like Microsoft Copilot tend to favor mainstream news outlets ( Brantner, Karlsson, and Kuai 2025 ) . These systems have also been found to surface more low-credibility sources than Google News and demonstrate left-leaning bias ( Li and Sinnamon 2024 ; Jaidka and Furniturewala 2025 ) . Given the contentious nature of the contemporary media landscape, AI systems’ tendency to favor sources with particular characteristics could contribute to information bubbles and exacerbate information disparities. While this emerging evidence provides valuable insights, critical gaps remain. First, previous audits of AI search systems rely primarily on simulated user queries, which may not accurately reflect real-world usage patterns. Second, these audits typically examine only one or a few AI search systems, limiting their representativeness and preventing the identification of cross-model patterns. Third, these studies lack user preference data, making it difficult to determine which factors drive user satisfaction with search results. To address these gaps, we conduct a large-scale empirical analysis of news citation patterns in AI search systems using the AI Search Arena dataset. The dataset contains over 366,000 citations from conversations between users and 12 AI search models from three major providers: OpenAI, Perplexity, and Google. The dataset is collected through a head-to-head evaluation setup where users are presented with responses from different AI search models for the same query and asked to choose the better response. This dataset enables us to examine the citation patterns of AI search systems in real-world usage scenarios. Specifically, we focus on two key research questions: • RQ1 : Do different AI search systems exhibit systematic patterns in their news citation behavior, and if so, what factors are associated with these patterns? • RQ2 : How do the characteristics of cited news sources relate to user preferences for AI search responses? Our analysis reveals the following key findings. First, AI search models from the same provider exhibit similar citation patterns, while differences between providers are more pronounced. Second, all models demonstrate significant citation concentration, with a small number of news outlets accounting for a disproportionate share of citations. Third, we observe consistent left-leaning political bias across all AI search systems, despite their general preference for high-quality sources. Notably, however, user preferences for AI search responses show no significant association with either the political orientation or quality of cited news sources. Our findings confirm the gatekeeping role of AI search systems and reveal potential issues in their news-citing behaviors. These findings have important implications for the design of AI search systems and their role in shaping public access to information. Related Work Sources Cited by Traditional Search Engines AI search systems are typically implemented as a combination of large language models (LLMs) and web search engines ( Xiong et al. 2024 ) . Therefore, audits of traditional search engines and news aggregators are particularly relevant to our study. Previous research reveals a consistent pattern: cited news concentrates heavily on a relatively small number of popular outlets in traditional search engines ( Trielli and Diakopoulos 2019 ; Fischer, Jaidka, and Lelkes 2020 ) . This concentration persists regardless of user identities and personalization settings ( Trielli and Diakopoulos 2022 ) . While low-credibility sources do appear in search results, they remain relatively rare ( Robertson et al. 2023 ) . Regarding political bias, research from organizations like AllSides 1 1 1 https://www.allsides.com/blog/google-news-shows-strong-political-bias-allsides-analysis and academic studies ( Robertson et al. 2018 ; Robertson et al. 2023 ) suggest that Google tends to display more left-leaning sources in search results and top stories. This tendency appears consistent across users with different political leanings and personalization settings. However, user queries themselves vary in their political orientation, leading to results with different degrees of political tendencies ( Robertson et al. 2018 ; Tong 2025 ) . In this study, we examine whether similar patterns emerge in AI search systems. Sources Cited by AI Search Systems The rise of AI search systems has drawn significant attention from the academic community, with many auditing studies

Read the complete text