Ad Insertion in LLM-Generated Responses
Shengwei Xu, Zhaohua Chen, Xiaotie Deng, Zhiyi Huang, Grant Schoenebeck · 2026
Read Ad Insertion in LLM-Generated Responses by Shengwei Xu, Zhaohua Chen, Xiaotie Deng, Zhiyi Huang, Grant Schoenebeck (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-19435.txt.
Introduction
Shengwei Xu and four co-authors work out how ads could live inside chat model answers. Paying for large language models in a lasting way is an open problem. Search ads rested on static keywords, but chat users reveal their wants in passing, inside a flowing conversation, and those wants fade fast.
Ad insertion must catch that fleeting intent and place a fitting offer without wrecking the answer. The team studies the design of such a system. How this gets solved will shape whether chat tools stay free, and how much trust users keep in answers that also sell.
Catalog record
| CREATOR | Shengwei Xu, Zhaohua Chen, Xiaotie Deng, Zhiyi Huang, Grant Schoenebeck |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 70 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-19435
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Ad Insertion in LLM-Generated Responses Shengwei Xu, Zhaohua Chen, Xiaotie Deng, Zhiyi Huang, Grant Schoenebeck Abstract Sustainable monetization of Large Language Models (LLMs) remains a critical open challenge. Traditional search advertising, which relies on static keywords, fails to capture the fleeting, context-dependent user intents–the specific information, goods, or services a user seeks–embedded in conversational flows. Beyond the standard goal of social welfare maximization , effective LLM advertising imposes additional requirements on contextual coherence (ensuring ads align semantically with transient user intents) and computational efficiency (avoiding user interaction latency), as well as adherence to ethical and regulatory standards , including preserving privacy and ensuring explicit ad disclosure. Although various recent solutions have explored bidding on token-level and query-level, both categories of approaches generally fail to holistically satisfy this multifaceted set of constraints. We propose a practical framework that resolves these tensions through two decoupling strategies. First, we decouple ad insertion from response generation to ensure safety and explicit disclosure. Second, we decouple bidding from specific user queries by using “genres” (high-level semantic clusters) as a proxy. This allows advertisers to bid on stable categories rather than sensitive real-time response, reducing computational burden and privacy risks. We demonstrate that applying the VCG auction mechanism to this genre-based framework yields approximately dominant strategy incentive compatibility (DSIC) and individual rationality (IR), as well as approximately optimal social welfare, while maintaining high computational efficiency. Finally, we introduce an "LLM-as-a-Judge" metric to estimate contextual coherence. Our experiments show that this metric correlates strongly with human ratings (Spearman’s ρ ≈ 0.66 \rho\approx 0.66 ), outperforming 80% of individual human evaluators. 1 Introduction ChatGPT now has more than 700 million weekly active users ( 1 ) . However, only around 10 million users are paying subscribers ( 1 ) . Given the considerable cost of training and deploying LLMs—a recent survey by International Data Corporation (IDC) forecasted $108 billion GenAI spending in the U.S. in 2028 ( 21 ) —this poses a challenge of sustainably monetizing LLM services which so many rely on. A natural approach to monetizing LLM services is to integrate ads into LLM responses, similar to current search engines. Indeed, a recent survey ( 35 ) revealed that 68% of users have used LLMs for “searching to find facts quickly, like a search engine”, and 57% of them have used LLMs for “getting information about products and services”. For context, Google Ads had revenues in excess of $260 billion in 2024 ( 41 ) . Thus, introducing ads into LLM responses could largely defray the costs associated with LLM services. However, the transition from “Search” to “Chat” is not merely a shift in interface; it presents unique structural challenges. In a search engine, user intent ( 6 ) is naturally encoded by the static keywords, so advertisers can bid on keywords when they want impressions targeting a certain intent. These keywords give a good indication of the users’ state of mind, and, in particular, what goods or services they may be seeking. In an LLM chat, the analogous user intent, we use the same terminology, may shift throughout a complex conversational flow. For example, an LLM response about a user’s family vacation to New York City might start with a discussion of attractions, then move on to accommodations, transportation, and budget considerations. Ideally, an ad about transportation would appear surrounded by text about transportation rather than text regarding accommodations. Placing an ad in the right place not only maximizes its effectiveness but also makes the ad less disruptive for the user experience. This fundamental shift raises three technical challenges: 1. Contextual coherence : How do we identify the evolving user intent in the LLM response to provide coherent ads, so that we can align advertisers’ welfare with specific users’ intents? 2. Computational efficiency : How do we insert ads without introducing latency that degrades the real-time user experience? 3. Social welfare : How can we design an mechanism that (approximately) maximizes social welfare, defined as the sum of advertiser and platform utilities, in the absence of explicit, static keywords to bid on? In addition, inserting commercial bias into the organic flow is constrained by practical considerations . For example, on the regulation side, LLM platforms must explicitly mark where ads are inserted, to align with the U.S. Federal Trade Commission (FTC) policy that “advertising and promotional messages that are not identifiable as advertising to consumers are deceptive if they mislead consumers into believing they are independent, impartial, or not from the sponsoring advertiser itself” ( 14 ) . On the ethics side, ads in the LLM response should also be non-deceptive and non-misleading. Further, if advertisers bid on the level of each query or each token, they may get access to possibly sensitive user prompts, leading to privacy issues. With these challenges in mind, we aim to answer the following research question: How can we design a practical framework for integrating ads in LLM responses with high advertisers’ economic welfare, contextual coherence, and computational efficiency? 1.1 Existing Solutions and Challenges Traditional search and display advertising models, which rely on fixed ad slots and static user intent, do not generalize well to this domain. LLM responses are dynamic and lack pre-defined slots, and an ad’s effectiveness depends heavily on its contextual coherence with the surrounding context that leads to specific user intents. Conceptually, this resembles native advertising , where ads are seamlessly woven into the narrative. However, native ads are typically labor-intensive; for instance, a paid post on the New York Times can require 6–12 weeks of planning ( 46 ) . Given that LLM platforms operate in real-time, we require a mechanism that achieves this level of integration with high computational efficiency . In the past two years, there has been a surge of studies on mixing ads into LLM responses. A position paper, 13 , raises several critical factors of LLM advertising, the most important of which is “what to bid for”. To this end, existing works can be roughly classified into two groups, both of which face challenges regarding computational efficiency and practical concerns that our framework addresses. The first group ( 12 ; 18 ) allows advertisers to bid at the token or segment level . Here, advertisers bid repeatedly during generation for their content to appear as the next token. This approach introduces significant latency. More critically, as reported in 50 , if LLMs are prompted to subtly blend ads into the organic response, the resulting ads can be hard to recognize. Because the content is generated in real-time by an LLM, it is also susceptible to hallucinations and misinformation. The second group ( 40 ; 11 ; 29 ; 3 ) focuses on bidding at the query or response level . While it avoids token-level generation issues by inserting pre-defined ads, bidding on the entire query forces advertisers to value the whole interaction in aggregate, preventing them from targeting the specific moments within the response (e.g., a travel plan containing both “flight” and “hotel” contexts). Furthermore, this approach typically requires advertisers to submit a bid for each specific user query. This also imposes a massive computational burden on advertisers, who must perform real-time semantic analysis to value each unique query