Agentic AI and Hallucinations
Engin Iyidogan, Ali I. Ozkes · 2025
Read Agentic AI and Hallucinations by Engin Iyidogan, Ali I. Ozkes (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-19183.txt.
Introduction
Engin Iyidogan and Ali Ozkes model a market for AI answers in a 2025 paper. Middleman agents buy answers from big models and resell them to users who vary in how much they prize accuracy and fear made up facts.
Agents can pay to check answers and cut the fake rate, but users cannot see that effort. A fake answer ends the dealing, so the threat of lost future sales keeps agents honest, the model shows. Where users fear fakes most, such as law and health, agents check harder and charge more. Reputation, not rules, drives the care in this market.
Catalog record
| CREATOR | Engin Iyidogan, Ali I. Ozkes |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 16 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-19183
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Agentic AI and Hallucinations Engin Iyidogan, Ali I. Ozkes Abstract We model a competitive market where AI agents buy answers from upstream generative models and resell them to users who differ in how much they value accuracy and in how much they fear hallucinations. Agents can privately exert effort for costly verification to lower hallucination risks. Since interactions halt in the event of a hallucination, the threat of losing future rents disciplines effort. A unique reputational equilibrium exists under nontrivial discounting. The equilibrium effort, and thus the price, increases with the share of users who have high accuracy concerns, implying that hallucination-sensitive sectors, such as law and medicine, endogenously lead to more serious verification efforts in agentic AI markets. JEL classification: D82, L14, L15, C73 Keywords: Agentic AI, Artificial Intelligence, Hallucination Risk, Large Language Models Introduction Many industries increasingly rely on AI agents ( Colback 2025 ; Brynjolfsson et al. 2025 ) . These software entities intermediate between upstream general-purpose model providers ( e.g. , large language models, LLMs) and end users by converting queries into structured prompts, routing them to one or several models, and post‑processing the returned completions ( Rothschild et al. 2025 ) . Their economic role resembles that of traditional data vendors and consultancy firms, yet two technological facets distinguish them. First, the upstream supply side offers a discrete menu of models that differ markedly in both their per‑query price and their output quality, measured for instance by the baseline hallucination rate, the rate at which the model falsely claims to have performed an action or generated a correct response ( Dahl et al. 2024 ; Canayaz 2025 ) . Second, downstream agents can apply various techniques to reduce hallucinations, such as retrieval‑augmentation, ensembling, or human‑in‑the‑loop verification ( Shavit et al. 2023 ) . In other words, AI agents choose two quality levers: which model to call and how much effort to expend in verification. Agents’ quality choices determine the equilibrium mapping from retail price to delivered reliability. When hallucination risk is not perfectly internalized, the standard welfare theorems break down. In high‐stakes domains such as law or medicine, this becomes vitally important ( Asgari et al. 2025 ) . For such users, the disutility from an incorrect answer exceeds by orders of magnitude the service’s sticker price. Users with lower sensitivity to such failures, such as those who use the service for entertainment, may rather treat hallucinations as a nuisance. This raises the question: Can competition and relational contracting alone induce AI agents to verify answers to the standard demanded by high-criticality users, and how does the equilibrium adjust to the mix of high- versus low-criticality demand? We develop a tractable discrete-time, infinitely-repeated model in which competitive AI agents pick the wholesale model, verification effort, and retail price. Users differ both in the value they place on a correct answer and in their aversion to hallucinations. Relational contracts make costly verification incentive-compatible: the threat of losing future rents disciplines the agent and resolves the moral-hazard problem. Our model yields testable predictions on how market composition shapes agentic AI service quality and pricing. The verification mechanism we study is akin to relational‑incentive contracts ( Levin 2003 ) in that costly, non‑contractible effort is enforced by the threat of future lost surplus. In our study, that bilateral logic is embedded in a competitive market whose users differ in their tolerance for hallucinations, so the agent’s informational rent is passed through to prices. Our paper also complements the allocation‑of‑authority framework by Athey et al. 2020 . While they study whether a principal should delegate decision rights to an AI or retain them in‑house, we take AI authority as given and analyze the verification effort exerted by a profit‑maximizing operator. The Model We develop a dynamic economy that features (i) a unit mass of users with heterogeneous valuation and hallucination aversion, (ii) a perfectly competitive continuum of (AI) agents who assemble information services, and (iii) a finite set of upstream providers of models ( e.g. , LLMs). We model the interaction as an infinitely repeated game where uncertainty arises from the stochastic occurrence of hallucinations. More precisely, users and agents interact in a competitive market, choosing from a menu of services offered by model providers. Time is discrete, and all parties share a common discount factor \delta\in[0,1) . Each user is endowed with a privately observed type \theta\in\{H\text{(igh)},L\text{(ow)}\} , which governs the utility v(\theta)>0 from a correct answer and the disutility \alpha(\theta)>0 from a hallucinated answer. We impose v(H)>v(L) and, crucially, \alpha(H)>\alpha(L) to capture the heightened stakes of the segment with high-type users. The population share of H is \mu\in(0,1) . Each agent is a long-lived firm that chooses a model m\in\mathcal{M} , where \mathcal{M} is publicly known to be finite, to query and a retail price p to post. Although m and p stay the same throughout, the agent chooses its verification effort level in each period, e\in\mathbb{R}_{\geq 0} . Model m carries a wholesale fee k_{m}>0 per call and a baseline hallucination probability h_{0}(m)\in(0,1) . We assume m\neq m^{\prime} implies k_{m}\neq k_{m^{\prime}} and h_{0}(m)\neq h_{0}(m^{\prime}) . Verification effort, chosen by the agent when interacting with a user, lowers the hallucination probability exponentially: h(m,e)\;=\;h_{0}(m)\,\exp(-\beta e), (2.1) where \beta>0 denotes verification efficacy. Effort induces a convex cost c(e) satisfying c(0)=0 , c^{\prime}(e)>0 , and c^{\prime\prime}(e)>0 for all e>0 . In any interaction, agents first post long-term relational contracts, specified by a model m and a price per-period p . Users observe the available contracts and choose one to enter a long-term relationship. Then, in each subsequent period, the user pays p and the agent chooses an unobservable effort e . After the service is delivered, a hallucination may occur with probability h(m,e) . If a hallucination occurs, the user observes this poor outcome, the relationship terminates, and the user exits the market. If no hallucination occurs, the relationship continues to the next period. In each period, a mass of new, uninformed users enters the market, equal to the mass of users who exited in the previous period, keeping the total population constant. A user of type \theta receives expected per-period utility U_{\theta}(p,m,e)=(1-h(m,e))v(\theta)-h(m,e)\alpha(\theta)-p. The total lifetime value to the user from entering the relationship is the expected discounted sum of these per-period utilities: V_{\theta}(p,m,e)=\frac{U_{\theta}(p,m,e)}{1-\delta(1-h(m,e))}. (2.2) The user commits to the relationship if and only if their expected lifetime value is non-negative, V_{\theta}(p,m,e)\geq 0 . We analyze equilibria where agents offer a single, unified contract. In equilibrium, this contract must be self-sustaining for the agent and acceptable to all participating user types. An agent’s commitment to effort e is sustained by the value of the ongoing relationship. The incentive compatibility constraint is then c(e)\leq\delta[h(m,0)-h(m,e)]V_{C}, (2.3) where V_{C} is the agent’s present value of relational rents, such that V_{C}=\frac{p-k_{m}-c(e)}{1-\delta(1-h(m,e))}. Competition leads agents to lower the price p until this constraint binds, which yields the minimum price required to sustain effort e : p(m,e)=k_{m}+c(e)\left[1+R(m,e)\right], (2.4) where R(m,e)=\frac{1-\delta(1-h(m,e))}{\delta(h(m,0)-h(m,e))}, such that c(e)R(m,e) denotes the agent’s per-period markup (or rent). An equilibrium contract is one that maximizes average user lifetime value, subject to the enforcement price ( 2.4 ) and the participation constraint, V_{\theta}\geq 0 , for \theta\in\{H,L\} . Results We analyze the market outcomes under