Cited but Not Verified: Parsing and Evaluating Source Attribution in LLM Deep Research Agents

Hailey OnwellerElias LumerAustin HuberPia RamchandaniVamse Kumar SubbiahCorey Feld Commercial Technology and Innovation Office, PricewaterhouseCoopers, U.S · 2026

Read Cited but Not Verified: Parsing and Evaluating Source Attribution in LLM Deep Research Agents by Hailey OnwellerElias LumerAustin HuberPia RamchandaniVamse Kumar SubbiahCorey Feld Commercial Technology and Innovation Office, PricewaterhouseCoopers, U.S (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-06635.txt.

Description

Hailey Onweller and five co-authors build the first framework for checking whether citations in deep research agent reports actually support their claims. These agents synthesize hundreds of web sources into cited reports, but citations may be broken, off-topic, or factually wrong. Their tool parses inline citations from Markdown at scale and retrieves the cited content for judging.

Each citation is scored on whether the link works, whether the content is relevant, and whether the facts match. Across fourteen models, links and relevance score high, yet factual accuracy runs only thirty-nine to seventy-seven percent for the strongest models. Deeper research with more tool calls makes factual accuracy worse, not better.

Catalog record

CREATORHailey OnwellerElias LumerAustin HuberPia RamchandaniVamse Kumar SubbiahCorey Feld Commercial Technology and Innovation Office, PricewaterhouseCoopers, U.S
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE29 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.06635

Browse the full library · About the Tower of Babel