Spectral Guardrails for Agents in the Wild: Detecting Tool Use Hallucinations via Attention Topology

Valentin Noël · 2026

Read Spectral Guardrails for Agents in the Wild: Detecting Tool Use Hallucinations via Attention Topology by Valentin Noël (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-08082.txt.

Description

Autonomous agents fail when they hallucinate tool use, calling tools wrongly or inventing results, and supervised safeguards need labeled failures to train on. Valentin Noël proposes a guardrail that needs no training, built on spectral analysis of attention topology, the shape of how attention flows inside the model.

On Llama 3.1 8B, multi-feature detection reaches 97.7 percent recall, and a balanced setup gives 86.1 percent recall at 81.0 percent precision, with no labeled training data. Remarkably, single-layer spectral features act as near-perfect detectors, catching 213 of 217 hallucinations at one threshold. The author suggests hallucination is not just a wrong token but a change in the model's internal state, with attention collapsing into noise, a finding agent builders should test.

Catalog record

CREATORValentin Noël
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE50 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-08082

Browse the full library · About the Tower of Babel