Segment-Level Coherence for Robust Harmful Intent Probing in LLMs

Xuanli He, Bilgehan Sel, Faizan Ali & Jenny Bao & Hoagy Cunningham & Jerry Wei · 2026

Read Segment-Level Coherence for Robust Harmful Intent Probing in LLMs by Xuanli He, Bilgehan Sel, Faizan Ali & Jenny Bao & Hoagy Cunningham & Jerry Wei (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-14865.txt.

Description

He, Sel, Ali, Bao, Cunningham, and Wei improve streaming probes for harmful intent, for jailbreaking in chemical, biological, radiological, and nuclear domains. Current probes lean on a few high-scoring tokens, tripping false alarms when sensitive terms appear in benign contexts. Their objective requires multiple signal tokens to support a prediction, using aggregate signals. At a 1 percent false-positive rate, true-positive rate rises 35.55 percent relative to streaming baselines. Attention and MLP activations beat residual-stream features, and base-model probes transfer to adversarial cipher attacks, topping 98.85 percent AUROC.

Catalog record

CREATORXuanli He, Bilgehan Sel, Faizan Ali & Jenny Bao & Hoagy Cunningham & Jerry Wei
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE98705
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.14865

Browse the full library · About the Tower of Babel