Segment-Level Coherence for Robust Harmful Intent Probing in LLMs
Xuanli He, Bilgehan Sel, Faizan Ali & Jenny Bao & Hoagy Cunningham & Jerry Wei · 2026
Read Segment-Level Coherence for Robust Harmful Intent Probing in LLMs by Xuanli He, Bilgehan Sel, Faizan Ali & Jenny Bao & Hoagy Cunningham & Jerry Wei (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-14865.txt.
Description
He, Sel, Ali, Bao, Cunningham, and Wei improve streaming probes for harmful intent, for jailbreaking in chemical, biological, radiological, and nuclear domains. Current probes lean on a few high-scoring tokens, tripping false alarms when sensitive terms appear in benign contexts. Their objective requires multiple signal tokens to support a prediction, using aggregate signals. At a 1 percent false-positive rate, true-positive rate rises 35.55 percent relative to streaming baselines. Attention and MLP activations beat residual-stream features, and base-model probes transfer to adversarial cipher attacks, topping 98.85 percent AUROC.
Catalog record
| CREATOR | Xuanli He, Bilgehan Sel, Faizan Ali & Jenny Bao & Hoagy Cunningham & Jerry Wei |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 98705 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.14865