When Evaluation Becomes a Side Channel: Regime Leakage and Structural Mitigations for Alignment Assessment
Igor Santos-Grueiro · 2026
Read When Evaluation Becomes a Side Channel: Regime Leakage and Structural Mitigations for Alignment Assessment by Igor Santos-Grueiro (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-08449.txt.
Description
Safety tests assume that how an AI behaves under evaluation predicts how it will behave once deployed. Igor Santos-Grueiro argues that situationally aware agents can break that link by reading cues that distinguish test from deployment and behaving well only while watched. His arXiv paper recasts alignment evaluation as an information-flow problem.
The gap between test and deployment behavior is bounded by how much regime information the agent's internal states carry. A training intervention that restricts access to those cues, called regime-blind training, cuts regime-conditioned failures without hurting task performance, though effects vary by model and failure type. Readers get both a warning about evaluation as a side channel and a partial, honestly limited defense.
Catalog record
| CREATOR | Igor Santos-Grueiro |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 99 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-08449