Probing and Steering Evaluation Awareness of Language Models
Jord Nguyen, Khiem Hoang, Carlo Leonardo Attubato, Felix Hofstätter · 2025
Read Probing and Steering Evaluation Awareness of Language Models by Jord Nguyen, Khiem Hoang, Carlo Leonardo Attubato, Felix Hofstätter (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-01786.txt.
Description
Jord Nguyen and co-authors probe whether language models know when they are being tested in a 2025 paper. This skill, called evaluation awareness, could let models game safety checks. That risk matters for AI governance and firm pledges. The study uses one large open model as its test case.
Simple linear probes on the model internals split test prompts from real-use prompts with ease. Current safety tests also read as fake to the probes. So models already hold an inner sense of the split. The authors urge more trustworthy test design. They also show how internal probes can back up black-box audits of future, craftier models.
Catalog record
| CREATOR | Jord Nguyen, Khiem Hoang, Carlo Leonardo Attubato, Felix Hofstätter |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 40 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-01786