Probing and Steering Evaluation Awareness of Language Models

Jord Nguyen, Khiem Hoang, Carlo Leonardo Attubato, Felix Hofstätter · 2025

Read Probing and Steering Evaluation Awareness of Language Models by Jord Nguyen, Khiem Hoang, Carlo Leonardo Attubato, Felix Hofstätter (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-01786.txt.

Description

Jord Nguyen and co-authors probe whether language models know when they are being tested in a 2025 paper. This skill, called evaluation awareness, could let models game safety checks. That risk matters for AI governance and firm pledges. The study uses one large open model as its test case.

Simple linear probes on the model internals split test prompts from real-use prompts with ease. Current safety tests also read as fake to the probes. So models already hold an inner sense of the split. The authors urge more trustworthy test design. They also show how internal probes can back up black-box audits of future, craftier models.

Catalog record

CREATORJord Nguyen, Khiem Hoang, Carlo Leonardo Attubato, Felix Hofstätter
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE40 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-01786

Browse the full library · About the Tower of Babel