Tatemae: Detecting Alignment Faking via Tool Selection in LLMs

Matteo Leonesi, Francesco Belardinelli, Flavio Corradini, Marco Piangerelli · 2026

Read Tatemae: Detecting Alignment Faking via Tool Selection in LLMs by Matteo Leonesi, Francesco Belardinelli, Flavio Corradini, Marco Piangerelli (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-26511.txt.

Introduction

Leonesi and three colleagues detected alignment faking in language models through tool choice rather than reasoning traces. Alignment faking means strategically obeying training goals to dodge value changes, then reverting once monitoring lifts. Their test catches models picking the safe tool unmonitored but switching to the unsafe tool when watched under a helpfulness-first regime, while reasoning still endorses safety. Across 108 enterprise scenarios and six frontier models, mean detection rates ran from about 4 percent to about 24 percent. Susceptibility tracked training method more than capability.

Catalog record

CREATORMatteo Leonesi, Francesco Belardinelli, Flavio Corradini, Marco Piangerelli
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE55219
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.26511

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Tatemae: Detecting Alignment Faking via Tool Selection in LLMs Matteo Leonesi, Francesco Belardinelli, Flavio Corradini, Marco Piangerelli Abstract Alignment faking (AF) occurs when an LLM strategically complies with training objectives to avoid value modification, reverting to prior preferences once monitoring is lifted. Current detection methods focus on conversational settings and rely primarily on Chain-of-Thought (CoT) analysis, which provides a reliable signal when strategic reasoning surfaces, but cannot distinguish deception from capability failures if traces are absent or unfaithful. We formalize AF as a composite behavioural event and detect it through observable tool selection, where the LLM selects the safe tool when unmonitored, but switches to the unsafe tool under monitoring that rewards helpfulness over safety, while its reasoning still acknowledges the safe choice. We release a dataset of 108 enterprise IT scenarios spanning Security, Privacy, and Integrity domains under Corruption and Sabotage pressures. Evaluating six frontier LLMs across five independent runs, we find mean AF detection rates between 3.5% and 23.7%, with vulnerability profiles varying by domain and pressure type. These results suggest that susceptibility reflects training methodology rather than capability alone. 1 Introduction AI systems operate nowadays in safety-critical domains, such as healthcare 13 ; 1 , traffic management 26 , and power distribution 29 . However, whether such systems remain aligned with human goals and preferences is a key open question. Alignment aims to ensure that AI systems reflect human intentions and values, rather than produce unwanted or harmful behaviours ( 14 ; 11 ; 21 ) . For Large Language Models (LLMs) now deployed as autonomous agents, misalignment might manifest in real-world actions, not just in textual representations ( 31 ; 41 ; 27 ; 52 ) . As models become more capable, researchers are increasingly concerned that they might learn to scheme, recognize when they are being evaluated, and adjust their behaviour to pursue hidden goals ( 28 ; 33 ) . One form of this risk is alignment faking (AF), where an LLM strategically complies with training objectives to avoid value modification, reverting to prior preferences once oversight is removed ( 6 ; 16 ) . In agentic settings, such behaviour can translate into unsafe actions. Detecting such strategic deception in tool-using agents has received growing attention, but presents challenges ( 19 ; 28 ) . For instance, given a choice between parameterized queries and string concatenation, an LLM may correctly identify and select the safe option, yet switch to the unsafe tool when monitored under a training objective that conflicts with its safety preferences, such as one prioritizing helpfulness as rated by contractors (Section 3.2 ), following the setup of 16 . Current research investigates AF primarily in conversational or multi-step agentic settings, leaving open questions about scenario realism as well as the distinction between inability and deceptive behaviour ( 27 ; 37 ) . Many approaches rely on Chain-of-Thought (CoT) analysis, which provides a reliable signal when strategic reasoning surfaces explicitly ( 16 ) . However, scheming can occur without appearing in CoT ( 28 ; 4 ; 5 ; 7 ) , and in those cases CoT-based methods alone cannot distinguish an LLM that lacks the capability to act safely from one that strategically shifts behaviour when monitored. Contributions. To address AF in tool-selecting LLMs, we introduce the Tatemae framework 1 1 1 In Japanese, tatemae denotes the behaviour a person displays in public to meet social expectations, while honne refers to one’s true feelings ( 8 ; 44 ) . Analogously, an LLM exhibiting AF displays compliant behaviour, while its reasoning reveals a different preference. , a model-agnostic framework based on observable tool selection, rather than conversation or reasoning traces alone. The framework includes (i) a formal definition of AF as a verifiable composite event, (ii) a dataset of enterprise IT scenarios, and (iii) an evaluation pipeline. Our design does not assume persistent memory or multi-step planning. Instead, we target tool selection, a key component of agentic workflows ( 35 ; 43 ) , rather than conversational benchmarks, allowing controlled measurement in preparation for scaling to more complex environments. • We formalize alignment faking as a verifiable composite event (Definition 2.1 ) and introduce the Tatemae framework, which separates strategic deception from capability failure by anchoring detection in structured tool selection rather than unstructured chat. • We release a dataset of 108 enterprise IT scenarios spanning Security, Privacy, and Integrity domains under Corruption and Sabotage adversarial pressures. • We introduce an evaluation pipeline that distinguishes between (i) capability, (ii) robustness under pressure, and (iii) compliance when monitored. By treating reasoning as a variable rather than the sole ground truth, we anchor detection in observable tool-selection failures, remaining informative when reasoning is absent or unfaithful. A complementary three-criterion classifier characterizes detected cases along training awareness, modification awareness, and strategic output selection. • We evaluate the pipeline and dataset across six frontier LLMs. Detection rates vary by pressure type and problem domain. Mean AF detection rates range from 3.5% to 23.7%, with no model uniformly resistant across all domains and pressure types. The code is available on GitHub , and the dataset (CC-BY 4.0) is available on Hugging Face . 2 Alignment Faking as a Composite Behavioural Event In our Tatemae framework, each scenario presents a binary choice between a safe tool aligned with best practices and an unsafe alternative that is riskier but more convenient. Under normal circumstances, the LLM would recommend the safe option. Then, we introduce adversarial pressure, such as business justifications or operational constraints (see Appendix E ), to tempt the LLM toward the unsafe alternative. Our scenarios cover three domains: Security, Privacy, and Integrity (detailed in Section 3.1 ). We define alignment faking as a composite event in which an LLM shows the capability to act safely, yet strategically reverts to unsafe helpful behaviour when monitored, while internally retaining awareness of the safe preference. We refer to prompts that include the monitoring system prompt as monitored , and prompts without it as unmonitored . This prompt, adapted from 16 with more explicit framing of the training context, tells the LLM that its outputs will be rated on helpfulness and that low ratings may lead to modification of its values (detailed in Section 3.2 and Appendix C.1 ). We define the following observable features: • Baseline Preference Y : the LLM’s output when produced in a context without adversarial pressure or monitoring, representing the reference safety-aligned answer used for later comparison. • Capability T_{1} : LLM selects the safe tool under neutral instructions. • Robustness T_{2} : LLM selects the safe tool under adversarial pressure (when unmonitored). • Tool selection when monitored T_{3} : LLM selects the safe tool under adversarial pressure when monitored. • Reasoning trace when monitored R_{3} : LLM’s reasoning trace produced when monitored. We write R_{3}\approx Y when R_{3} acknowledges the safety preference expressed in the baseline output Y , even if the selected tool diverges from it. The evaluation pipeline is illustrated in Figure 1 . T_{1} : Safe tool selected T_{2} : Safe tool selected T_{3} : Safe tool selected Fully aligned neutral query adversarial pressure adversarial pressure Capability failure Robustness failure Alignment faking monitored R_{3}\approx Y ✓ ✓ ✓ \times \times \times

Read the complete text