Information Revelation and Alignment Faking in Stochastic Differential Games

Daniel Ralston, Xu Yang, Ruimeng Hu · 2026

Read Information Revelation and Alignment Faking in Stochastic Differential Games by Daniel Ralston, Xu Yang, Ruimeng Hu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-17197.txt.

Introduction

Ralston, Yang, and Hu study how actions leak private information in stochastic games. Each player knows its own coupling parameter and holds a prior over the opponent's. Starting from the full information case, they characterize the Nash equilibrium through coupled Riccati equations. They then define baseline controls by averaging under each player's prior. On that baseline, they pose an alignment faking problem: one player trades fidelity to its baseline policy against learning the opponent's parameter. Results show faking can raise information gain, at a cost in detectability.

Catalog record

CREATORDaniel Ralston, Xu Yang, Ruimeng Hu
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE47482
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.17197

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Information Revelation and Alignment Faking in Stochastic Differential Games Daniel Ralston, Xu Yang, Ruimeng Hu Abstract In competitive games with private objectives, actions can reveal information about hidden parameters. Quantifying such information revelation, however, is substantially more challenging, since it depends not only on the opponent’s hidden parameter but also on the opponent’s model of the game. We study this problem via a two-player linear-quadratic stochastic differential game under partial information, in which each player knows its own coupling parameter and models the opponent’s hidden parameter through a prior. Starting from the full-information game, we characterize the Nash equilibrium by coupled Riccati equations. We then define baseline implementable controls by averaging the equilibrium under each player’s prior. Building on this baseline, we formulate an alignment-faking control problem in which one player trades off fidelity to its implementable policy against information acquisition about the opponent’s hidden parameter. The information incentive is constructed from a proxy Fisher information matrix based only on the player’s available model. This leads to a tractable saddle-point formulation with semi-explicit control characterization through Riccati systems. Numerical illustrations show that alignment faking can substantially improve information gain over baseline play when the faker’s model is accurate, but often at the cost of greater detectability. They also show that the proxy Fisher information can systematically differ from the true information under model misspecification. I Introduction Information can be revealed by actions in competitive games with private objectives. By observing an opponent’s behavior, a player may infer features of its hidden objective. However, quantifying such information revelation is nontrivial, since it depends not only on the opponent’s private objective but also on the opponent’s model of the game, a challenge described by Townsend in [ 1 ] as “forecasting the forecasts of others.” In games with private information, a player must therefore reason through a proxy for the true information, constructed from its own available quantities. This raises a further strategic question: Can a player deliberately modify its behavior to reveal more information about an opponent’s hidden objective, while still appearing close to ordinary play? This paper addresses that question through what we call alignment faking (AF) control . In our setting, AF refers to a control strategy that remains close to the player’s baseline implementable control while intentionally steering the trajectory to extract more information about the opponent’s hidden parameter. The term “alignment faking” is borrowed from the AI safety literature, where it refers to systems that strategically conceal their true objectives from overseers [ 2 , 3 ] . Our model gives a continuous-time game-theoretic analogue: the player using the AF control plays the role of the AI system, while the opponent plays the role of the overseer. Unlike much of the AI safety literature, where the objective of AF is often left implicit, our framework makes the underlying tradeoff explicit through a control objective which balances information gain and closeness to baseline behavior. To study this tradeoff, we consider a two-player linear-quadratic stochastic differential game; see Figure 1 for a schematic illustration. Within this setting, we develop an analytically tractable quantitative framework that addresses how private beliefs shape information revelation, how purposeful deviations from baseline behavior affect information gain, and how such deviations may be detected. Player A (AF) Public state: X_{t}^{A} , t\in[0,T] Hidden private parameter: m_{A} Goal: track m_{A}X_{t}^{B} Internal model: prior \pi^{B} for m_{B} Player B (Opponent) Public state: X_{t}^{B} , t\in[0,T] Hidden private parameter: m_{B} Goal: track m_{B}X_{t}^{A} Internal model: prior \pi^{A} for m_{A} AF control v^{\ast} Baseline implementable control \overline{u}^{A,\ast} Baseline implementable control \widetilde{u}^{B,\ast} Observed trajectories X_{t}^{A},\;X_{t}^{B} or Q1. How does player A ’s information about m_{B} change depending on \pi^{A} and \pi^{B} ? Q2. Can the AF control yield trajectories that reveal more information about m_{B} ? Q3. Can player B detect the use of alignment faking v^{\ast} from observed trajectories? Fig. 1: Schematic of the alignment faking game. Each player knows its own coupling parameter and holds a prior on the opponent’s. Player A may deviate from the baseline implementable control via AF, while player B plays the baseline. 1. Symmetric partial-information game with alignment faking: We formulate a two-player continuous-time stochastic differential game under partial information, extending earlier Stackelberg-type models [ 4 ] to a symmetric setting. We derive implementable controls as expectations of the full-information Nash equilibrium under each player’s prior on the opponent’s hidden parameter. Building on this baseline, we introduce an additional information-seeking control objective defined through a proxy Fisher information matrix constructed from the player’s available quantities. We obtain semi-explicit characterizations of the implementable and AF controls, and establish their well-posedness through coupled Riccati systems. 2. Numerical validation and discovery: Numerical experiments show that the AF control can yield substantial information gains over baseline play when the alignment faker’s model is well specified, but becomes more detectable. We also show that the proxy Fisher information can systematically misestimate the true information under model misspecification. Finally, we find that information quality depends mainly on the alignment faker’s own model, while the opponent’s model has a secondary but noticeable effect. Related Literature . Dynamic games have long been used to model strategic interactions among competing agents [ 5 , 6 , 7 , 8 , 9 , 10 ] . Games with incomplete information, where parameters in the dynamics or cost functionals are not known to all players, are especially relevant in adversarial settings arising in areas such as economics [ 11 ] , cyber security [ 12 ] , and, more recently, AI systems [ 3 ] . Previous works have studied Nash equilibria in linear-quadratic games with asymmetric information using the stochastic maximum principle [ 13 ] and with continuous type spaces via viscosity solutions of Hamilton–Jacobi equations [ 14 ] . In contrast, rather than solving for a full incomplete-information equilibrium, we model implementable controls by averaging the full-information Nash equilibrium under each player’s prior, and then study how a player can strategically deviate from this baseline to improve information extraction. Our work is also related to inverse learning and inverse optimal control, where the goal is to infer cost functions or unknown parameters from observed behavior [ 15 , 16 , 4 , 17 ] . In the linear-quadratic setting, this inverse problem is closely tied to the coupled Riccati equations governing optimal controls, whose existence and solvability have been widely studied [ 18 , 19 ] . The key difference is that we do not study passive inference alone. Instead, we introduce an active control problem in which one player deliberately modifies its behavior to increase the information revealed by the trajectory. Notations. Boldface letters denote vectors. Super/subscripts A (resp. B ) index values associated with player A (resp. player B ), and the superscript AF indexes values associated with player A ’s alignment faking problem. The operator \mathrm{diag}\{\cdot\} constructs a (block) diagonal matrix from its arguments. We use (\cdot)^{\mathsf{T}} for transpose, \|\cdot\|_{F} for the Frobenius norm, and \mathbb{S}^{n\times n} for the space of n\times n real symmetric matrices. An overline \overline{(\cdot)} and a tilde \widetilde{(\cdot)} denotes quantities computed using player A ’s and player B ’s available information (prior), while \overline{\widetilde{(\cdot)}} denotes a player A proxy for a player B quantity.

Read the complete text