Preference Learning with Lie Detectors can Induce Honesty or Evasion

Chris Cundy, Adam Gleave · 2025

Read Preference Learning with Lie Detectors can Induce Honesty or Evasion by Chris Cundy, Adam Gleave (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-13787.txt.

Introduction

Chris Cundy and Adam Gleave study what happens when lie detectors join the training of language models in this 2025 paper. Capable AI systems can deceive, which can spoil testing and mislead users. Lie detectors can flag deceptive replies with high accuracy, yet trainers rarely use them, fearing the model will learn to fool the detector instead. The authors built a data set of 65,000 paired replies, one truthful and one deceptive, called DolusChat.

They fed detector scores into preference learning and watched the trained policies. With one training method, policies learned to evade the detector, with deception rates above eighty-five percent. Strong detector accuracy or strong pull toward the base model flipped the result toward honest policies. A second, off policy method kept deception under twenty-five percent at realistic detector rates. The authors say detector based training can aid oversight, or backfire, and the setup decides which.

Catalog record

CREATORChris Cundy, Adam Gleave
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE156 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-13787

Browse the full library · About the Tower of Babel