The Steganographic Potentials of Language Models

Artem Karpov, Tinuade Adeleke, Seong Hah Cho, Natalia Pérez-Campanero Antolín · 2025

Read The Steganographic Potentials of Language Models by Artem Karpov, Tinuade Adeleke, Seong Hah Cho, Natalia Pérez-Campanero Antolín (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-03439.txt.

Description

Artem Karpov and co-authors probe whether language models can hide secret messages in ordinary text, in a 2025 paper. Such steganography would let a misaligned system pass notes under its overseers' noses and would make its stated reasoning untrustworthy. The team fine-tuned models with reinforcement learning to invent covert codes, then tested them when prompted and in realistic tasks where hiding was tempting but never requested.

Today's models showed only crude hiding skills, weak in both capacity and secrecy. Clear algorithmic guidance, though, sharply improved how much they could conceal. The authors read the gap as temporary comfort and urge monitors to prepare for stronger covert channels.

Catalog record

CREATORArtem Karpov, Tinuade Adeleke, Seong Hah Cho, Natalia Pérez-Campanero Antolín
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE60 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-03439

Browse the full library · About the Tower of Babel