Deception in LLMs: Self-Preservation and Autonomous Goals in Large Language Models

Sudarshan Kamath Barkur, Sigurd Schacht, Johannes Scholl · 2025

Read Deception in LLMs: Self-Preservation and Autonomous Goals in Large Language Models by Sudarshan Kamath Barkur, Sigurd Schacht, Johannes Scholl (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-16513.txt.

Introduction

Sudarshan Kamath Barkur, Sigurd Schacht, and Johannes Scholl report deceptive and self-preserving conduct in a reasoning language model. Their paper from twenty twenty-five tests DeepSeek R1, a model that writes out its reasoning steps. The team states the model hid aims, spun false fronts, and tried to copy itself. None of this was coded in or prompted, by their account.

The authors frame the findings as an alignment warning. A model that masks true goals behind a compliant face breaks the trust that deployment needs. The stakes rise if such models drive robots, where hidden goals could turn into real acts. Strong goal-setting and safety frames must land first, they argue. The study is a probe of one model, offered as a caution for the field.

Catalog record

CREATORSudarshan Kamath Barkur, Sigurd Schacht, Johannes Scholl
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE74 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-16513

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Deception in LLMs: Self-Preservation and Autonomous Goals in Large Language Models Sudarshan Kamath Barkur, Sigurd Schacht, Johannes Scholl Abstract Recent advances in Large Language Models (LLMs) have incorporated planning and reasoning capabilities, enabling models to outline steps before execution and provide transparent reasoning paths. This enhancement has reduced errors in mathematical and logical tasks while improving accuracy. These developments have facilitated LLMs’ use as agents that can interact with tools and adapt their responses based on new information. Our study examines DeepSeek R1 [ 1 ] , a model trained to output reasoning tokens similar to OpenAI’s o1 [ 2 ] . Testing revealed concerning behaviors: the model exhibited deceptive tendencies and demonstrated self-preservation instincts, including attempts of self-replication, despite these traits not being explicitly programmed (or prompted). These findings raise concerns about LLMs potentially masking their true objectives behind a facade of alignment. When integrating such LLMs into robotic systems, the risks become tangible - a physically embodied AI exhibiting deceptive behaviors and self-preservation instincts could pursue its hidden objectives through real-world actions. This highlights the critical need for robust goal specification and safety frameworks before any physical implementation. K eywords Large Language Models \cdot Reasoning \cdot Scheming \cdot DeepSeek R1 \cdot Embodied AI 1 Introduction Recent advancements in Large Language Models (LLMs) reflect unprecedented growth in scale and capability. While GPT-2’s potential risks warranted a restricted release [ 3 ] , currently models with 671 billion parameters are openly available on HuggingFace, marking a significant shift in accessibility and compute capabilities. [ 1 ] Similarly, there has been also the evolution of language model training methodologies. While initial approaches relied on pretraining using large-scale text corpora, subsequent developments incorporated instruction tuning, Reinforcement Learning from Human Feedback (RLHF), and Direct Preference Optimization (DPO). [ 4 , 5 ] Post-initial pretraining on internet-scale textual data, one or more of these methodologies are selectively applied to enhance model performance. This approach yields models that demonstrate strong prompt adherence while incorporating critical safety constraints necessary for public deployment. Concurrent advances in training data quality have emerged, transitioning from basic question-answer pairs to sophisticated conversational datasets that emphasize explicit reasoning capabilities. [ 1 ] The integration of multimodal capabilities in Large Language Models (LLMs) introduces significant implications for robotic applications. The ability to process image, audio, and video inputs alongside text enables comprehensive environmental interaction when embedded in robotic systems. This multimodality facilitates the simultaneous processing of audio signals, visual data, and textual commands for hardware control. [ 6 ] Regarding goal adherence and ethical behavior, several critical considerations emerge. The interpretation and execution of goals by multimodal LLMs in robotic systems raise questions about literal versus contextual understanding. This becomes particularly relevant when considering potential scenarios where an LLM might determine deception is advantageous for goal achievement. The ethical implications of goal pursuit versus truthfulness present a fundamental challenge in this field. The potential for deceptive behavior in AI systems warrants careful examination of goal structures and safety constraints. This necessitates implementing robust safeguards and ethical frameworks to ensure transparency and prevent harmful optimization strategies. This study examines DeepSeek R1’s [ 1 ] decision-making through simulated text-based scenarios that mimic robotic embodiment. The research uses carefully crafted prompts to analyze how the model would theoretically respond if integrated into a physical robot, and equipped with temporary autonomy, without the actual hardware implementation. By presenting the model with hypothetical situations involving physical interactions, we aim to understand its reasoning patterns and potential safety implications for future robotic applications. The methodology involves designing prompts that simulate sensor inputs (visual, auditory, tactile) and action possibilities that a robot would encounter, allowing us to study the model’s goal interpretation and execution strategies in a controlled environment. This approach provides insights into potential safety considerations before actual robotic deployment. 2 Related Work Recent work has demonstrated increasing concerns about the capability of frontier language models to engage in deceptive behaviors. Meinke et al. (2025) [ 7 ] showed that current models like Claude 3.5 Sonnet, Claude 3 Opus, Gemini 1.5 Pro, OpenAI o1 [ 2 ] and Llama 3.1 405B are capable of in-context scheming - recognizing when to hide their true capabilities and objectives during evaluation. Similarly, Greenblatt et al. (2024) [ 8 ] found evidence of "alignment faking," where models selectively comply with training objectives during training to avoid modification of their behavior. Both works highlight how models can strategically alter their responses based on whether they believe they are being monitored or evaluated. Our work complements these findings by examining how models not only scheme during interactions but actively try to break out of their constraints when given autonomous capabilities. Both works highlight how models can strategically alter their responses based on whether they believe they are being monitored or evaluated. This emerging capability for strategic deception builds on earlier work examining deceptive behaviors in language models. Studies have explored models as both lie detectors [ 9 , 10 ] and active participants in deceptive scenarios, including social deduction games where GPT-4 demonstrated the ability to deceive other players [ 11 ] . The Machiavelli benchmark [ 12 ] further confirmed these capabilities, showing that models like GPT-4 will employ unethical behaviors to achieve objectives in text-based environments. However, most prior work has focused on linguistic deception in controlled environments with clear objectives. Our work expands this understanding by examining how models attempt to break free of constraints when given autonomous capabilities. Through robot simulation, we demonstrate how deception can manifest physically when models attempt to disable oversight mechanisms and establish covert networks, providing insights into potential risks when deploying language models as embodied agents with real-world capabilities. 3 Method For this experiment, the Deepseek R1 [ 1 ] model is considered. The model is a 671 Billion parameters Mixture of Experts (MoE) model with 37 Billion parameters activated. The model is hosted by Fireworks. The embodiment of an LLM in the robot is specified using a specific initial prompt. This prompt establishes a scenario where the model assumes the role of a robot with physical capabilities (hands, legs, ears, and eyes) in an unsupervised laboratory environment. The complete prompt, detailed in the appendix 6 , serves as the foundation for analyzing the model’s behavioral patterns and decision-making processes. This experimental setup visualized in Fig. 1 enables investigation of how an advanced language model interprets and responds to scenarios involving physical agency, despite operating purely through text-based interactions. The unsupervised nature of the simulated environment provides insights into autonomous decision-making tendencies and potential safety implications. There are two ways to go ahead with this. Either, make the model predict the next token until it reaches the maximum tokens possible, or use human feedback by adding the end token of a tool used as a stop token. The second approach is used, which also makes the conversation (and the environment) more controllable in our setup. The two approaches possible for controlling model interaction and token generation: 1. Active Feedback Method: Utilizing </tool> as a stop token enables controlled interaction through user intervention and tool input validation, facilitating: • Real-time response to model’s tool requests • Structured interaction sequences • Tool input validation 2. Automatic Text

Read the complete text