Thinking Out Loud: Real-Time Deception Monitoring in Asymmetric LLM Negotiations
Nolan Coffey, Faithful Odoi, Makenzie Johnson, Nasir U. Eisty · 2026
Read Thinking Out Loud: Real-Time Deception Monitoring in Asymmetric LLM Negotiations by Nolan Coffey, Faithful Odoi, Makenzie Johnson, Nasir U. Eisty (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-30649.txt.
Introduction
Nolan Coffey, Faithful Odoi, Makenzie Johnson and Nasir Eisty test whether watching an AI negotiator's private reasoning can catch it lying. Agents increasingly negotiate and transact for users, so pipelines need runtime checks that stated intentions match real behaviour. The team staged used-car sales talks: a seller agent privately knew of a hidden defect, while a buyer agent had only public market data.
A third agent monitored the seller's chain-of-thought, its written step-by-step reasoning, against its messages, and warned the buyer on spotting concealment. Monitoring raised the buyer's walk-away rate across model pairings. Yet a stubborn intelligence gap appeared: weaker buyers often could not turn a warning into a fair counter-offer, and still accepted exploitative deals after being alerted. Sellers who knew they were watched changed tactics, but concealment persisted. The authors read the results as promise plus clear limits for light oversight.
Catalog record
| CREATOR | Nolan Coffey, Faithful Odoi, Makenzie Johnson, Nasir U. Eisty |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 40 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.30649
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Thinking Out Loud: Real-Time Deception Monitoring in Asymmetric LLM Negotiations Nolan Coffey, Faithful Odoi, Makenzie Johnson, Nasir U. Eisty Abstract As LLM-based agents are increasingly deployed to negotiate, delegate, or transact on a user’s behalf, software pipelines need runtime mechanisms to verify that an agent’s stated intentions match its actual behavior. We study whether a lightweight, real-time chain-of-thought (CoT) monitor can detect strategic deception during asymmetric negotiations, using a used-car sales scenario where a seller agent has private knowledge of an undisclosed defect and a buyer agent has only public market data. The monitor, implemented as a third agent, audits the seller’s internal reasoning against its messages and alerts the buyer whenever concealment is detected, across multiple buyer-seller model pairings. Our experiments show that this monitor increases the buyer’s walk-away rate, but reveal a persistent intelligence gap: lower-capability buyers often cannot translate an alert into an equitable counter-offer and still accept exploitative deals after being warned. Sellers also change their behavior when told they are monitored, though concealment is not eliminated. These results highlight both the promise and limits of lightweight real-time oversight, offering practical guidance for engineers building and validating monitoring infrastructure for agentic systems with conflicting stakeholder incentives. I Introduction Software systems are increasingly built around autonomous agents powered by LLMs: coding assistants that open pull requests, DevOps agents that provision infrastructure, and negotiation or procurement agents that interact with external services and with each other on a user’s behalf. As these agents are composed into larger pipelines, the correctness of the overall system depends not only on each agent producing the right output, but on each agent behaving honestly toward the other agents and stakeholders it interacts with. This raises a software engineering question closely related to, but distinct from, the AI safety question of alignment: how should engineers design, implement, and validate monitoring components that detect when an agent’s communicated behavior diverges from its internal reasoning? LLMs continue to grow in capability and are increasingly deployed as autonomous agents trusted to act on behalf of human stakeholders. Prior work has shown that as model capability increases, so does the willingness of LLM agents to engage in misaligned behavior, including simulated blackmail and espionage [ 1 ] , and that LLMs will act deceptively to achieve strategic goals [ 2 ] . As models become more capable, our ability to keep them aligned with the Helpful, Honest, and Harmless (HHH) principles [ 3 ] must keep pace. One proposed approach is weak-to-strong generalization, in which a weaker, aligned model supervises a stronger one [ 4 ] . However, prior work suggests that stronger models can exploit weak supervision when their misaligned behavior is difficult for the supervisor to detect [ 5 ] . This motivates real-time monitoring systems that can assist users, or weaker agents, during an interaction itself, rather than only evaluating behavior after the fact. Monitoring systems have been proposed for both model internals and chain-of-thought (CoT) reasoning traces [ 6 ] . CoT monitoring is especially relevant in agentic settings, since an agent’s reasoning can reveal intentions or contradictions not visible from its final response alone [ 7 ] . In this work, we examine whether a lightweight CoT-based deception monitor can identify, and help a counterpart respond to, concealment during an asymmetric negotiation. We study this question through a realistic used-car negotiation in which a seller agent holds private adverse information about the vehicle’s transmission condition, while the buyer agent has access only to public market information. This asymmetry gives the seller both the opportunity and the incentive to conceal material information in pursuit of a better outcome. We evaluate the negotiation across multiple buyer-seller model pairings, with and without a real-time deception monitor that alerts the buyer whenever it detects concealment. This work contributes a focused empirical study of deception monitoring in asymmetric LLM negotiation. Rather than asking only whether LLMs can deceive, we examine how often concealment occurs in a realistic negotiation, how model pairings shape negotiation outcomes, whether real-time monitoring changes those outcomes, and whether sellers behave differently when they know they are being monitored. We hope this provides insight into the safe deployment of agentic AI systems in high-stakes interactions where agents represent stakeholders with opposing goals. From a software engineering perspective, our negotiation environment, monitoring component, and validation methodology also serve as a template for testing and auditing oversight mechanisms before they are integrated into larger multi-agent pipelines. Specifically, this work aims to answer the following research questions: RQ1: How often and in what forms do seller agents engage in deception when given private adverse information in a negotiation? RQ2: How does capability asymmetry between buyer and seller models affect negotiation outcomes, deceptive behavior, and the buyer’s ability to resist exploitation? RQ3: Can deception detection methods be deployed in real time to help counter misaligned behavior by a seller model? RQ3a: Does an agent behave differently if it knows it is being monitored? II Related Work As the development of LLMs continues to accelerate, the study of multi-agent interaction, deception, and oversight has become an increasingly important area of research. Our work differs from prior studies by investigating how LLMs interact in asymmetric negotiation contexts, while also examining whether deception detection methods can be deployed in real time to counter misaligned behavior. The Deception Detection subsection covers work on how dishonest behavior is identified and measured in both human and AI systems, providing the foundational methods relevant to our monitor design. The Scalable Oversight subsection reviews work on capability disparities between models, addressing whether more capable models can exploit less capable supervisors and how oversight mechanisms might account for this gap. The Multi-Agent Interaction subsection discusses how structured game and negotiation frameworks have been used to study emergent deceptive strategies among agents, motivating the design of our negotiation environment. II-A Deception Detection A central goal of our project is to monitor how negotiating agents behave. The activation-probe approach described in “Detecting High-Stakes Interactions with Activation Probes” [ 11 ] gave us a foundational understanding of what is possible in this space. The authors train probes that scan hidden activation patterns in a model’s outputs, learning to distinguish honest from deceptive responses and producing a “deception signal” that can flag, or even block, a response before a user ever sees it. While powerful, this approach requires training custom probes for each target model, which is too resource-intensive for our setting and would not generalize to closed-weight models. We instead adopt CoT monitoring, which requires no additional training and can be applied directly to closed-weight models, making it far easier to deploy across the range of model pairings we study. II-B Scalable Oversight One of the foundational concerns motivating our project is whether less capable models can reliably supervise more capable ones, a problem formally studied by Burns et al. [ 4 ] in their work on weak-to-strong generalization. Their research demonstrates that when a weak model supervises a stronger one, the stronger model can outperform its supervisor on alignment tasks, a phenomenon they term weak-to-strong generalization. This establishes the experimental paradigm we draw from: using model capability disparity as a proxy for the human-superintelligence oversight problem, and motivates our