The Imitation Game: Using Large Language Models as Chatbots to Combat Chat-Based Cybercrimes CCS: Security and privacy Social aspects of security and privacy
Yifan Yao, Baojuan Wang, Jinhao Duan, Kaidi Xu, Chuankai Guo, Zhibo Eric Sun, Yue Zhang · 2025
Read The Imitation Game: Using Large Language Models as Chatbots to Combat Chat-Based Cybercrimes CCS: Security and privacy Social aspects of security and privacy by Yifan Yao, Baojuan Wang, Jinhao Duan, Kaidi Xu, Chuankai Guo, Zhibo Eric Sun, Yue Zhang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-21371.txt.
Introduction
Instead of filtering scam messages, why not waste the scammers' time and study them up close? Yifan Yao, Baojuan Wang, and five co-authors built LURE, a system that sends language-model chatbots into illicit Telegram video-chat scams posing as victims. It discovers groups, sustains adversarial conversations, and extracts payment details hidden inside images.
In over half of its chats, the bot held multi-round conversations without being spotted, engaging fifty-three actors across ninety-eight groups. The transcripts expose how these operations run: payment flows, upselling scripts, and tactics for migrating victims between platforms. The work flips Turing's imitation game into a defensive instrument, turning deception back on the deceivers.
Catalog record
| CREATOR | Yifan Yao, Baojuan Wang, Jinhao Duan, Kaidi Xu, Chuankai Guo, Zhibo Eric Sun, Yue Zhang |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 65 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2512-21371
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
The Imitation Game: Using Large Language Models as Chatbots to Combat Chat-Based Cybercrimes CCS: Security and privacy Social aspects of security and privacy Yifan Yao, Baojuan Wang, Jinhao Duan, Kaidi Xu, Chuankai Guo, Zhibo Eric Sun, Yue Zhang Abstract . Chat-based cybercrime has emerged as a pervasive threat, with attackers leveraging real-time messaging platforms to conduct scams that rely on trust-building, deception, and psychological manipulation. Traditional defense mechanisms, which operate on static rules or shallow content filters, struggle to identify these conversational threats—especially when attackers use multimedia obfuscation and context-aware dialogue. In this work, we ask a provocative question inspired by the classic Imitation Game : Can machines convincingly pose as human victims to turn deception against cybercriminals? We present LURE (LLM-based User Response Engagement), the first system to deploy Large Language Models (LLMs) as active agents (not as passive classifiers) embedded within adversarial chat environments. LURE combines automated discovery, adversarial interaction, and OCR-based analysis of image-embedded payment data. Applied to the setting of illicit video chat scams on Telegram, our system engaged 53 actors across 98 groups. In over 56% of interactions, the LLM maintained multi-round conversations without being noticed as a bot, effectively “winning” the imitation game. Our findings reveal key behavioral patterns in scam operations, such as payment flows, upselling strategies, and platform migration tactics. 1. Introduction Over the past decade, chat-based communication platforms such as Telegram ( telegram ) , WhatsApp ( whatsapp ) , and WeChat ( wechat ) have become integral to daily life, enabling users to connect instantly and globally. However, the very features that make these platforms popular anonymity, scalability, and real-time interaction—also render them attractive vectors for cybercriminal activities. A wide range of illicit behaviors, from romance scams and sextortion to impersonation fraud and credential phishing ( bilz2023tainted ; yang2025fraud ; zhao2024explain ) , increasingly begins with a simple message in a chat window. Unlike traditional malware that relies on technical exploits, these threats are driven by social engineering, where trust is gradually established and then weaponized against the victim. One prominent example is sextortion, where victims are lured into explicit video chats and then blackmailed with the recordings. According to the FBI, over 13,000 reports of financially motivated sextortion targeting minors were received from October 2021 to March 2023, resulting in at least 20 suicides ( fbi2023sextortion ) . Traditional defense systems, such as keyword matchers ( singh2020intelligent ; shah2021cybercrime ) , static rules ( soomro2019social ) , or user reporting, are poorly equipped to detect such nuanced threats. They typically lack memory of conversational history and fail to process mixed media content, such as screenshots or QR codes embedded in images. As a result, attackers can easily circumvent existing safeguards and escalate their tactics undetected. At the heart of many chat-based cybercrimes lies a powerful illusion. Attackers pretend to be someone they are not, adopting the persona of a romantic partner, a customer support representative, or a recruiter in order to manipulate their victims. This observation raises an intriguing countermeasure: what if machines could do the same, not to deceive innocent users, but to infiltrate and investigate malicious actors? This idea is inspired by the classic Imitation Game ( hodges2014alan ) , which tests a machine’s ability to convincingly mimic human conversation. With the rapid advancement of Large Language Models (LLMs), machines are now capable of producing highly fluent, context-aware, and emotionally resonant dialogue. While LLMs have been adopted for use cases such as code auditing and log summarization, they have largely been treated as passive tools. In this paper, we reimagine their role as active participants in adversarial settings. We ask whether LLMs can convincingly engage with cybercriminals, sustain realistic conversations, and extract operational intelligence without being detected. We introduce LURE ( L LM-based U ser R esponse E ngagement), the first system to deploy LLMs as autonomous conversational agents embedded within real-world cybercrime ecosystems. LURE performs illicit channel discovery, actor identification, and live engagement through carefully prompted LLM chatbots. To handle non-textual content commonly used to evade detection, such as QR codes and payment images, LURE integrates optical character recognition (OCR), enabling the chatbot to interpret and respond to both visual and textual elements. Our empirical study focuses on illicit video chat scams, a prevalent and understudied form of chat-based cybercrime. Across 98 Telegram groups, we identified 120 suspected service providers and engaged 53 of them in sustained interactions. Because this research involves engaging with potentially real individuals, we manually reviewed all conversations before sending them to the actors to ensure no unnecessary harm was caused. This precaution limited our ability to scale up the experiment, as each interaction required careful human oversight. Despite the adversarial setting, only 8 interactions (15.1%) ended prematurely, while 30 actors (56.6%) proceeded naturally, often involving price negotiation, upselling, or redirection to third-party applications. The remaining cases were dead-on-arrival conversations, where the actor never responded to our initial message. These findings highlight the LLM’s ability to convincingly mimic human behavior and sustain realistic dialogue. In most cases, the model was accepted as a legitimate user—successfully playing and winning the “Imitation Game” in the eyes of cybercriminals. Those 30 actors disclosed at least one payment method, with a total of 62 distinct payment disclosures. USDT (24.19%), WeChat Pay (22.58%), and Alipay (19.35%) were the most common, and 41.9% of payment details were embedded in images, requiring OCR-based extraction. LLM agents maintained multi-round conversations with a median of 3 rounds before disengagement. We also analyzed pricing strategies across 41 conversations where service length was mentioned. Prices ranged from 100 to 680 CNY, and longer durations did not scale linearly in cost. In one notable case, an actor directed our LLM-driven agent to download an application called “Mugua Video.” This app posed as a video streaming platform but was in fact a front for adult services and online gambling, requiring users to recharge their accounts via Alipay or bank transfer. We would like to note that although our study focuses on a specific genre of chat-based cybercrimes, we believe that the techniques developed in LURE generalize to a wide range of adversarial dialogue settings, including romance scams, phishing, fake customer support, and investment fraud. In any domain where deception unfolds through conversation, LLMs can play an active defensive role by embedding themselves directly in the interaction loop. Moreover, our objective extends beyond intelligence collection. We envision a scalable defense strategy in which LLMs are deployed across illicit platforms to simulate engagement and absorb adversarial attention. By interacting with cybercriminals through realistic dialogue, these agents can waste their time, expose their tactics, and create uncertainty about whether potential victims are real. As cybercriminals increasingly encounter fake users instead of actual targets, their operations become less efficient, more costly, and easier to disrupt. This shift undermines the economic and psychological foundations of trust-based cybercrime. In summary, our work makes the following contributions: • We propose a novel paradigm for LLMs as active agents embedded within adversarial ecosystems, transforming their role from passive detectors to proactive participants. • We design and implement LURE, an end-to-end system that operationalizes this paradigm through automated channel discovery, LLM-guided engagement, and visual content extraction. • We conduct the first large-scale empirical study